Advertisement:

Author Topic: Indexing Error - How to Remove '.msg%msg_id%'  (Read 5352 times)

Offline InfoStrides

  • Full Member
  • ***
  • Posts: 497
  • www.TheInfoStrides.com
    • InfoStrides on Facebook
    • @TheInfoStrides on Twitter
    • TheInfoStrides.com
Indexing Error - How to Remove '.msg%msg_id%'
« on: December 30, 2009, 04:29:38 AM »
I need help on how to achieve the subject matter. I discovered that there has always been problems with indexing when the post url is in this format:

http://www.infostridesforum.com/index.php?topic=358.msg%msg_id%

Is it possible to have something like below:

http://www.infostridesforum.com/index.php?topic=358

Moreso,

can the post url always be in this format:
http://www.infostridesforum.com/grants-scholarships/african-virtual-university-scholarship-programs/

Instead of:
http://www.infostridesforum.com/grants-scholarships/african-virtual-university-scholarship-programs/msg493/#msg493

Please help. This is affecting search engine crawling.

Thanks.

Offline DavidCT

  • Sophist Member
  • *****
  • Posts: 1,239
  • Gender: Male
  • $$$ This $pace For Rent $$$
    • Home Plate Network's Ballpark
Re: Indexing Error - How to Remove '.msg%msg_id%'
« Reply #1 on: December 30, 2009, 03:14:53 PM »
Add this to robots.txt for Google and Yahoo and whomever else...

Disallow: /*msg*

SMF does automatically do a NOINDEX for those pages, at least it does on mine :)

As for the other thing, check out the mods - Pretty URL is one and I think there is another... (which it appears you are using one of them).  If it doesn't work as you expect, ask for support in their support area (shown on the mod page)

Offline H

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 21,662
  • Gender: Male
Re: Indexing Error - How to Remove '.msg%msg_id%'
« Reply #2 on: December 30, 2009, 03:17:41 PM »
Quote
SMF does automatically do a NOINDEX for those pages, at least it does on mine :)

Duplicate content prevention is only part of 2.0+ ;)
-H
Former Support Team Lead
                              I recommend:
Namecheap (domains)
Fastmail (e-mail)
Linode (VPS)
                             

Offline DavidCT

  • Sophist Member
  • *****
  • Posts: 1,239
  • Gender: Male
  • $$$ This $pace For Rent $$$
    • Home Plate Network's Ballpark
Re: Indexing Error - How to Remove '.msg%msg_id%'
« Reply #3 on: December 30, 2009, 03:43:22 PM »
Quote
SMF does automatically do a NOINDEX for those pages, at least it does on mine :)

Duplicate content prevention is only part of 2.0+ ;)

Umm, well...

index.template.php 1.1.5 (of 1.1.11)
Code: [Select]
<meta name="description" content="', $context['page_title'], '" />', empty($context['robot_no_index']) ? '' : '
<meta name="robots" content="noindex" />', '

SMF 1.1.x DOES NOINDEX a /index.php?topic=25.msg182 URL - I checked by using a different unmodified theme (included with SMF)

Offline InfoStrides

  • Full Member
  • ***
  • Posts: 497
  • www.TheInfoStrides.com
    • InfoStrides on Facebook
    • @TheInfoStrides on Twitter
    • TheInfoStrides.com
Re: Indexing Error - How to Remove '.msg%msg_id%'
« Reply #4 on: January 01, 2010, 05:12:36 AM »
Add this to robots.txt for Google and Yahoo and whomever else...

Disallow: /*msg*

SMF does automatically do a NOINDEX for those pages, at least it does on mine :)

As for the other thing, check out the mods - Pretty URL is one and I think there is another... (which it appears you are using one of them).  If it doesn't work as you expect, ask for support in their support area (shown on the mod page)

Thank you. This has been done! Waiting for its action.

I use Pretty URL.

Thanks to all.

Offline Arantor

  • Resident Overthinker
  • SMF Friend
  • SMF Legend
  • *
  • Posts: 71,647
    • StoryBB/StoryBB on GitHub
Re: Indexing Error - How to Remove '.msg%msg_id%'
« Reply #5 on: January 01, 2010, 08:19:52 AM »
This was also fixed separately in 2.0 so those links were never generated in the first place.
Don’t try to tell me that some power can corrupt a person. You haven’t had enough to know what it’s like.

No good deed goes unpunished / No act of charity goes unresented.

Offline InfoStrides

  • Full Member
  • ***
  • Posts: 497
  • www.TheInfoStrides.com
    • InfoStrides on Facebook
    • @TheInfoStrides on Twitter
    • TheInfoStrides.com
Re: Indexing Error - How to Remove '.msg%msg_id%'
« Reply #6 on: January 03, 2010, 03:59:32 AM »
Thank you all. This has been resolved. I can see the errors reducing now.

Meanwhile, I have an observation about the behaviours of my Google Ads when the url in the format below, the google ads do not show:

http://www.infostridesforum.com/announcements/free-website-listing-on-infostrides-directory/msg913/?topicseen#msg913

But when the url is in the following format, everything works fine:

http://www.infostridesforum.com/announcements/free-website-listing-on-infostrides-directory/

The strings "msg913/?topicseen#msg913" always occur when I click via recent posts. Please help me out!

Offline CR Forum

  • Semi-Newbie
  • *
  • Posts: 99
Re: Indexing Error - How to Remove '.msg%msg_id%'
« Reply #7 on: July 28, 2011, 06:22:46 AM »
Thank you all. This has been resolved. I can see the errors reducing now.

Meanwhile, I have an observation about the behaviours of my Google Ads when the url in the format below, the google ads do not show:

http://www.infostridesforum.com/announcements/free-website-listing-on-infostrides-directory/msg913/?topicseen#msg913

But when the url is in the following format, everything works fine:

http://www.infostridesforum.com/announcements/free-website-listing-on-infostrides-directory/

The strings "msg913/?topicseen#msg913" always occur when I click via recent posts. Please help me out!

I am having the same problem with adsense ads. Does anybody have an idea how to remove the last part of the url when the page is rendered,
Thanks

Offline Illori

  • Project Manager
  • SMF Legend
  • *
  • Posts: 51,286
Re: Indexing Error - How to Remove '.msg%msg_id%'
« Reply #8 on: July 28, 2011, 06:29:57 AM »
please open a separate thread for your issue, this thread belongs to someone else and is marked solved.