everdred (everdred) wrote in suggestions,

Tell search spiders to ignore "post comment" pages

Tell search spiders to ignore "post comment" pages

Short, concise description of the idea
While going through some Google results looking for an entry of mine, I realized that quite a few of the results were "post comment" pages - considerably less useful than actual entry pages would be.

Full description of the idea
Tell spiders (via robots.txt, I presume) to ignore URLs with "mode=reply" in them.

An ordered list of benefits
  • Search results would be more concise.
  • Search results would be more useful, since actual entry pages may contain comments left in reply to the entry.

An ordered list of problems/issues involved
  • None, that I can see. Can anyone help me out here?

An organized list, or a few short paragraphs detailing suggestions for implementation
  • If this could be done for both subdomain style addresses as well as the default, that would be super.
Tags: external services, ~ submitted - needs retagging
  • Post a new comment


    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

    Your IP address will be recorded