how do I stop google from including my RSS feed in normal SERPs?

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • rowan
    Too lazy to set a custom title
    • Mar 2002
    • 17393
    #1

    how do I stop google from including my RSS feed in normal SERPs?

    Google is including my RSS feed as a search result - it doesn't seem to recognise/care that it's in XML...

    The obvious solution would be to exclude that file with robots.txt, but I'm concerned that it may affect some services which should be accessing that file.

    Anyone run into this problem before?
    Tags: None
    • beta-tester
      Rock 'n Roll Baby!
      • Sep 2004
      • 22562
      #2
      you don't have to worry about google's including your rss feeds. I asked Matt Cutts on his blog and he answered that there's no reason to block spiders from indexing your rss feeds. They'll simply distinguish between real page and the feed, and display original page in serps.

      Sig for sale. Affordable prices. Contact me and get a great deal ;)

      My contact:
      ICQ: 944-320-46
      e-mail: manca {AT} HotFreeSex4All.com

        Comment

        • rowan
          Too lazy to set a custom title
          • Mar 2002
          • 17393
          #3
          Originally posted by beta-tester
          you don't have to worry about google's including your rss feeds. I asked Matt Cutts on his blog and he answered that there's no reason to block spiders from indexing your rss feeds. They'll simply distinguish between real page and the feed, and display original page in serps.
          Hmmm... this is not a hypothetical concern, Google is actually linking to rss.php in some of its results. Other search queries link to / as expected.

          144.139.37.*- - [21/Oct/2007:14:03:38 +1000] "GET /rss.php HTTP/1.1" 200 31210 http://www.google.com.au/search?hl=en&q=***&btnG=Search&meta=cr%3DcountryAU

            Comment

            • rowan
              Too lazy to set a custom title
              • Mar 2002
              • 17393
              #4
              I could exclude rss.php for user-agent Googlebot only, but I'm not sure if their bloggy and RSS specific stuff also uses Googlebot.

              It's not really a big problem, but it does mean there's potential for someone unfamiliar with XML to see "junk" when they click on a result, and get confused/scared off...

                Comment

                • beta-tester
                  Rock 'n Roll Baby!
                  • Sep 2004
                  • 22562
                  #5
                  excluding rss.php for user-agent Googlebot is against Google's quality guidelines and such behavior will be seen as spam, hence the site will be probably banned. So I don't recommend this solution.

                  If that rss thing really bothers you, just exclude rss.php (or whatever) via simple robots.txt Disallow clause and you're all set.

                  Sig for sale. Affordable prices. Contact me and get a great deal ;)

                  My contact:
                  ICQ: 944-320-46
                  e-mail: manca {AT} HotFreeSex4All.com

                    Comment

                    • beta-tester
                      Rock 'n Roll Baby!
                      • Sep 2004
                      • 22562
                      #6
                      just to clear up... when i wrote that excluding a page only for certain user-agent sting i meant excluding page via php, javascript and other 'sneaky' technique.

                      It's of course legitimate and legal to exclude the page via robots.txt and specify User-Agent: clause to address to certain search engines bot.

                      You could do that w/o problems. I am pretty much certain other google bots (media, images, etc) will keep indexing that page.

                      Sig for sale. Affordable prices. Contact me and get a great deal ;)

                      My contact:
                      ICQ: 944-320-46
                      e-mail: manca {AT} HotFreeSex4All.com

                        Comment

                        • Bird
                          Confirmed User
                          • Jan 2005
                          • 4365
                          #7
                          exclude that shit in robots.txt file
                          ICQ:268731675

                            Comment

                            Previous template Next
                            Working...