![]() |
how do I stop google from including my RSS feed in normal SERPs?
Google is including my RSS feed as a search result - it doesn't seem to recognise/care that it's in XML...
The obvious solution would be to exclude that file with robots.txt, but I'm concerned that it may affect some services which should be accessing that file. Anyone run into this problem before? |
you don't have to worry about google's including your rss feeds. I asked Matt Cutts on his blog and he answered that there's no reason to block spiders from indexing your rss feeds. They'll simply distinguish between real page and the feed, and display original page in serps.
|
Quote:
144.139.37.*- - [21/Oct/2007:14:03:38 +1000] "GET /rss.php HTTP/1.1" 200 31210 http://www.google.com.au/search?hl=en&q=***&btnG=Search&meta=cr%3DcountryAU |
I could exclude rss.php for user-agent Googlebot only, but I'm not sure if their bloggy and RSS specific stuff also uses Googlebot.
It's not really a big problem, but it does mean there's potential for someone unfamiliar with XML to see "junk" when they click on a result, and get confused/scared off... |
excluding rss.php for user-agent Googlebot is against Google's quality guidelines and such behavior will be seen as spam, hence the site will be probably banned. So I don't recommend this solution.
If that rss thing really bothers you, just exclude rss.php (or whatever) via simple robots.txt Disallow clause and you're all set. |
just to clear up... when i wrote that excluding a page only for certain user-agent sting i meant excluding page via php, javascript and other 'sneaky' technique.
It's of course legitimate and legal to exclude the page via robots.txt and specify User-Agent: clause to address to certain search engines bot. You could do that w/o problems. I am pretty much certain other google bots (media, images, etc) will keep indexing that page. |
exclude that shit in robots.txt file
|
All times are GMT -7. The time now is 12:01 AM. |
Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123