GoFuckYourself.com - Adult Webmaster Forum - View Single Post - how do I stop google from including my RSS feed in normal SERPs?

beta-tester · 10-21-2007, 08:19 AM

just to clear up... when i wrote that excluding a page only for certain user-agent sting i meant excluding page via php, javascript and other 'sneaky' technique.

It's of course legitimate and legal to exclude the page via robots.txt and specify User-Agent: clause to address to certain search engines bot.

You could do that w/o problems. I am pretty much certain other google bots (media, images, etc) will keep indexing that page.

10-21-2007, 08:19 AM
beta-tester Rock 'n Roll Baby! Join Date: Sep 2004 Location: USA, temporarly Posts: 22,562	just to clear up... when i wrote that excluding a page only for certain user-agent sting i meant excluding page via php, javascript and other 'sneaky' technique. It's of course legitimate and legal to exclude the page via robots.txt and specify User-Agent: clause to address to certain search engines bot. You could do that w/o problems. I am pretty much certain other google bots (media, images, etc) will keep indexing that page. __________________ Sig for sale. Affordable prices. Contact me and get a great deal ;) My contact: ICQ: 944-320-46 e-mail: manca {AT} HotFreeSex4All.com