GoFuckYourself.com - Adult Webmaster Forum - View Single Post

Mr Pheer · 05-31-2007, 01:48 PM

wonder why it took them so long to adopt this?

pretty cool... tell the spider right where your sitemap is with your robots.txt file.

more info here:
http://www.marketposition.com/blog/a..._new_tr_1.html

05-31-2007, 01:48 PM
Mr Pheer Top Rated CEO Industry Role: Join Date: Dec 2002 Location: Las Vegas Posts: 21,892	new sitemap command for robots.txt file wonder why it took them so long to adopt this? pretty cool... tell the spider right where your sitemap is with your robots.txt file. more info here: http://www.marketposition.com/blog/a..._new_tr_1.html __________________