GoFuckYourself.com - Adult Webmaster Forum - View Single Post

brizzad · 01-07-2004, 07:25 PM

If I don't want the SE bots going into a directory, let's say whatever.com/members, what would I put in my robots.txt? Thanks

01-07-2004, 07:25 PM
brizzad holla Join Date: Jul 2003 Location: KFC Posts: 11,769	robots.txt question... If I don't want the SE bots going into a directory, let's say whatever.com/members, what would I put in my robots.txt? Thanks