Thread
:
leaving out robots.txt ?
View Single Post
06-02-2007, 01:05 PM
Tempest
Too lazy to set a custom title
Industry Role:
Join Date: May 2004
Location: West Coast, Canada.
Posts: 10,217
You probably want to get around to using robots.txt. Apparently there's a new command that lets you tell the SE bots where your sitemap is.
Tempest
View Public Profile
Find More Posts by Tempest