Thread
:
robots.txt question
View Single Post
11-15-2004, 12:26 AM
sake
Confirmed User
Industry Role:
Join Date: Apr 2002
Location: Toronto
Posts: 2,646
with a robots.txt file you're telling google which directories to crawl and which not to crawl..
and it goes in your main directory .. public_html or whatever it is
sake
View Public Profile
Find More Posts by sake