Thread
:
robots.txt question
View Single Post
06-02-2005, 05:33 AM
Muff
Confirmed User
Join Date: Mar 2001
Location: Toronto
Posts: 1,782
I think you can limit certain urls from being crawled... Google it to see for sure.
Muff
View Public Profile
Find More Posts by Muff