Thread
:
robots.txt file?
View Single Post
03-03-2005, 01:54 PM
psili
Confirmed User
Join Date: Apr 2003
Location: Loveland, CO
Posts: 5,526
I think it's used more to define parts you don't want crawled. The meta tags should take care if you just want to be crawled.
__________________
Your post count means nothing.
psili
View Public Profile
Visit psili's homepage!
Find More Posts by psili