Thread
:
robots.txt file?
View Single Post
03-03-2005, 06:00 PM
nico-t
emperor of my world
Join Date: Aug 2004
Location: nethalands
Posts: 29,903
Quote:
Originally Posted by
psili
I think it's used more to define parts you don't want crawled. The meta tags should take care if you just want to be crawled.
yeah thats what i think too... so no robots text file for me
nico-t
View Public Profile
Find More Posts by nico-t