Thread: robots.txt....WTF?
View Single Post
Old 12-06-2003, 11:15 AM  
Greg B
So Fucking Banned
 
Join Date: Jul 2001
Location: EARTH (for the time being)
Posts: 7,014
robots.txt....WTF?
Okay, been a while, but what's the advantage of having a robots.txt file?
Greg B is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote