Thread: Can someone explain this robots.txt for me
View Single Post
Old 09-02-2004, 04:20 AM  
ClamSmacker
Confirmed User
 
Join Date: May 2004
Location: Oztralia
Posts: 677
http://www.robotstxt.org/wc/norobots.html
ClamSmacker is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote