Thread: Robots.txt Fun
View Single Post
Old 01-01-2008, 10:12 PM  
minusonebit
So Fucking Banned
 
Join Date: Feb 2006
Posts: 7,391
Quote:
Originally Posted by FredIsMe View Post
I'm surprised that these bots would actually listen.
Me too, but apparently they do otherwise I doubt wikipedia would put them in there...
minusonebit is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote