Thread: Anti Mass Site downloader, Bots Scripts?
View Single Post
Old 09-02-2004, 04:16 PM  
johnbosh
Confirmed User
 
Join Date: Aug 2002
Location: The Netherlands, Rotterdam
Posts: 8,965
there is a robot.txt for
johnbosh is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote