Thread: I have several different crawlers
View Single Post
Old 11-08-2010, 05:09 AM  
redwhiteandblue
Bollocks
 
redwhiteandblue's Avatar
 
Industry Role:
Join Date: Jun 2007
Location: Bollocks
Posts: 2,793
Block the little fuckers in your htaccess, most of them are up to no good or at least a waste of bandwidth.
redwhiteandblue is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote