Thread: How do I stop Googlebot from raping my site? 8000+ spider hits?
View Single Post
Old 09-16-2006, 12:54 PM  
wedouglas
So Fucking Banned
 
Join Date: Aug 2004
Location: Dearborn, MI
Posts: 5,921
25352 1.74% Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.co
43779 3.01% Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/
wedouglas is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote