|
How do I stop Googlebot from raping my site? 8000+ spider hits?
Site is under 5 days old and I get this crap!
Googlebot 3221 49.17 MB 16 Sep 2006 - 04:52
Inktomi Slurp 3045 24.24 MB 16 Sep 2006 - 04:53
Unknown robot (identified by 'crawl') 1610 31.45 MB 16 Sep 2006 - 04:53
MSNBot 59 557.32 KB 16 Sep 2006 - 04:53
AskJeeves 39 574.24 KB 16 Sep 2006 - 04:24
Just kidding. If you want to invest in building some automated traffic targetted to any market email me with your needs and lets chat.
|