GoFuckYourself.com - Adult Webmaster Forum - View Single Post - How do I stop Googlebot from raping my site? 8000+ spider hits?

Solid Bob · 09-16-2006, 09:24 AM

Site is under 5 days old and I get this crap!

Googlebot 3221 49.17 MB 16 Sep 2006 - 04:52
Inktomi Slurp 3045 24.24 MB 16 Sep 2006 - 04:53
Unknown robot (identified by 'crawl') 1610 31.45 MB 16 Sep 2006 - 04:53
MSNBot 59 557.32 KB 16 Sep 2006 - 04:53
AskJeeves 39 574.24 KB 16 Sep 2006 - 04:24

Just kidding. If you want to invest in building some automated traffic targetted to any market email me with your needs and lets chat.

09-16-2006, 09:24 AM
Solid Bob Confirmed User Join Date: Apr 2006 Location: Easy Webcam Pro Posts: 1,213	How do I stop Googlebot from raping my site? 8000+ spider hits? Site is under 5 days old and I get this crap! Googlebot 3221 49.17 MB 16 Sep 2006 - 04:52 Inktomi Slurp 3045 24.24 MB 16 Sep 2006 - 04:53 Unknown robot (identified by 'crawl') 1610 31.45 MB 16 Sep 2006 - 04:53 MSNBot 59 557.32 KB 16 Sep 2006 - 04:53 AskJeeves 39 574.24 KB 16 Sep 2006 - 04:24 Just kidding. If you want to invest in building some automated traffic targetted to any market email me with your needs and lets chat. __________________ [email protected]