I just noticed they always hit my sites within seconds of each other. What's the word on this? I find it awfully strange that competitors would be spidering the same site at the exact same time. Any of you SE gurus care to tell me why they do that?
Googlebot, Inktomi Slurp & Gigabot
Collapse
X
-
Well I've been going through my server logs and for at least the past 2 weeks they keep in sync with each other. Hitting the site every 2-3 hours all at the same time or just a few seconds apart.
That's why it seemed so strange to me. I mean I could understand minutes difference or hours, but to all do it in sync for weeks looks awfully strange.Comment
-
<img src="http://www.advertisingsex.com/gay.jpg">Comment
-
Yeah I think you're right! lolOriginally posted by AdvertisingSex
<img src="http://www.advertisingsex.com/gay.jpg">
UUGallery Builder - automated photo/video gallery plugin for Wordpress!
Stop looking!
Checkout Naked Hosting, online since 1999 ! 

Comment

Comment