Googlebot, Inktomi Slurp & Gigabot

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • AgentCash
    Confirmed User
    • Feb 2002
    • 720

    #1

    Googlebot, Inktomi Slurp & Gigabot

    I just noticed they always hit my sites within seconds of each other. What's the word on this? I find it awfully strange that competitors would be spidering the same site at the exact same time. Any of you SE gurus care to tell me why they do that?
  • WiredGuy
    Pounding Googlebot
    • Aug 2002
    • 34517

    #2
    Most SE bots I track coming at late night, between 2-4am est. Makes sense to me, most people are asleep at this hour so it won't stress the servers they're hitting.

    WG
    I play with Google.

    Comment

    • AgentCash
      Confirmed User
      • Feb 2002
      • 720

      #3
      Well I've been going through my server logs and for at least the past 2 weeks they keep in sync with each other. Hitting the site every 2-3 hours all at the same time or just a few seconds apart.

      That's why it seemed so strange to me. I mean I could understand minutes difference or hours, but to all do it in sync for weeks looks awfully strange.

      Comment

      • Rorschach
        So Fucking Banned
        • Aug 2002
        • 5579

        #4
        It's obviously a conspiracy. I blame Bill Gates.

        Comment

        • AgentCash
          Confirmed User
          • Feb 2002
          • 720

          #5
          And G.W. don't forget him. They're all in cahoots.

          Comment

          • WiredGuy
            Pounding Googlebot
            • Aug 2002
            • 34517

            #6
            Don't forget Google employs government spooks. They're monitoring this board, just look, PR1. They know everything.

            WG
            I play with Google.

            Comment

            • ~Ray
              visit hardlinks.org
              • Jun 2003
              • 18361

              #7
              <img src="http://www.advertisingsex.com/gay.jpg">
              Adult Backlinks for Adult Websites - Testimonials Available

              Comment

              • Basic_man
                Programming King Pin
                • Oct 2003
                • 27360

                #8
                Originally posted by AdvertisingSex
                <img src="http://www.advertisingsex.com/gay.jpg">
                Yeah I think you're right! lol
                UUGallery Builder - automated photo/video gallery plugin for Wordpress!
                Stop looking! Checkout Naked Hosting, online since 1999 !

                Comment

                Working...