Caffeine spiders my Mainstream sites in seconds

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • Argos88
    So Fucking Banned
    • Sep 2009
    • 1732
    #1

    Caffeine spiders my Mainstream sites in seconds

    During the last few months, I noticed that caffeine spiders my Mainstream sites in a matter of seconds... Man, my last post was cached in 10 seconds by google! Then I type the title of the post in Google and there I am! In the first positions with "1 minute ago"! Amazing! And yes, it gets SE traffic if you ask that.

    I don't notice the same with my adult sites though, even older adult established sites don't get spidered this fast, like my mainstream sites. Another great reason to switch over to Mainstream.

    .
    Tags: None
    • epitome
      So Fucking Lame
      • Jun 2009
      • 12156
      #2
      I have two social networks and have noticed that the Google bot never leaves. Ever.

        Comment

        • rowan
          Too lazy to set a custom title
          • Mar 2002
          • 17393
          #3
          How could G consistently find new posts within 10 seconds unless it's repeatedly hammering a site? Imagine if all SE bots went fishing like that!

          I kind of have the opposite problem, there's too much content for it to ever completely index so it just fetches endlessly, more than 120,000+ per day...

            Comment

            • seeandsee
              Check SIG!
              • Mar 2006
              • 50945
              #4
              How much band does google takes that way ??!?
              BUY MY SIG - 50$/Year

              Contact here

                Comment

                • Argos88
                  So Fucking Banned
                  • Sep 2009
                  • 1732
                  #5
                  Originally posted by epitome
                  I have two social networks and have noticed that the Google bot never leaves. Ever.
                  What script/software are you using for your social bookmarking sites?

                    Comment

                    • Cyber Fucker
                      Hmm
                      • Sep 2005
                      • 12642
                      #6
                      Google = Evil

                      and seriously it's really worrying that there is something like Google owned by god knows who and with no serious alternatives...



                        Comment

                        • VHNet
                          Confirmed User
                          • May 2005
                          • 386
                          #7
                          I'm wondering if google uses its never-ending cookie on people's computers to tell it when new content is viewed and should be spidered?
                          Bringing mainstream marketing to the Adult Industry

                          ICQ: 221976033

                            Comment

                            Previous template Next
                            Working...