Googlebot wtf?

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • fusionx
    Confirmed User
    • Nov 2003
    • 4618

    #1

    Googlebot wtf?

    Anyone else get beat up by googlebot like this?

    Googlebot 29414+33 1.04 GB

    That's hits plus bandwidth so far this month - on one small site.
  • baddog
    So Fucking Banned
    • Apr 2001
    • 107089

    #2
    you aren't complaining are you?

    Comment

    • baddog
      So Fucking Banned
      • Apr 2001
      • 107089

      #3
      if you are, try robots.txt

      Comment

      • fusionx
        Confirmed User
        • Nov 2003
        • 4618

        #4
        hehe - not complaining in that sense..

        Seems like a lot of traffic for a site that doesn't really update.

        Could someone be spoofing googlebot?

        Comment

        • rigrunner
          Confirmed User
          • Jan 2004
          • 877

          #5
          wow i get googlebot everyday and it doesn't run up that much bandwidth...
          Get Nasty - Make Bank Here

          Comment

          • chaze
            Confirmed User
            • Aug 2002
            • 9774

            #6
            If you site is a gig then it will spider a little less then a gig if it likes you, it basically downloads you site when you are in there a list.

            Congrats
            Like the desert needs the rain
            We do fully manged WordPress, VPS, and Servers. Adult Host Pro https://adulthostpro.com/ Since 2001

            Comment

            • woj
              <&(©¿©)&>
              • Jul 2002
              • 47882

              #7
              wow, you really got owned...
              Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000
              Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager
              Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager

              Comment

              • squishypimp
                PostMaster General
                • Aug 2006
                • 10781

                #8
                google is mad at you...

                Comment

                • BSleazy
                  Confirmed User
                  • Aug 2002
                  • 6721

                  #9
                  There's a crawl rate option in the google webmaster tools. If a gig a month is a problem for you then slow it down.
                  icq 156131086

                  Comment

                  Working...