Google Bot.

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Walrus
    Confirmed User
    • May 2005
    • 2150

    #1

    Google Bot.

    How often does the Google Bot come scan your web site? I can see when it comes in my stats. But I don't ever remember being albe to tell when Yahoo or MSN has scanned.
  • BastarD
    Confirmed User
    • Apr 2004
    • 6341

    #2
    it all depends how many and what quality inbound links you have and also site content is very important, how often it is updated etc.

    I have google bot, yahoo and msn spiders few times a day on each of my sites.

    Comment

    • IceMaster
      Confirmed User
      • Jan 2005
      • 8920

      #3
      Everyday. It depends on the Pr of the site.

      Comment

      • Manowar
        jellyfish  
        • Dec 2003
        • 71528

        #4
        everyday

        Comment

        • Walrus
          Confirmed User
          • May 2005
          • 2150

          #5
          Everyday for you guys, wow. So does your PR for some pages change on a daily basis too? Or is all PR for every page on every web site only done every few months?

          Also, what does the url look like in your stats for MSN and Yahoo? Is it similar to Google, where it has "bot" in the link?

          - Walrus

          Comment

          • Alky
            Confirmed User
            • Apr 2002
            • 5651

            #6
            Pr is updated every few months

            65.54.188.72 - - [03/Sep/2005:06:33:03 -0400] "GET / HTTP/1.0" 200 49510 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"

            66.196.91.167 - - [02/Sep/2005:20:26:25 -0400] "GET / HTTP/1.0" 200 60744 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"

            Comment

            • Walrus
              Confirmed User
              • May 2005
              • 2150

              #7
              Alky, thanks. What did you use to get those stats? Raw logs or did you use something like webalyzer? I am looking for a new host with better raw logs. With WebAir's Virtual Hosting you don't get stats like you showed above that has IP address with referring URL.

              - Walrus

              Comment

              • Alky
                Confirmed User
                • Apr 2002
                • 5651

                #8
                Originally posted by Walrus
                Alky, thanks. What did you use to get those stats? Raw logs or did you use something like analyzer? I am looking for a new host with better raw logs. With WebAir's Virtual Hosting you don't get stats like you showed above that has IP address with referring URL.

                - Walrus
                just from the raw logs.

                Comment

                • Walrus
                  Confirmed User
                  • May 2005
                  • 2150

                  #9
                  Originally posted by Alky
                  just from the raw logs.
                  Virtual or dedicated? And which hosting company, and how much $$/month? WebAir's Dedicated servers have it, but I get less than 1k visitors a day to my cam site. I'm not going to pay more just to have better stats when I can get it elsewhere, and for free with Virtual. They are a great hosting company but I need better stats. Right now I'm paying $9.95/month.

                  - Walrus
                  Last edited by Walrus; 09-03-2005, 04:56 AM.

                  Comment

                  • wedouglas
                    So Fucking Banned
                    • Aug 2004
                    • 5921

                    #10
                    in August on my PR4 that gets about 600 a day

                    20 1127 0.85% Googlebot/2.1 (+http://www.google.com/bot.html)

                    Comment

                    Working...