Google Bot.
 

How often does the Google Bot come scan your web site? I can see when it comes in my stats. But I don't ever remember being albe to tell when Yahoo or MSN has scanned.

it all depends how many and what quality inbound links you have and also site content is very important, how often it is updated etc.

I have google bot, yahoo and msn spiders few times a day on each of my sites.

Everyday. It depends on the Pr of the site.

everyday

Everyday for you guys, wow. So does your PR for some pages change on a daily basis too? Or is all PR for every page on every web site only done every few months?

Also, what does the url look like in your stats for MSN and Yahoo? Is it similar to Google, where it has "bot" in the link?

- Walrus

Pr is updated every few months

65.54.188.72 - - [03/Sep/2005:06:33:03 -0400] "GET / HTTP/1.0" 200 49510 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"

66.196.91.167 - - [02/Sep/2005:20:26:25 -0400] "GET / HTTP/1.0" 200 60744 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"

Alky, thanks. What did you use to get those stats? Raw logs or did you use something like webalyzer? I am looking for a new host with better raw logs. With WebAir's Virtual Hosting you don't get stats like you showed above that has IP address with referring URL.

- Walrus

just from the raw logs.

Virtual or dedicated? And which hosting company, and how much $$/month? WebAir's Dedicated servers have it, but I get less than 1k visitors a day to my cam site. I'm not going to pay more just to have better stats when I can get it elsewhere, and for free with Virtual. They are a great hosting company but I need better stats. Right now I'm paying $9.95/month.

- Walrus

in August on my PR4 that gets about 600 a day

20 1127 0.85% Googlebot/2.1 (+http://www.google.com/bot.html)