Quote:
Originally posted by cj-design
Hi guys,
I'm just finishing off a script that will allow you to log each and every crawl that Google makes on your website. Some screenshots can be found here:
http://www.cj-design.com/downloads/g...activity/demo/
The script will be up for free download very soon (just finishing off the installation guide) - so if you dont have anything like this on your site, stay tuned.
P.S The script is written in PHP therefore can only be run in pages that can include PHP files (i.e .php, .php3, .shtml, .shtm)
|
What are the features?
Is it any better than:
grep googlebot access.log | cut -f4 -d'/' | sed s/HTTP//g | sort | uniq
This is a serious question, as here is my count from today alone, across my domains:
% grep googlebot * |wc -l
18974