![]() |
finding the IP's of SE's webpiders (and more)...
When the SE's index sites like whatismyip.com that display the IP of the visitor, the spider will usually also store it's own IP in the results for the index :)
From there you can just hit arin with that IP to see how much of the block the company owns. You could also use it to determine whos results smaller engines primarily use. :winkwink: Example: http://216.239.57.104/search?q=cache...is+my+ip&hl=en Then: http://ws.arin.net/cgi-bin/whois.pl?...t=64.68.82.201 |
Resolved 64.68.82.201 to crawler15.googlebot.com
no big secret |
cat domain.log | grep googlebot
this works too :) |
Quote:
:) Don't focus so much on google. I just used google as an example. |
All times are GMT -7. The time now is 07:45 AM. |
Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123