|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
07-23-2004, 03:53 PM
|
#1 |
|
Confirmed User
Join Date: Nov 2002
Posts: 7,761
|
finding the IP's of SE's webpiders (and more)...
When the SE's index sites like whatismyip.com that display the IP of the visitor, the spider will usually also store it's own IP in the results for the index
 From there you can just hit arin with that IP to see how much of the block the company owns. You could also use it to determine whos results smaller engines primarily use.  Example: http://216.239.57.104/search?q=cache...is+my+ip&hl=en Then: http://ws.arin.net/cgi-bin/whois.pl?...t=64.68.82.201 |
|
|
|
07-23-2004, 03:59 PM
|
#2 |
|
i have man boobies
Join Date: Jul 2003
Location: van down by the river
Posts: 13,082
|
Resolved 64.68.82.201 to crawler15.googlebot.com
no big secret
__________________
333-765-551 |
|
|
|
|
07-23-2004, 04:00 PM
|
#3 |
|
i have man boobies
Join Date: Jul 2003
Location: van down by the river
Posts: 13,082
|
cat domain.log | grep googlebot
this works too
__________________
333-765-551 |
|
|
|
|
07-23-2004, 04:00 PM
|
#4 | |
|
Confirmed User
Join Date: Nov 2002
Posts: 7,761
|
Quote:
Don't focus so much on google. I just used google as an example. |
|
|
|
|
