GoFuckYourself.com - Adult Webmaster Forum - View Single Post

colpanic · 02-02-2005, 12:01 AM

http://216.239.57.104/search?q=cache...&hl=en&start=1

Here is a list of a ton of crawler names, search for Yahoo.

Dunno about referrer names, but most/all decent crawlers identify themselves these days.

02-02-2005, 12:01 AM
colpanic Confirmed User Join Date: May 2004 Location: San Diego, CA Posts: 1,007	http://216.239.57.104/search?q=cache...&hl=en&start=1 Here is a list of a ton of crawler names, search for Yahoo. Dunno about referrer names, but most/all decent crawlers identify themselves these days. __________________ I like ducks.