GoFuckYourself.com - Adult Webmaster Forum - View Single Post

Hooligan · 08-07-2006, 10:50 AM

there's a way to block alexa and similar sites from spidering your site.
it's somehow set up in robots.txt

dont remember the details.

08-07-2006, 10:50 AM
Hooligan So Fucking Banned Join Date: May 2001 Posts: 1,472	there's a way to block alexa and similar sites from spidering your site. it's somehow set up in robots.txt dont remember the details.