GoFuckYourself.com - Adult Webmaster Forum - View Single Post

minusonebit · 10-15-2007, 12:02 AM

Am I the only one who has ever heard of Robots.txt? Google does follow it...

http://www.icwt.us/robots.txt

# Stop indexing forbidden directories User-agent: *

Disallow: /wp-content/
Disallow: /wp-admin/
Disallow: /wp-includes/

10-15-2007, 12:02 AM
minusonebit So Fucking Banned Join Date: Feb 2006 Location: [email protected] Posts: 7,391	Am I the only one who has ever heard of Robots.txt? Google does follow it... http://www.icwt.us/robots.txt # Stop indexing forbidden directories User-agent: * Disallow: /wp-content/ Disallow: /wp-admin/ Disallow: /wp-includes/ Last edited by minusonebit; 10-15-2007 at 12:04 AM..