Thread: Robots.txt help. How do I do this?
View Single Post
Old 09-16-2006, 03:06 PM  
After Shock Media
It's coming look busy
 
After Shock Media's Avatar
 
Join Date: Mar 2001
Location: "Ph'nglui mglw'nafh Cthulhu R'lyeh wgah'nagl fhtagn".
Posts: 35,299
yeah but cant remember, damn pain meds.

but not all spiders follow those rules.

Umm I think it is
User-Agent: *
Disallow: /dirofyourdesire/

I take no responsibility if you loose all rankings, i am under the influence.
__________________

[email protected] ICQ:135982156 AIM: Aftershockmed1a MSN: [email protected]
After Shock Media is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote