Thread: Robots.txt help. How do I do this?
View Single Post
Old 09-16-2006, 03:37 PM  
wedouglas
So Fucking Banned
 
Join Date: Aug 2004
Location: Dearborn, MI
Posts: 5,921
Quote:
Originally Posted by borked
Yeah, I use there tool to test it. I ended up just allowing /sub/a-z* and disallowing /sub/

Thanks
wedouglas is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote