Thread: Robots.txt help. How do I do this?
View Single Post
Old 09-16-2006, 03:19 PM  
borked
Totally Borked
 
borked's Avatar
 
Industry Role:
Join Date: Feb 2005
Posts: 6,284
Quote:
Originally Posted by wedouglas
I want to disallow the folder /sub/, but I want to allow everything in that folder. e.g. /sub/page1, /sub/page2

Any quick way to allow all files/folders inside /sub/ but disallow /sub/ alone?
Disallow /sub
Allow /sub/

-edit...but to play it safe, just name all the folders to allow

Allow /sub/folder1
etc
__________________

For coding work - hit me up on andy // borkedcoder // com
(consider figuring out the email as test #1)


All models are wrong, but some are useful. George E.P. Box. p202
Last edited by borked; 09-16-2006 at 03:20 PM..
borked is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote