robots.txt question...
 

If I don't want the SE bots going into a directory, let's say whatever.com/members, what would I put in my robots.txt? Thanks

### BEGIN FILE ###
#
# allow-all
#
#
# The use of robots or other automated means to access this site
# without express permission is strictly prohibited.
# Notwithstanding the foregoing, we may permit automated access to
# access certain of these pages but soley for the limited purpose of
# including content in publicly available search engines. Any other
# use of robots or failure to obey the robots exclusion standards set
# forth at <http://www.robotstxt.org/wc/exclusion.html> is strictly
# prohibited and will result in me beating your ass.
#

User-agent: *
Disallow: /members
Disallow: /working
User-agent: grub-client
User-agent: grub
User-agent: looksmart
User-agent: WebZip
User-agent: b2w/0.1
User-agent: copernic
Disallow: /

### END FILE ###

google.com/bot.html

Doesn't anyone use google before posting here?

Disallow: /directory_name/

see:
http://www.searchengineworld.com/rob...s_tutorial.htm

for more detail.

why would they? someone else will do it for them

Thanks :thumbsup

sorry for being lazy

just change your bots file

Google bitch, google.

that's good :1orglaugh