Do a search on google for 'Robot Exclusion Standard'
You'll have to make a robots.txt file and put it on your root www folder (so you can access it from the browser:
http://www.cnn.com/robots.txt). In that file you'll tell the world what browsers can and cant go to certain parts of your site.