What would I use to tell the search engines to NOT read a specific page and it NOT affect the rest of the site. I just want one page to be ignored.
Robots meta tags... little help please
Collapse
X
-
Tags: None
-
Do a search on google for 'Robot Exclusion Standard'
You'll have to make a robots.txt file and put it on your root www folder (so you can access it from the browser: http://www.cnn.com/robots.txt). In that file you'll tell the world what browsers can and cant go to certain parts of your site. -
robots.txt:
User-agent: *
Disallow: /specific_dir/
Disallow: /particular_file.html
in file:
<META NAME="robots" CONTENT="noindex">
more robots.txt info
additionally you can have nofollow command for a specific link, introduced by google
<a href="http://www.site.com/page.html" rel="nofollow">Visit My Page</a>Comment
-

Comment