Robots meta tags... little help please

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • iwantchixx
    Too lazy to set a custom title
    • Oct 2002
    • 12860

    #1

    Robots meta tags... little help please

    What would I use to tell the search engines to NOT read a specific page and it NOT affect the rest of the site. I just want one page to be ignored.
  • Code_Havoc
    Registered User
    • Jun 2005
    • 221

    #2
    Do a search on google for 'Robot Exclusion Standard'

    You'll have to make a robots.txt file and put it on your root www folder (so you can access it from the browser: http://www.cnn.com/robots.txt). In that file you'll tell the world what browsers can and cant go to certain parts of your site.

    Comment

    • Serge Litehead
      Confirmed User
      • Dec 2002
      • 5190

      #3
      robots.txt:
      User-agent: *
      Disallow: /specific_dir/
      Disallow: /particular_file.html

      in file:
      <META NAME="robots" CONTENT="noindex">


      more robots.txt info

      additionally you can have nofollow command for a specific link, introduced by google
      <a href="http://www.site.com/page.html" rel="nofollow">Visit My Page</a>

      Comment

      • iwantchixx
        Too lazy to set a custom title
        • Oct 2002
        • 12860

        #4
        thanks guys

        Comment

        Working...