robots.txt question

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Cyrano
    Confirmed User
    • Apr 2006
    • 920

    #1

    robots.txt question

    Is it possible to use robots.txt to prevent search engines from indexing certain areas of text on specific pages? If not, is there another method of accomplishing this?
  • baddog
    So Fucking Banned
    • Apr 2001
    • 107089

    #2
    Originally posted by Cyrano
    Is it possible to use robots.txt to prevent search engines from indexing certain areas of text on specific pages? If not, is there another method of accomplishing this?
    You can use it to keep spiders from certain pages, but I am not sure how I would hide just certain text . . . . unless you put it in a .gif or something

    Comment

    • Elixir
      CHECK MY SIG-AMAZING SITE
      • May 2006
      • 12870

      #3
      User-agent: *
      Disallow: /images/

      you can use this.
      SIG FOR SALE


      ICQ 210874419

      Comment

      • bigalownz
        Confirmed User
        • Aug 2005
        • 1657

        #4
        but robots.txt dont work with some bots and spiders
        $100 free credit for all hosting needs

        Comment

        • darksoul
          Confirmed User
          • Apr 2002
          • 4997

          #5
          use iframes for that text and deny access to the page
          1337 5y54|)m1n: 157717888
          BM-2cUBw4B2fgiYAfjkE7JvWaJMiUXD96n9tN
          Cambooth

          Comment

          Working...