Robots.txt VS meta robots INDEX

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • Kard63
    Confirmed User
    • Nov 2003
    • 8944
    #1

    Robots.txt VS meta robots INDEX

    I have a robots text that disables the entire site for indexing

    # Make changes for all web spiders
    User-agent: *
    Disallow: /

    but I have robots meta data at the top of each page saying to index it. Which will happen? I don't want it to get indexed but I dont want to disable the plugin adding the robots meta data either.

    Which one of these rules will trump the other?

    Thanks in advance - and please don't guess.
    Tags: None
    • Kard63
      Confirmed User
      • Nov 2003
      • 8944
      #2
      come on guys, I know all the smart people are working Sunday morning. Hook me up with the info please.

        Comment

        • 18teens
          Confirmed User
          • Dec 2002
          • 1605
          #3
          robots.txt

            Comment

            • u-Bob
              there's no $$$ in porn
              • Jul 2005
              • 33063
              #4
              robots.txt
              think about it for a sec

                Comment

                • woj
                  <&(©¿©)&>
                  • Jul 2002
                  • 47882
                  #5
                  they should follow robots.txt first
                  Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000
                  Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager
                  Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager

                    Comment

                    • voa
                      Too lazy to set a custom title
                      • Nov 2006
                      • 16532
                      #6
                      I have no idea

                        Comment

                        • MediaGuy
                          Confirmed User
                          • Sep 2004
                          • 5500
                          #7
                          robots.txt is looked for first, and followed - so it won't bother hitting the metas if you no-index the site.

                          Yahoo! will take forever to index and list you if you don't have a robots.txt, for example, even if you have a robots meta tag.

                          YOU Are Industry News!
                          Press Releases: pr[at]payoutmag.com
                          Facebook: Payout Magazine! Facebook: MIKEB!
                          ICQ: 248843947
                          Skype: Mediaguy1

                            Comment

                            Previous template Next
                            Working...