Question for SEO Gurus out there

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • 2MuchMark
    Mark of 2Much.net
    • Aug 2004
    • 50991
    #1

    Question for SEO Gurus out there

    Hey all... question for the SEO Gurus:

    If you have a dynamic link that does not exist all the time, how do you stop Engines from indexing it or validators from flagging it as invalid?

    For example, I have a link that looks like this:

    /Directory/SubDirectory/ProgramName.cgi/content

    Sometimes this content is online and sometimes it is not.

    I have tried inserting rel="nofollow" into the link, but validators still see this as 404 error.

    What am I missing?
    Tags: None
    • Rob
      I'm a great bowler.
      • Nov 2003
      • 13310
      #2
      Use .htaccess to omit.

        Comment

        • Google Expert
          Webmaster
          • Jun 2004
          • 14294
          #3
          put this into your robots.txt

          User-agent: *
          Disallow: /Directory/SubDirectory/

          or

          User-agent: *
          Disallow: /Directory/SubDirectory/ProgramName.cgi

            Comment

            • 2MuchMark
              Mark of 2Much.net
              • Aug 2004
              • 50991
              #4
              Originally posted by Rob
              Use .htaccess to omit.
              Can you show me an example?

                Comment

                • Fat Panda
                  Porn is Dead. Move along.
                  • Aug 2006
                  • 13296
                  #5
                  https://en.wikipedia.org/wiki/Noindex

                    Comment

                    • 2MuchMark
                      Mark of 2Much.net
                      • Aug 2004
                      • 50991
                      #6
                      Originally posted by Muad'Dib
                      put this into your robots.txt

                      User-agent: *
                      Disallow: /Directory/SubDirectory/

                      or

                      User-agent: *
                      Disallow: /Directory/SubDirectory/ProgramName.cgi


                      Hi Muad'Dib,

                      Thanks for the info. For now, page validators keep showing the pages I don't want indexed anyway, so I'm thinking that only htaccess will work in this case. I'll use your suggestion too just to be sure.


                      Originally posted by Fat Panda
                      https://en.wikipedia.org/wiki/Noindex
                      Hi Fat,

                      I already have rel="nofollow" in the links to those pages. Do you think I should use rel="no index" too?

                        Comment

                        • Google Expert
                          Webmaster
                          • Jun 2004
                          • 14294
                          #7
                          Originally posted by MarkPrince
                          Hi Muad'Dib,

                          Thanks for the info. For now, page validators keep showing the pages I don't want indexed anyway, so I'm thinking that only htaccess will work in this case. I'll use your suggestion too just to be sure.
                          Page validators are not the same as SE bots.

                          You are basically giving (allowing) the address to page validators to go to and check.

                          But when SE bots come to your site, they read the instructions first and don't go to those directories, because it's forbidden.

                            Comment

                            • O MARINA
                              I'm clockin' ya, Versace shade watchin' ya
                              • Mar 2003
                              • 13796
                              #8
                              Originally posted by Muad'Dib
                              Page validators are not the same as SE bots.

                              You are basically giving (allowing) the address to page validators to go to and check.

                              But when SE bots come to your site, they read the instructions first and don't go to those directories, because it's forbidden.
                              Oh hello
                              Seo Guru hit me up sometime!

                                Comment

                                • Fat Panda
                                  Porn is Dead. Move along.
                                  • Aug 2006
                                  • 13296
                                  #9
                                  u want this between head tags on that page

                                  <meta name="robots" content="noindex">

                                    Comment

                                    • Fat Panda
                                      Porn is Dead. Move along.
                                      • Aug 2006
                                      • 13296
                                      #10
                                      rel="nofollow" has nothing to do with what youre trying to do

                                        Comment

                                        Previous template Next
                                        Working...