Help!! Why would I be getting 50,000 (302 error) redirects a day!!?

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Damian_Maxcash
    So Fucking Banned
    • Oct 2002
    • 12745

    #1

    Help!! Why would I be getting 50,000 (302 error) redirects a day!!?

    Its driving me nuts - Im not getting close to that traffic on the site so I dont think its to do with a couple of redirects in the htaccess file......

    Is there a way to see what this traffic is and see where its coming from and going to?

    Thanks
  • squishypimp
    PostMaster General
    • Aug 2006
    • 10781

    #2
    check your AWstats or Webalizer to see were the errors are occuring.

    Comment

    • Damian_Maxcash
      So Fucking Banned
      • Oct 2002
      • 12745

      #3
      Originally posted by squishypimp
      check your AWstats or Webalizer to see were the errors are occuring.
      AWStats dosnt show them - it just gives you a count

      I havnt looked at Webalizer - I will try it now.

      Comment

      • GrouchyAdmin
        Now choke yourself!
        • Apr 2006
        • 12085

        #4
        Mentioning the site, and/or posting your htaccess might help.

        Comment

        • SmokeyTheBear
          ►SouthOfHeaven
          • Jun 2004
          • 28609

          #5
          Originally posted by damian2001
          AWStats dosnt show them - it just gives you a count

          I havnt looked at Webalizer - I will try it now.
          try looking at the last 300 visitors if you have that option in cpanel you should notice
          hatisblack at yahoo.com

          Comment

          • Chris
            Too lazy to set a custom title
            • May 2003
            • 27880

            #6
            download log files?
            [email protected]

            Comment

            • Damian_Maxcash
              So Fucking Banned
              • Oct 2002
              • 12745

              #7
              Originally posted by SmokeyTheBear
              try looking at the last 300 visitors if you have that option in cpanel you should notice
              After calming down (watching 50000 uniques disappear can have an adverse effect on your health)

              It turns out its bloody search engine bots looking for a robots.txt file.

              The bots have pulled over a gig of that server today - really strange.....

              but at least Im not losing traffic.

              Thanks guys

              Comment

              • Tempest
                Too lazy to set a custom title
                • May 2004
                • 10217

                #8
                what type of site? tgp? running links thru a script?

                Comment

                • Tempest
                  Too lazy to set a custom title
                  • May 2004
                  • 10217

                  #9
                  Originally posted by damian2001
                  It turns out its bloody search engine bots looking for a robots.txt file.
                  Put an empty robots.txt file on there.. that's what I do.

                  Comment

                  • GrouchyAdmin
                    Now choke yourself!
                    • Apr 2006
                    • 12085

                    #10
                    Originally posted by Tempest
                    Put an empty robots.txt file on there.. that's what I do.
                    Or, you know, actually make one.

                    User-Agent: *
                    Disallow: /sekret

                    Comment

                    • woj
                      <&(©¿©)&>
                      • Jul 2002
                      • 47880

                      #11
                      look in the raw log files...
                      Custom Software Development, email: woj#at#wojfun#.#com to discuss details or skype: wojl2000 or gchat: wojfun or telegram: wojl2000
                      Affiliate program tools: Hosted Galleries Manager Banner Manager Video Manager
                      Wordpress Affiliate Plugin Pic/Movie of the Day Fansign Generator Zip Manager

                      Comment

                      • Tempest
                        Too lazy to set a custom title
                        • May 2004
                        • 10217

                        #12
                        Originally posted by toonpornblog
                        Or, you know, actually make one.

                        User-Agent: *
                        Disallow: /sekret
                        true.. on the other hand, now every smart person can come along and pull up your robots.txt file and see you have this "hidden" sekret directory.

                        Comment

                        • GrouchyAdmin
                          Now choke yourself!
                          • Apr 2006
                          • 12085

                          #13
                          Originally posted by Tempest
                          true.. on the other hand, now every smart person can come along and pull up your robots.txt file and see you have this "hidden" sekret directory.
                          That's what .htaccess/.htpasswd is for. A few sites penalize you for a 0 byte robots.txt; webcrawler is no longer so they don't count, but I know it still makes Yahoo unhappy.

                          Comment

                          • Tempest
                            Too lazy to set a custom title
                            • May 2004
                            • 10217

                            #14
                            Originally posted by toonpornblog
                            That's what .htaccess/.htpasswd is for. A few sites penalize you for a 0 byte robots.txt; webcrawler is no longer so they don't count, but I know it still makes Yahoo unhappy.
                            Interesting.. I have a site that Yahoo seems to love and it's got a 0 length robots.txt file in there.

                            .htpasswd etc. is ok.. but it's even better when they don't even know where to look in the first place.

                            Comment

                            Working...