Stopping programs that rip member's areas

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Rochard
    Jägermeister Test Pilot
    • Dec 2001
    • 75764

    #1

    Stopping programs that rip member's areas

    I thought I had read on GFY a few weeks ago that there is a way to stop members from using programs (site strippers) from downloading all of the members areas. Is there a way to do this?

    GFY search didn't turn anything up for me.
    Herschel Savage
    Brooklyn, NY
  • PerfectionGirls
    Too lazy to set a custom title
    • Oct 2002
    • 4484

    #2
    I net I know someone that knows
    SIG TOO BIG! Maximum 120x60 button and no more than 3 text lines of DEFAULT SIZE and COLOR. Unless your sig is for a GFY top banner sponsor, then you may use a 624x80 instead of a 120x60.

    Comment

    • DTK
      Confirmed User
      • Feb 2002
      • 4546

      #3
      pretty sure you can do this through htaccess....let me try and find a code snippet
      Arguing whether the Democratic or Republican party is better is like debating which steaming pile of shit is slightly less stinky.

      Comment

      • extreme
        Confirmed User
        • Oct 2002
        • 2120

        #4
        Coded such a sollution in PHP when I started out with some TGPs a long time ago. Simple sollution..

        A small invisible link that no real user can click on, a robot trap. (even if a real user comes over the invisible link with his browser java-script stops him from clicking).

        The link leads to a php script that just inserts users IP into a database. Then a small php function on each page you want to protect that checks against that database and returns a error msgs if a match is found.

        Not very hard to code ...

        Comment

        • Snake Doctor
          I'm Lenny2 Bitch
          • Mar 2001
          • 13449

          #5
          I would think the easiest thing to do would be to serve up content through the cgi-bin rather than linking to it directly.
          Put the pics on html.....shit like that.

          You can also get the names of most of the site rippers and disallow that user agent in your htaccess file.
          sig too big

          Comment

          • integrated
            Confirmed User
            • Apr 2003
            • 3826

            #6
            I just email each member asking them please dont do that.

            trust is a 2 way street my friend

            Pioneer of .TV domains
            Grandfather of .TV development
            Respected among industry LEADERS

            Comment

            • Ludedude
              Suck it!
              • Jun 2001
              • 4432

              #7
              Originally posted by Lenny2


              You can also get the names of most of the site rippers and disallow that user agent in your htaccess file.
              We do this and it works pretty well however there is a penalty in server load that with this method. There might be better solutions from an efficiency point of view but it's pretty effective.

              The real hardcore rippers will know how to change their user agents to defeat an htaccess based system although as you well know, the majority of the surfers out there are just plain dumb.

              Comment

              • uranidiot
                So Fucking Banned
                • Sep 2003
                • 566

                #8
                Originally posted by integrated
                I just email each member asking them please dont do that.

                trust is a 2 way street my friend

                Comment

                • foe
                  Confirmed User
                  • May 2002
                  • 5246

                  #9
                  Both of the methods above are good solutions. I know of several others, if your interested in me coding something up for you just contact me via icq.
                  My schedule is a little busy now though.

                  Comment

                  • extreme
                    Confirmed User
                    • Oct 2002
                    • 2120

                    #10
                    Originally posted by Lenny2
                    I would think the easiest thing to do would be to serve up content through the cgi-bin rather than linking to it directly.
                    Put the pics on html.....shit like that.
                    Doesn't make it much harder to rip .. "wget --mirror -A .jpg" for example. Haven't used many win32 rippers but I used to use "GetRight" .. which can download just a certain type of filetype. (and GetRights mainthing isn't even ripping webpages).


                    You can also get the names of most of the site rippers and disallow that user agent in your htaccess file.
                    I bet loads of rippers has an option to fake the useragent data. Could stop some clueless rippers I guess. But you'll need alot of ripper user agents in your .htaccess on the other hand .. + keep it updated.

                    Comment

                    • Ludedude
                      Suck it!
                      • Jun 2001
                      • 4432

                      #11
                      Originally posted by extreme

                      I bet loads of rippers has an option to fake the useragent data. Could stop some clueless rippers I guess. But you'll need alot of ripper user agents in your .htaccess on the other hand .. + keep it updated.
                      Yep, that's the downside. The .htaccess files get big, leading to load concerns and they have to be updated frequently but it works. Trust me, most of the rippers are clueless...think average surfer with a different hammer

                      Comment

                      • JFPdude
                        Confirmed User
                        • Jan 2002
                        • 4027

                        #12
                        here's a little htaccess code I keep around for such an ocasion


                        RewriteEngine On

                        RewriteCond %{HTTP_USER_AGENT} ^Mozilla
                        RewriteRule /* - [L]

                        RewriteCond %{HTTP_USER_AGENT} ^Teleport [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^ia_archiver [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Aculinx [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Ants [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^attach [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Backstreet [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^BackWeb [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Bandit [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Buddy [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Burner [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Caitoo [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Collector [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Commander [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Copier [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Crawler [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Curl [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^DA\ .\.0 [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Devil [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^DISCo\ Pump [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Down2Web [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Downloader [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^DownloadIt [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Drip [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Eater [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Eclipt [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Enterprise [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Express [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Extractor [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^FairAd\ Client [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^FileHound [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^FlashSite [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^FlipBrowser [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^GetBot [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^GetSmart [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Gets [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^GetWeb [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^gotit [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Grabber [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Grab [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Greed [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^HMView [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Hoover [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^HtGet [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^HTTrack [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^IBrowse [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^iFox98 [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^IGJpg$ [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^InternetLinkAgent [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^IPhoto [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^iwantmy [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^iwantmyxxx.com [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^JOC [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^JustView [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Keepoint [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^leech [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^lftp [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^likse [NC,OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Magnet [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Mag-Net [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Memo [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^MemoWeb [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Mirror [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^MSProxy [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^NetDrag [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Offline [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^PerManSurfer [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^PlantyNet_WebRo [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Pockey [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Pump [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Reaper [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Recorder [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Retriever [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^SilentSurf [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Siphon [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Snagger [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Snake [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Snarf [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Snatcher [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^SpaceBison [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Stripper [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Sucker [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Vacuum [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Vampire [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^wantmy [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Weazel [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Webexe [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Webster [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WebVCR [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WFARC [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Whacker [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WWWCopy [OR]
                        RewriteCond %{HTTP_USER_AGENT} ^WWWoffle
                        RewriteRule .\.([gG][iI][fF]|[jJ][pP][gG])$ - [F]

                        Comment

                        • extreme
                          Confirmed User
                          • Oct 2002
                          • 2120

                          #13
                          Originally posted by Ludedude


                          Yep, that's the downside. The .htaccess files get big, leading to load concerns and they have to be updated frequently but it works. Trust me, most of the rippers are clueless...think average surfer with a different hammer

                          mmm .. on the other hand they have bothered to download and install a rippersoftware, learnt how it works etc? Doesn't make them rocketscientists but more complicated then just starting pre-installed IE? ;]

                          I'll chip in with some UserAgents I've found ripping my site:

                          User-agent: URL2File
                          User-agent: TE
                          User-agent: BaiDuSpider
                          User-agent: Offline Explorer
                          User-agent: Mister PiX
                          User-agent: WebSauger
                          User-agent: Mister PiX
                          User-agent: Internet Ninja
                          User-agent: Microsoft URL Control
                          User-agent: WebStripper
                          User-agent: WebCopier
                          User-agent: Teleport
                          User-agent: asterias
                          User-agent: wget
                          User-agent: Web Downloader
                          User-agent: nearsite
                          User-agent: netattache
                          User-agent: sitesnagger
                          User-agent: webwhacker
                          User-agent: digout4u
                          User-agent: extractorpro
                          User-agent: go-ahead-got-it
                          User-agent: HTTPClient
                          User-agent: TovekTools Web Indexer
                          User-agent: LinkWalker
                          User-agent: NEWT ActiveX
                          User-agent: GetRight
                          User-agent: WebZIP
                          User-agent: WebReaper
                          User-agent: HTTrack

                          Comment

                          • VideoJ
                            Confirmed User
                            • Aug 2002
                            • 750

                            #14
                            Back in 99, I coded up a tracker that tracked bytes downloaded by account and put a limit on the maximum amount they could download during a day. After they reached the download limit, any downloads returned an error page.

                            With PHP and htaccess it'd be pretty easy to code something like that up.
                            Somebody stole my damn signture...

                            Comment

                            • ryph
                              Confirmed User
                              • Oct 2002
                              • 1225

                              #15
                              Originally posted by extreme
                              Coded such a sollution in PHP when I started out with some TGPs a long time ago. Simple sollution..

                              A small invisible link that no real user can click on, a robot trap. (even if a real user comes over the invisible link with his browser java-script stops him from clicking).

                              The link leads to a php script that just inserts users IP into a database. Then a small php function on each page you want to protect that checks against that database and returns a error msgs if a match is found.

                              Not very hard to code ...
                              Very innovative. You could probably just put a html tag within the anchor tag so there's nothing a regular user would even be able to notice or click.
                              tom at ryphs dot com

                              Comment

                              • Adultnet
                                Confirmed User
                                • Sep 2003
                                • 8713

                                #16
                                If you are interested in advance protection means + multi login to members area analyzer security and 100% protection of your content contact !



                                TrafficCashGold Paying Webmasters Since 1996!

                                Awesome Conversions! Fast Weekly Payments! Over 125 Tours!

                                Comment

                                • wyvern
                                  Registered User
                                  • Jul 2002
                                  • 39

                                  #17
                                  We have a software to limit the daily download traffic of any member or a group of members (it doesn't allow them to download more if they have reached the limit), as well as limit the number of IP changes and a protection against multiple logins.
                                  Pease contact me if you are interested - [email protected]

                                  Comment

                                  • Ludedude
                                    Suck it!
                                    • Jun 2001
                                    • 4432

                                    #18
                                    Here is a list from one of our sites. I didn't cross-check it against the other two that were already posted FYI.

                                    RewriteCond %{HTTP_USER_AGENT} ^DISCo\Pump.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Drip.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^EirGrabber.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^FlashGet.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^GetRight.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Gets.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Grafula.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^IBrowse.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^InterGET.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Internet\Ninja.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^JetCar.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^JustView.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^MIDown\tool.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Mister\PiX.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^NearSite.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Need\To\Know.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^NetSpider.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Offline\Explorer.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^PageGrabber.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Papa\Foto.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Pockey.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^ReGet.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Slurp.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^SpaceBison.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Teleport.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^WebAuto.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^WebCopier.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^WebFetch.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^WebReaper.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^WebSauger.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^WebStripper.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^WebWhacker.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^WebZIP.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Web\Image\Collector.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Web\Sucker.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Webster.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^Wget.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^eCatch.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^ia_archiver.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^lftp.* [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^tAkeOut.*
                                    RewriteCond %{HTTP_USER_AGENT} ^.*WebZIP.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Stripper.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Offline.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Copier.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Crawler.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Snagger.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Teleport.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Reaper.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Wget.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Grabber.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Sucker.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Downloader.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Siphon.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Collector.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Mag-Net.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Widow.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Snake.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*BackWeb.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*gotit.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Vacuum.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Pump.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*HMView.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*HTTrack.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*JOC.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*likse.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Memo.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*pcBrowser.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*SuperBot.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*leech.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Mirror.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Recorder.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*GrabNet.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Likse.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Navroad.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*attach.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Magnet.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Surfbot.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Bandit.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Ants.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Buddy.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Whacker.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Backstreet.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Caitoo.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Curl.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Eclipt.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*FlashSite.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*GetBot.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*GetSmart.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*GetWeb.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Grab.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Greed.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*HtGet.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*HTTrack.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*iFox98.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Sucker.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Vampire.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Eater.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Snarf.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Devil.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Retriever.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*WebVCR.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*WWWCopy.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*WWWoffle.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Aculinx.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*DownloadIt.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Express.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*FlipBrowser.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Weazel.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*IPhoto.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*MemoWeb.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*NetDrag.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Commander.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*SuperBot.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Teleport.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Webexe.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Extractor.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Navroad.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Hoover.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Keepoint.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Enterprise.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Down2Web.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Burner.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Custo.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*Snatcher.*$ [OR]
                                    RewriteCond %{HTTP_USER_AGENT} ^.*FileHound.*$

                                    Comment

                                    • berg.the.red
                                      Confirmed User
                                      • Feb 2003
                                      • 596

                                      #19
                                      there's a lot of this discussed over on Webmaster World News. do a search on "perfect .htaccess". there's some folks over there who have coded up some routines to monitor bytes downloaded over time and dump them if it's acting like a ripper instead of a surfer. covers the not having the user agent in your .htaccess or spoofed agent problem. actually they've got quite a few neat little ideas over there ...
                                      Need a Dedicated Box with BALLS ?
                                      How about a Dedicated Server starting at just $49 per month.

                                      Comment

                                      Working...