Stopping programs that rip member's areas - GoFuckYourself.com

Rochard · 09-25-2003, 05:43 PM

I thought I had read on GFY a few weeks ago that there is a way to stop members from using programs (site strippers) from downloading all of the members areas. Is there a way to do this?

GFY search didn't turn anything up for me.

PerfectionGirls · 09-25-2003, 05:44 PM

I net I know someone that knows

DTK · 09-25-2003, 05:48 PM

pretty sure you can do this through htaccess....let me try and find a code snippet

extreme · 09-25-2003, 05:50 PM

Coded such a sollution in PHP when I started out with some TGPs a long time ago. Simple sollution..

A small invisible link that no real user can click on, a robot trap. (even if a real user comes over the invisible link with his browser java-script stops him from clicking).

The link leads to a php script that just inserts users IP into a database. Then a small php function on each page you want to protect that checks against that database and returns a error msgs if a match is found.

Not very hard to code ...

Snake Doctor · 09-25-2003, 06:00 PM

I would think the easiest thing to do would be to serve up content through the cgi-bin rather than linking to it directly.
Put the pics on html.....shit like that.

You can also get the names of most of the site rippers and disallow that user agent in your htaccess file.

integrated · 09-25-2003, 06:04 PM

I just email each member asking them please dont do that.

trust is a 2 way street my friend

Ludedude · 09-25-2003, 06:04 PM

Quote:

Originally posted by Lenny2

You can also get the names of most of the site rippers and disallow that user agent in your htaccess file.

We do this and it works pretty well however there is a penalty in server load that with this method. There might be better solutions from an efficiency point of view but it's pretty effective.

The real hardcore rippers will know how to change their user agents to defeat an htaccess based system although as you well know, the majority of the surfers out there are just plain dumb.

uranidiot · 09-25-2003, 06:04 PM

Quote:

Originally posted by integrated
I just email each member asking them please dont do that.

trust is a 2 way street my friend

foe · 09-25-2003, 06:05 PM

Both of the methods above are good solutions. I know of several others, if your interested in me coding something up for you just contact me via icq.
My schedule is a little busy now though.

extreme · 09-25-2003, 06:08 PM

Quote:

Originally posted by Lenny2
I would think the easiest thing to do would be to serve up content through the cgi-bin rather than linking to it directly.
Put the pics on html.....shit like that.

Doesn't make it much harder to rip .. "wget --mirror -A .jpg" for example. Haven't used many win32 rippers but I used to use "GetRight" .. which can download just a certain type of filetype. (and GetRights mainthing isn't even ripping webpages).

Quote:

You can also get the names of most of the site rippers and disallow that user agent in your htaccess file.

I bet loads of rippers has an option to fake the useragent data. Could stop some clueless rippers I guess. But you'll need alot of ripper user agents in your .htaccess on the other hand .. + keep it updated.

Ludedude · 09-25-2003, 06:12 PM

Quote:

Originally posted by extreme

I bet loads of rippers has an option to fake the useragent data. Could stop some clueless rippers I guess. But you'll need alot of ripper user agents in your .htaccess on the other hand .. + keep it updated.

Yep, that's the downside. The .htaccess files get big, leading to load concerns and they have to be updated frequently but it works. Trust me, most of the rippers are clueless...think average surfer with a different hammer

JFPdude · 09-25-2003, 06:17 PM

here's a little htaccess code I keep around for such an ocasion

RewriteEngine On

RewriteCond %{HTTP_USER_AGENT} ^Mozilla
RewriteRule /* - [L]

RewriteCond %{HTTP_USER_AGENT} ^Teleport [OR]
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR]
RewriteCond %{HTTP_USER_AGENT} ^ia_archiver [OR]
RewriteCond %{HTTP_USER_AGENT} ^Aculinx [OR]
RewriteCond %{HTTP_USER_AGENT} ^Ants [OR]
RewriteCond %{HTTP_USER_AGENT} ^attach [OR]
RewriteCond %{HTTP_USER_AGENT} ^Backstreet [OR]
RewriteCond %{HTTP_USER_AGENT} ^BackWeb [OR]
RewriteCond %{HTTP_USER_AGENT} ^Bandit [OR]
RewriteCond %{HTTP_USER_AGENT} ^Buddy [OR]
RewriteCond %{HTTP_USER_AGENT} ^Burner [OR]
RewriteCond %{HTTP_USER_AGENT} ^Caitoo [OR]
RewriteCond %{HTTP_USER_AGENT} ^Collector [OR]
RewriteCond %{HTTP_USER_AGENT} ^Commander [OR]
RewriteCond %{HTTP_USER_AGENT} ^Copier [OR]
RewriteCond %{HTTP_USER_AGENT} ^Crawler [OR]
RewriteCond %{HTTP_USER_AGENT} ^Curl [OR]
RewriteCond %{HTTP_USER_AGENT} ^DA\ .\.0 [OR]
RewriteCond %{HTTP_USER_AGENT} ^Devil [OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo\ Pump [OR]
RewriteCond %{HTTP_USER_AGENT} ^Down2Web [OR]
RewriteCond %{HTTP_USER_AGENT} ^Downloader [OR]
RewriteCond %{HTTP_USER_AGENT} ^DownloadIt [OR]
RewriteCond %{HTTP_USER_AGENT} ^Drip [OR]
RewriteCond %{HTTP_USER_AGENT} ^Eater [OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]
RewriteCond %{HTTP_USER_AGENT} ^Eclipt [OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^Enterprise [OR]
RewriteCond %{HTTP_USER_AGENT} ^Express [OR]
RewriteCond %{HTTP_USER_AGENT} ^Extractor [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR]
RewriteCond %{HTTP_USER_AGENT} ^FairAd\ Client [OR]
RewriteCond %{HTTP_USER_AGENT} ^FileHound [OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashSite [OR]
RewriteCond %{HTTP_USER_AGENT} ^FlipBrowser [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetSmart [OR]
RewriteCond %{HTTP_USER_AGENT} ^Gets [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetWeb [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR]
RewriteCond %{HTTP_USER_AGENT} ^gotit [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR]
RewriteCond %{HTTP_USER_AGENT} ^Grabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^Grab [OR]
RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR]
RewriteCond %{HTTP_USER_AGENT} ^Greed [OR]
RewriteCond %{HTTP_USER_AGENT} ^HMView [OR]
RewriteCond %{HTTP_USER_AGENT} ^Hoover [OR]
RewriteCond %{HTTP_USER_AGENT} ^HtGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^HTTrack [OR]
RewriteCond %{HTTP_USER_AGENT} ^IBrowse [OR]
RewriteCond %{HTTP_USER_AGENT} ^iFox98 [OR]
RewriteCond %{HTTP_USER_AGENT} ^IGJpg$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR]
RewriteCond %{HTTP_USER_AGENT} ^InternetLinkAgent [OR]
RewriteCond %{HTTP_USER_AGENT} ^IPhoto [OR]
RewriteCond %{HTTP_USER_AGENT} ^iwantmy [OR]
RewriteCond %{HTTP_USER_AGENT} ^iwantmyxxx.com [OR]
RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR]
RewriteCond %{HTTP_USER_AGENT} ^JOC [OR]
RewriteCond %{HTTP_USER_AGENT} ^JustView [OR]
RewriteCond %{HTTP_USER_AGENT} ^Keepoint [OR]
RewriteCond %{HTTP_USER_AGENT} ^leech [OR]
RewriteCond %{HTTP_USER_AGENT} ^lftp [OR]
RewriteCond %{HTTP_USER_AGENT} ^likse [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Magnet [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mag-Net [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR]
RewriteCond %{HTTP_USER_AGENT} ^Memo [OR]
RewriteCond %{HTTP_USER_AGENT} ^MemoWeb [OR]
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mirror [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR]
RewriteCond %{HTTP_USER_AGENT} ^MSProxy [OR]
RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR]
RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetDrag [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline [OR]
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR]
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR]
RewriteCond %{HTTP_USER_AGENT} ^PerManSurfer [OR]
RewriteCond %{HTTP_USER_AGENT} ^PlantyNet_WebRo [OR]
RewriteCond %{HTTP_USER_AGENT} ^Pockey [OR]
RewriteCond %{HTTP_USER_AGENT} ^Pump [OR]
RewriteCond %{HTTP_USER_AGENT} ^Reaper [OR]
RewriteCond %{HTTP_USER_AGENT} ^Recorder [OR]
RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^Retriever [OR]
RewriteCond %{HTTP_USER_AGENT} ^SilentSurf [OR]
RewriteCond %{HTTP_USER_AGENT} ^Siphon [OR]
RewriteCond %{HTTP_USER_AGENT} ^Snagger [OR]
RewriteCond %{HTTP_USER_AGENT} ^Snake [OR]
RewriteCond %{HTTP_USER_AGENT} ^Snarf [OR]
RewriteCond %{HTTP_USER_AGENT} ^Snatcher [OR]
RewriteCond %{HTTP_USER_AGENT} ^SpaceBison [OR]
RewriteCond %{HTTP_USER_AGENT} ^Stripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR]
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR]
RewriteCond %{HTTP_USER_AGENT} ^Vacuum [OR]
RewriteCond %{HTTP_USER_AGENT} ^Vampire [OR]
RewriteCond %{HTTP_USER_AGENT} ^wantmy [OR]
RewriteCond %{HTTP_USER_AGENT} ^Weazel [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]
RewriteCond %{HTTP_USER_AGENT} ^Webexe [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR]
RewriteCond %{HTTP_USER_AGENT} ^Webster [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebVCR [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^WFARC [OR]
RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
RewriteCond %{HTTP_USER_AGENT} ^Whacker [OR]
RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]
RewriteCond %{HTTP_USER_AGENT} ^WWWCopy [OR]
RewriteCond %{HTTP_USER_AGENT} ^WWWoffle
RewriteRule .\.([gG][iI][fF]|[jJ][pP][gG])$ - [F]

extreme · 09-25-2003, 06:23 PM

Quote:

Originally posted by Ludedude

Yep, that's the downside. The .htaccess files get big, leading to load concerns and they have to be updated frequently but it works. Trust me, most of the rippers are clueless...think average surfer with a different hammer

mmm .. on the other hand they have bothered to download and install a rippersoftware, learnt how it works etc? Doesn't make them rocketscientists but more complicated then just starting pre-installed IE? ;]

I'll chip in with some UserAgents I've found ripping my site:

User-agent: URL2File
User-agent: TE
User-agent: BaiDuSpider
User-agent: Offline Explorer
User-agent: Mister PiX
User-agent: WebSauger
User-agent: Mister PiX
User-agent: Internet Ninja
User-agent: Microsoft URL Control
User-agent: WebStripper
User-agent: WebCopier
User-agent: Teleport
User-agent: asterias
User-agent: wget
User-agent: Web Downloader
User-agent: nearsite
User-agent: netattache
User-agent: sitesnagger
User-agent: webwhacker
User-agent: digout4u
User-agent: extractorpro
User-agent: go-ahead-got-it
User-agent: HTTPClient
User-agent: TovekTools Web Indexer
User-agent: LinkWalker
User-agent: NEWT ActiveX
User-agent: GetRight
User-agent: WebZIP
User-agent: WebReaper
User-agent: HTTrack

VideoJ · 09-25-2003, 06:59 PM

Back in 99, I coded up a tracker that tracked bytes downloaded by account and put a limit on the maximum amount they could download during a day. After they reached the download limit, any downloads returned an error page.

With PHP and htaccess it'd be pretty easy to code something like that up.

ryph · 09-25-2003, 07:04 PM

Quote:

Originally posted by extreme
Coded such a sollution in PHP when I started out with some TGPs a long time ago. Simple sollution..

A small invisible link that no real user can click on, a robot trap. (even if a real user comes over the invisible link with his browser java-script stops him from clicking).

The link leads to a php script that just inserts users IP into a database. Then a small php function on each page you want to protect that checks against that database and returns a error msgs if a match is found.

Not very hard to code ...

Very innovative. You could probably just put a html tag within the anchor tag so there's nothing a regular user would even be able to notice or click.

Adultnet · 09-25-2003, 07:04 PM

If you are interested in advance protection means + multi login to members area analyzer security and 100% protection of your content contact !

wyvern · 09-25-2003, 07:56 PM

We have a software to limit the daily download traffic of any member or a group of members (it doesn't allow them to download more if they have reached the limit), as well as limit the number of IP changes and a protection against multiple logins.
Pease contact me if you are interested - [email protected]

Ludedude · 09-25-2003, 08:57 PM

Here is a list from one of our sites. I didn't cross-check it against the other two that were already posted FYI.

RewriteCond %{HTTP_USER_AGENT} ^DISCo\Pump.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Drip.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashGet.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetRight.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Gets.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Grafula.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^IBrowse.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^InterGET.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Internet\Ninja.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^JetCar.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^JustView.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^MIDown\tool.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mister\PiX.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^NearSite.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Need\To\Know.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetSpider.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\Explorer.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Papa\Foto.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Pockey.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^ReGet.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Slurp.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^SpaceBison.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Teleport.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\Image\Collector.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\Sucker.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Webster.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Wget.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^ia_archiver.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^lftp.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut.*
RewriteCond %{HTTP_USER_AGENT} ^.*WebZIP.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Stripper.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Offline.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Copier.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Crawler.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Snagger.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Teleport.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Reaper.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Wget.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Grabber.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Sucker.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Downloader.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Siphon.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Collector.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Mag-Net.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Widow.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Snake.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*BackWeb.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*gotit.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Vacuum.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Pump.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*HMView.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*HTTrack.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*JOC.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*likse.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Memo.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*pcBrowser.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*SuperBot.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*leech.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Mirror.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Recorder.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*GrabNet.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Likse.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Navroad.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*attach.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Magnet.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Surfbot.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Bandit.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Ants.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Buddy.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Whacker.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Backstreet.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Caitoo.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Curl.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Eclipt.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*FlashSite.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*GetBot.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*GetSmart.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*GetWeb.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Grab.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Greed.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*HtGet.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*HTTrack.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*iFox98.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Sucker.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Vampire.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Eater.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Snarf.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Devil.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Retriever.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WebVCR.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WWWCopy.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*WWWoffle.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Aculinx.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*DownloadIt.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Express.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*FlipBrowser.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Weazel.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*IPhoto.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*MemoWeb.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*NetDrag.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Commander.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*SuperBot.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Teleport.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Webexe.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Extractor.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Navroad.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Hoover.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Keepoint.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Enterprise.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Down2Web.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Burner.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Custo.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*Snatcher.*$ [OR]
RewriteCond %{HTTP_USER_AGENT} ^.*FileHound.*$

berg.the.red · 09-25-2003, 09:05 PM

there's a lot of this discussed over on Webmaster World News. do a search on "perfect .htaccess". there's some folks over there who have coded up some routines to monitor bytes downloaded over time and dump them if it's acting like a ripper instead of a surfer. covers the not having the user agent in your .htaccess or spoofed agent problem. actually they've got quite a few neat little ideas over there ...

09-25-2003, 05:43 PM	#1
Rochard Jägermeister Test Pilot Industry Role: Join Date: Dec 2001 Location: NORCAL Posts: 74,033	Stopping programs that rip member's areas I thought I had read on GFY a few weeks ago that there is a way to stop members from using programs (site strippers) from downloading all of the members areas. Is there a way to do this? GFY search didn't turn anything up for me. __________________ “The choice is no longer between right or left. The choice is between normal and crazy.” - Sarah Huckabee Sanders YNOT MAIL \| THE BEST ADULT MAILING SOLUTION

09-25-2003, 05:44 PM	#2
PerfectionGirls Too lazy to set a custom title Join Date: Oct 2002 Location: MI Posts: 4,484	I net I know someone that knows __________________ SIG TOO BIG! Maximum 120x60 button and no more than 3 text lines of DEFAULT SIZE and COLOR. Unless your sig is for a GFY top banner sponsor, then you may use a 624x80 instead of a 120x60.

09-25-2003, 05:50 PM	#4
extreme Confirmed User Industry Role: Join Date: Oct 2002 Location: lalaland Posts: 2,120	Coded such a sollution in PHP when I started out with some TGPs a long time ago. Simple sollution.. A small invisible link that no real user can click on, a robot trap. (even if a real user comes over the invisible link with his browser java-script stops him from clicking). The link leads to a php script that just inserts users IP into a database. Then a small php function on each page you want to protect that checks against that database and returns a error msgs if a match is found. Not very hard to code ... __________________ Browse and find new paysites with screenshot-preview Export FHGs/FLVs/Paysites by JSON, XML, CSV and Text Find FHGs/FLVs/Paysites from any given Category or Search-query

09-25-2003, 06:00 PM	#5
Snake Doctor I'm Lenny2 Bitch Join Date: Mar 2001 Location: On top of my soapbox Posts: 13,449	I would think the easiest thing to do would be to serve up content through the cgi-bin rather than linking to it directly. Put the pics on html.....shit like that. You can also get the names of most of the site rippers and disallow that user agent in your htaccess file. __________________ sig too big

09-25-2003, 06:04 PM	#6
integrated Confirmed User Join Date: Apr 2003 Location: west end Posts: 3,826	I just email each member asking them please dont do that. trust is a 2 way street my friend __________________ Pioneer of .TV domains Grandfather of .TV development Respected among industry LEADERS

09-25-2003, 05:48 PM	#3
DTK Confirmed User Industry Role: Join Date: Feb 2002 Location: The 510 Posts: 4,545	pretty sure you can do this through htaccess....let me try and find a code snippet

09-25-2003, 06:05 PM	#9
foe Confirmed User Join Date: May 2002 Location: CT Posts: 5,246	Both of the methods above are good solutions. I know of several others, if your interested in me coding something up for you just contact me via icq. My schedule is a little busy now though.

09-25-2003, 06:17 PM	#12
JFPdude Confirmed User Join Date: Jan 2002 Location: Mountains of Western North Carolina. Posts: 4,027	here's a little htaccess code I keep around for such an ocasion RewriteEngine On RewriteCond %{HTTP_USER_AGENT} ^Mozilla RewriteRule /* - [L] RewriteCond %{HTTP_USER_AGENT} ^Teleport [OR] RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR] RewriteCond %{HTTP_USER_AGENT} ^ia_archiver [OR] RewriteCond %{HTTP_USER_AGENT} ^Aculinx [OR] RewriteCond %{HTTP_USER_AGENT} ^Ants [OR] RewriteCond %{HTTP_USER_AGENT} ^attach [OR] RewriteCond %{HTTP_USER_AGENT} ^Backstreet [OR] RewriteCond %{HTTP_USER_AGENT} ^BackWeb [OR] RewriteCond %{HTTP_USER_AGENT} ^Bandit [OR] RewriteCond %{HTTP_USER_AGENT} ^Buddy [OR] RewriteCond %{HTTP_USER_AGENT} ^Burner [OR] RewriteCond %{HTTP_USER_AGENT} ^Caitoo [OR] RewriteCond %{HTTP_USER_AGENT} ^Collector [OR] RewriteCond %{HTTP_USER_AGENT} ^Commander [OR] RewriteCond %{HTTP_USER_AGENT} ^Copier [OR] RewriteCond %{HTTP_USER_AGENT} ^Crawler [OR] RewriteCond %{HTTP_USER_AGENT} ^Curl [OR] RewriteCond %{HTTP_USER_AGENT} ^DA\ .\.0 [OR] RewriteCond %{HTTP_USER_AGENT} ^Devil [OR] RewriteCond %{HTTP_USER_AGENT} ^DISCo\ Pump [OR] RewriteCond %{HTTP_USER_AGENT} ^Down2Web [OR] RewriteCond %{HTTP_USER_AGENT} ^Downloader [OR] RewriteCond %{HTTP_USER_AGENT} ^DownloadIt [OR] RewriteCond %{HTTP_USER_AGENT} ^Drip [OR] RewriteCond %{HTTP_USER_AGENT} ^Eater [OR] RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR] RewriteCond %{HTTP_USER_AGENT} ^Eclipt [OR] RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR] RewriteCond %{HTTP_USER_AGENT} ^Enterprise [OR] RewriteCond %{HTTP_USER_AGENT} ^Express [OR] RewriteCond %{HTTP_USER_AGENT} ^Extractor [OR] RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR] RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR] RewriteCond %{HTTP_USER_AGENT} ^FairAd\ Client [OR] RewriteCond %{HTTP_USER_AGENT} ^FileHound [OR] RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR] RewriteCond %{HTTP_USER_AGENT} ^FlashSite [OR] RewriteCond %{HTTP_USER_AGENT} ^FlipBrowser [OR] RewriteCond %{HTTP_USER_AGENT} ^GetBot [OR] RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR] RewriteCond %{HTTP_USER_AGENT} ^GetSmart [OR] RewriteCond %{HTTP_USER_AGENT} ^Gets [OR] RewriteCond %{HTTP_USER_AGENT} ^GetWeb [OR] RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR] RewriteCond %{HTTP_USER_AGENT} ^gotit [OR] RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR] RewriteCond %{HTTP_USER_AGENT} ^Grabber [OR] RewriteCond %{HTTP_USER_AGENT} ^Grab [OR] RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR] RewriteCond %{HTTP_USER_AGENT} ^Greed [OR] RewriteCond %{HTTP_USER_AGENT} ^HMView [OR] RewriteCond %{HTTP_USER_AGENT} ^Hoover [OR] RewriteCond %{HTTP_USER_AGENT} ^HtGet [OR] RewriteCond %{HTTP_USER_AGENT} ^HTTrack [OR] RewriteCond %{HTTP_USER_AGENT} ^IBrowse [OR] RewriteCond %{HTTP_USER_AGENT} ^iFox98 [OR] RewriteCond %{HTTP_USER_AGENT} ^IGJpg$ [OR] RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR] RewriteCond %{HTTP_USER_AGENT} ^InternetLinkAgent [OR] RewriteCond %{HTTP_USER_AGENT} ^IPhoto [OR] RewriteCond %{HTTP_USER_AGENT} ^iwantmy [OR] RewriteCond %{HTTP_USER_AGENT} ^iwantmyxxx.com [OR] RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR] RewriteCond %{HTTP_USER_AGENT} ^JOC [OR] RewriteCond %{HTTP_USER_AGENT} ^JustView [OR] RewriteCond %{HTTP_USER_AGENT} ^Keepoint [OR] RewriteCond %{HTTP_USER_AGENT} ^leech [OR] RewriteCond %{HTTP_USER_AGENT} ^lftp [OR] RewriteCond %{HTTP_USER_AGENT} ^likse [NC,OR] RewriteCond %{HTTP_USER_AGENT} ^Magnet [OR] RewriteCond %{HTTP_USER_AGENT} ^Mag-Net [OR] RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR] RewriteCond %{HTTP_USER_AGENT} ^Memo [OR] RewriteCond %{HTTP_USER_AGENT} ^MemoWeb [OR] RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR] RewriteCond %{HTTP_USER_AGENT} ^Mirror [OR] RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR] RewriteCond %{HTTP_USER_AGENT} ^MSProxy [OR] RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR] RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR] RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR] RewriteCond %{HTTP_USER_AGENT} ^NetDrag [OR] RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR] RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR] RewriteCond %{HTTP_USER_AGENT} ^Offline [OR] RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR] RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR] RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR] RewriteCond %{HTTP_USER_AGENT} ^PerManSurfer [OR] RewriteCond %{HTTP_USER_AGENT} ^PlantyNet_WebRo [OR] RewriteCond %{HTTP_USER_AGENT} ^Pockey [OR] RewriteCond %{HTTP_USER_AGENT} ^Pump [OR] RewriteCond %{HTTP_USER_AGENT} ^Reaper [OR] RewriteCond %{HTTP_USER_AGENT} ^Recorder [OR] RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR] RewriteCond %{HTTP_USER_AGENT} ^Retriever [OR] RewriteCond %{HTTP_USER_AGENT} ^SilentSurf [OR] RewriteCond %{HTTP_USER_AGENT} ^Siphon [OR] RewriteCond %{HTTP_USER_AGENT} ^Snagger [OR] RewriteCond %{HTTP_USER_AGENT} ^Snake [OR] RewriteCond %{HTTP_USER_AGENT} ^Snarf [OR] RewriteCond %{HTTP_USER_AGENT} ^Snatcher [OR] RewriteCond %{HTTP_USER_AGENT} ^SpaceBison [OR] RewriteCond %{HTTP_USER_AGENT} ^Stripper [OR] RewriteCond %{HTTP_USER_AGENT} ^Sucker [OR] RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR] RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR] RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR] RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR] RewriteCond %{HTTP_USER_AGENT} ^Vacuum [OR] RewriteCond %{HTTP_USER_AGENT} ^Vampire [OR] RewriteCond %{HTTP_USER_AGENT} ^wantmy [OR] RewriteCond %{HTTP_USER_AGENT} ^Weazel [OR] RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR] RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR] RewriteCond %{HTTP_USER_AGENT} ^Webexe [OR] RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR] RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR] RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR] RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR] RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR] RewriteCond %{HTTP_USER_AGENT} ^Webster [OR] RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR] RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR] RewriteCond %{HTTP_USER_AGENT} ^WebVCR [OR] RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR] RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR] RewriteCond %{HTTP_USER_AGENT} ^WFARC [OR] RewriteCond %{HTTP_USER_AGENT} ^Wget [OR] RewriteCond %{HTTP_USER_AGENT} ^Whacker [OR] RewriteCond %{HTTP_USER_AGENT} ^Widow [OR] RewriteCond %{HTTP_USER_AGENT} ^WWWCopy [OR] RewriteCond %{HTTP_USER_AGENT} ^WWWoffle RewriteRule .\.([gG][iI][fF]\|[jJ][pP][gG])$ - [F]

09-25-2003, 06:59 PM	#14
VideoJ Confirmed User Join Date: Aug 2002 Location: S. Florida Posts: 750	Back in 99, I coded up a tracker that tracked bytes downloaded by account and put a limit on the maximum amount they could download during a day. After they reached the download limit, any downloads returned an error page. With PHP and htaccess it'd be pretty easy to code something like that up. __________________ Somebody stole my damn signture...

09-25-2003, 07:04 PM	#16
Adultnet Confirmed User Join Date: Sep 2003 Posts: 8,713	If you are interested in advance protection means + multi login to members area analyzer security and 100% protection of your content contact ! __________________ TrafficCashGold Paying Webmasters Since 1996! Awesome Conversions! Fast Weekly Payments! Over 125 Tours!

09-25-2003, 07:56 PM	#17
wyvern Registered User Join Date: Jul 2002 Posts: 39	We have a software to limit the daily download traffic of any member or a group of members (it doesn't allow them to download more if they have reached the limit), as well as limit the number of IP changes and a protection against multiple logins. Pease contact me if you are interested - [email protected]

09-25-2003, 08:57 PM	#18
Ludedude Suck it! Industry Role: Join Date: Jun 2001 Location: Who wants to know? Posts: 4,432	Here is a list from one of our sites. I didn't cross-check it against the other two that were already posted FYI. RewriteCond %{HTTP_USER_AGENT} ^DISCo\Pump.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Drip.* [OR] RewriteCond %{HTTP_USER_AGENT} ^EirGrabber.* [OR] RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro.* [OR] RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE.* [OR] RewriteCond %{HTTP_USER_AGENT} ^FlashGet.* [OR] RewriteCond %{HTTP_USER_AGENT} ^GetRight.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Gets.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Grafula.* [OR] RewriteCond %{HTTP_USER_AGENT} ^IBrowse.* [OR] RewriteCond %{HTTP_USER_AGENT} ^InterGET.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Internet\Ninja.* [OR] RewriteCond %{HTTP_USER_AGENT} ^JetCar.* [OR] RewriteCond %{HTTP_USER_AGENT} ^JustView.* [OR] RewriteCond %{HTTP_USER_AGENT} ^MIDown\tool.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Mister\PiX.* [OR] RewriteCond %{HTTP_USER_AGENT} ^NearSite.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Need\To\Know.* [OR] RewriteCond %{HTTP_USER_AGENT} ^NetSpider.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Offline\Explorer.* [OR] RewriteCond %{HTTP_USER_AGENT} ^PageGrabber.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Papa\Foto.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Pockey.* [OR] RewriteCond %{HTTP_USER_AGENT} ^ReGet.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Slurp.* [OR] RewriteCond %{HTTP_USER_AGENT} ^SpaceBison.* [OR] RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Teleport.* [OR] RewriteCond %{HTTP_USER_AGENT} ^WebAuto.* [OR] RewriteCond %{HTTP_USER_AGENT} ^WebCopier.* [OR] RewriteCond %{HTTP_USER_AGENT} ^WebFetch.* [OR] RewriteCond %{HTTP_USER_AGENT} ^WebReaper.* [OR] RewriteCond %{HTTP_USER_AGENT} ^WebSauger.* [OR] RewriteCond %{HTTP_USER_AGENT} ^WebStripper.* [OR] RewriteCond %{HTTP_USER_AGENT} ^WebWhacker.* [OR] RewriteCond %{HTTP_USER_AGENT} ^WebZIP.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Web\Image\Collector.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Web\Sucker.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Webster.* [OR] RewriteCond %{HTTP_USER_AGENT} ^Wget.* [OR] RewriteCond %{HTTP_USER_AGENT} ^eCatch.* [OR] RewriteCond %{HTTP_USER_AGENT} ^ia_archiver.* [OR] RewriteCond %{HTTP_USER_AGENT} ^lftp.* [OR] RewriteCond %{HTTP_USER_AGENT} ^tAkeOut.* RewriteCond %{HTTP_USER_AGENT} ^.WebZIP.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Stripper.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Offline.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Copier.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Crawler.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Snagger.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Teleport.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Reaper.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Wget.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Grabber.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Sucker.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Downloader.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Siphon.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Collector.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Mag-Net.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Widow.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Snake.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.BackWeb.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.gotit.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Vacuum.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Pump.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.HMView.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.HTTrack.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.JOC.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.likse.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Memo.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.pcBrowser.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.SuperBot.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.leech.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Mirror.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Recorder.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.GrabNet.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Likse.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Navroad.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.attach.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Magnet.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Surfbot.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Bandit.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Ants.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Buddy.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Whacker.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Backstreet.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Caitoo.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Curl.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Eclipt.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.FlashSite.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.GetBot.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.GetSmart.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.GetWeb.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Grab.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Greed.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.HtGet.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.HTTrack.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.iFox98.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Sucker.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Vampire.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Eater.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Snarf.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Devil.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Retriever.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.WebVCR.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.WWWCopy.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.WWWoffle.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Aculinx.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.DownloadIt.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Express.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.FlipBrowser.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Weazel.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.IPhoto.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.MemoWeb.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.NetDrag.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Commander.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.SuperBot.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Teleport.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Webexe.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Extractor.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Navroad.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Hoover.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Keepoint.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Enterprise.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Down2Web.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Burner.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Custo.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.Snatcher.$ [OR] RewriteCond %{HTTP_USER_AGENT} ^.FileHound.$ __________________

09-25-2003, 09:05 PM	#19
berg.the.red Confirmed User Join Date: Feb 2003 Location: Right Here. Right Now. Posts: 596	there's a lot of this discussed over on Webmaster World News. do a search on "perfect .htaccess". there's some folks over there who have coded up some routines to monitor bytes downloaded over time and dump them if it's acting like a ripper instead of a surfer. covers the not having the user agent in your .htaccess or spoofed agent problem. actually they've got quite a few neat little ideas over there ... __________________ Need a Dedicated Box with BALLS ? How about a Dedicated Server starting at just $49 per month.