Blocking Offline browsers, site downloaders..
 

What are some methods you're using ( if you are ) to block assholes who run site downloaders on you ? I've got a php/mysql driven site and there's always someone downloading thousands of pages which shoots the server load up to like 24.0

.htaccess/mod_rewrite
mod_throttle

It's impossible, coz they can to use Offline Explorer.

mod_throttle? Hallo?
Nothing is impossible if you have skill, or money. :winkwink:

what is 'Offline Explorer', and how is it getting around MOD_THROTTLE..?

Offline Explorer is a website downloader. My guess is that it forges headers so it gets by robots.txt or an .htaccess file.

It *can* get by mod_throttle as you are throttling each users download speed. Of course you could still download a website, but if a user is on your site for 12 hours, personally I would zap him and let him 'splain why. That is, of course, if you are running member based sites. I don't know what Brujah runs. We used to catch these guys all the time and turf 'em on the spot, usually. It was the guys on highspeed that pissed me off. Dialups I can understand, highspeed, fuck 'em.

If you're talking about a members section (ie. htpasswd protected) then grab pennywize. You can specify a download limit per day and it blocks them once they reach it.

Robert