What is the best way to mass download an entire site?

**GooSearch** · 06-13-2007, 06:39 PM

frontpage :p

ur killin me ya know this

**HighSociety** · 06-13-2007, 06:57 PM

this is why you put a virus in your members area that can't be seen but will be downloaded when a program is used to suck your site dry

**DWB** · 06-13-2007, 06:59 PM

Originally posted by made2ordervideos

this is why you put a virus in your members area that can't be seen but will be downloaded when a program is used to suck your site dry

Ohhhhh. I like the sound of that.

You have one to sell?

**GooSearch** · 06-13-2007, 07:01 PM

Originally posted by made2ordervideos

this is why you put a virus in your members area that can't be seen but will be downloaded when a program is used to suck your site dry

we been beat up for a few days.. i'll take one too

**HighSociety** · 06-13-2007, 07:01 PM

the virus or the program that downloads entire sites? I do know of a members area that has this in it. The program you can probably find on google

**jact** · 06-13-2007, 07:02 PM

wget will do it.

**tony286** · 06-13-2007, 07:03 PM

Originally posted by made2ordervideos

this is why you put a virus in your members area that can't be seen but will be downloaded when a program is used to suck your site dry

Thats a great idea actually, some scum bag ripped one of my sites and put it up on a bt.

**HighSociety** · 06-13-2007, 07:05 PM

It works well

**psili** · 06-13-2007, 07:15 PM

Originally posted by jact

wget will do it.

Never tried it, but might have to agree with "wget" or the ton of graphical clients that crawl and download from sites.

You find a site that still uses basic authentication and offers video downloads that aren't DRM'd, you could pretty much own their shit with free software out there.

Fuck it. Hit up a password sharing site, find all that use basic auth who you have a grudge against, and work their shit.

Using basic auth and allowing free downloads is like dropping a wallet on the street. -- You find it. It's yours.

**geedub** · 06-13-2007, 07:18 PM

wget fo shizzle

**fluffygrrl** · 06-13-2007, 07:18 PM

wget, it even has a windows port now.

**ultimatebbwdotcom** · 06-13-2007, 07:29 PM

Theres hundreds of progs that download entire sites - d/l limits and block lists cure most of the problems...... like the sound of the virus though, any more info?

**camgenie** · 06-13-2007, 07:40 PM

Originally posted by jact

wget will do it.

wget -r [site]

or

man wget

**RedShoe** · 06-13-2007, 07:54 PM

I'd like to wget a fuckin boot up their ass!

**RawAlex** · 06-13-2007, 07:58 PM

You can lead wget down the garden path and fill their disk space up pretty quickly with junk - apparently well formed jpeg files that are really large and don't contain images. You can use links that normal surfers won't see to do this (1x1 pixels linked, example, near the top of each page). Track whoever hits those links, and ban the IP. It will certainly slow them down.

Good luck.

**DWB** · 06-13-2007, 08:35 PM

Originally posted by RawAlex

You can lead wget down the garden path and fill their disk space up pretty quickly with junk - apparently well formed jpeg files that are really large and don't contain images. You can use links that normal surfers won't see to do this (1x1 pixels linked, example, near the top of each page). Track whoever hits those links, and ban the IP. It will certainly slow them down.

Good luck.

That's pretty slick.

**GrouchyAdmin** · 06-13-2007, 09:15 PM

Wget, of course. wget can be set to ignore robots.txt, so a good thing to do is make a hidden directory full of crap, say /d/, and just fill it with a bunch of random data, and have your analyzer watch for that. There are many programs written for UNIX that can even realtime watch your apache logs and fire off an email with the person's IP (and if using normal authentication methods, their username).

**uno** · 06-13-2007, 09:29 PM

Originally posted by jact

wget will do it.

jact knows his shit.

**Shoehorn!** · 06-13-2007, 09:43 PM

Originally posted by made2ordervideos

this is why you put a virus in your members area that can't be seen but will be downloaded when a program is used to suck your site dry

That is an awesome idea.

**bobby666** · 06-13-2007, 09:57 PM

i used webzip for mirroring or downloading websites when i was a pc user

What is the best way to mass download an entire site?

What is the best way to mass download an entire site?

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment