GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   best download spider? (https://gfy.com/showthread.php?t=114188)

strainer 03-08-2003 06:23 PM

best download spider?
 
There are a ton of these out there, which works the best for spidering a members site and downloading the content. (So I have to be able to feed it a username/password).

I'm trying to backup a site for a technically challenged webmaster...

completetosser 03-08-2003 06:27 PM

Why don't you just tar it up?

strainer 03-08-2003 06:29 PM

Quote:

Originally posted by completetosser
Why don't you just tar it up?
He doesn't have ftp access, much less ssh. long story. I know those dowload spiders work well cause my members use them all the time to suck the whole site down...

p00p 03-08-2003 06:32 PM

Quote:

Originally posted by strainer
There are a ton of these out there, which works the best for spidering a members site and downloading the content. (So I have to be able to feed it a username/password).

I'm trying to backup a site for a technically challenged webmaster...

I've tried quite a few, and this one best replicates directory structure, and gets everything, no missed files.
http://www.httrack.com/index.php

3Xguru 03-08-2003 06:46 PM

WebCopier is very good and can submit forms too

SpaceAce 03-08-2003 06:48 PM

Quote:

Originally posted by strainer


He doesn't have ftp access, much less ssh. long story. I know those dowload spiders work well cause my members use them all the time to suck the whole site down...

Just pick the one from your logs that does the most damage.

SpaceAce

lil2rich4u2 03-08-2003 08:33 PM

theres a program on download.com called GetPics

strainer 03-08-2003 09:26 PM

Quote:

Originally posted by p00p

I've tried quite a few, and this one best replicates directory structure, and gets everything, no missed files.
http://www.httrack.com/index.php

Pretty cool... Its running now. I had already wasted my money on Teleport which doesn't seem to work too well and put everything in one directory.:mad:

p00p 03-08-2003 09:30 PM

Quote:

Originally posted by strainer


Pretty cool... Its running now. I had already wasted my money on Teleport which doesn't seem to work too well and put everything in one directory.:mad:

Yeah. Once you figure that program out (and it isn't hard) it will download everything, and do a perfect replication. It is the only one I have used over the years that actually does this everytime consistently. I used to use offline explorer, and it would never go deep enough into the directory structure to get everything....

X37375787 03-08-2003 09:33 PM

Teleport Pro works well on certain teen hardcore vid sites... :1orglaugh


All times are GMT -7. The time now is 10:46 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123