Any FTP program that can do this? - GoFuckYourself.com

ldinternet · 05-10-2003, 02:38 AM

I want to select a bunch of files from a folder (a few thousand in each folder) and have the FTP program download only files of a certain type - e.g, download only *.html and *.php

It can be done manually but it would take days because of the folder structure and the number of files involved.

Any recommendations please?

beemk · 05-10-2003, 02:44 AM

use cute ftp

right click -> sorting -> by entention

click the first file with that extention, hold down shift, click the last file. then add to queue. then do that for each type of extention you want.

ldinternet · 05-10-2003, 03:01 AM

Thanks... the problem is that I have hundreds and hundreds of folders, some within another folder, some within a folder that's within another folder, etc.

Looks like I'll have to use that method if there's nothing else.

It would be fantastic if I could select the root folder, and have the program download everything that ends with *.html or *.php, rather than having to enter each folder and select the files manually.

beemk · 05-10-2003, 03:05 AM

mabye you could hide all the other files?

or better yet, just download them all. then go to find-> find files or folders in windows and type the path for the folder you downloaded under "look in" then theres a thing on the top to click to sort by type of file. then delete all un-necessary files. problem solved.

Phoenix66 · 05-10-2003, 03:13 AM

I was going to say that it may be possible to download them all and then sort, but previous post is about it.

It's not a right way if you have a lot of other files though.

As far as I remember TeleportPro (or something similar to it) can download only files with specified extentions. I'm not sure if it can work with FTP, but I think you can get those files via http as well.

ldinternet · 05-10-2003, 03:19 AM

Quote:

Originally posted by beemk
mabye you could hide all the other files?

or better yet, just download them all. then go to find-> find files or folders in windows and type the path for the folder you downloaded under "look in" then theres a thing on the top to click to sort by type of file. then delete all un-necessary files. problem solved.

I'd download everything if there wasn't so much to download... there's about 10GB of stuff spread unevenly across 20-something domains. That's the problem.

At the moment I'm fiddling around with WS, bullet proof and cute FTP. Most processes like mass-html editing and mass file deletion/replacement are easy to work out, but this has me stumped.

There must be a way to do this automatically without downloading everything.

ldinternet · 05-10-2003, 03:20 AM

Quote:

Originally posted by Phoenix66
As far as I remember TeleportPro (or something similar to it) can download only files with specified extentions.

Checking it out... didn't think of that.

beemk · 05-10-2003, 03:25 AM

you can search and search, but i would start downloading now. you might finish the download before you're done searching.

ldinternet · 05-10-2003, 03:26 AM

ahahahaha, true.

phish · 05-10-2003, 04:21 AM

ok this is my first post but im pretty sure this should help you

download wget ( *nix version | windows version )
its a command line utility but it should work
for example
wget -r --accept=gif,jpg,htm ftp://user@pass:myserver.com
would download all files from your server that hat the extensions .gif .jpg and .htm

i hope thats what youre searching for

have a nice day...

ldinternet · 05-10-2003, 04:45 AM

Thanks.

venturi · 05-10-2003, 04:49 AM

Quote:

Originally posted by ldinternet
I want to select a bunch of files from a folder (a few thousand in each folder) and have the FTP program download only files of a certain type - e.g, download only *.html and *.php

It can be done manually but it would take days because of the folder structure and the number of files involved.

Any recommendations please?

Grab a copy of FTPVoyager from RhinoSoft.com. It's not a free program like CuteFTP, but it is feature packed and has a very robust file filtering capability that will allow you to see and/or upload/download only files matching what you select.

Stramm · 05-10-2003, 05:03 AM

use tar to compress all files of the type you need. Then download the tarfile and uncompress it.. done.. and downloading one massive archive is 100x faster then downloading thousands of crappy lil files

grumpy · 05-10-2003, 07:04 AM

ftp in windows let you do that get *.jpg

05-10-2003, 02:38 AM	#1
ldinternet Confirmed User Join Date: Apr 2001 Posts: 8,245	Any FTP program that can do this? I want to select a bunch of files from a folder (a few thousand in each folder) and have the FTP program download only files of a certain type - e.g, download only .html and .php It can be done manually but it would take days because of the folder structure and the number of files involved. Any recommendations please?

05-10-2003, 02:44 AM	#2
beemk CLICK HERE Industry Role: Join Date: Jan 2002 Posts: 20,829	use cute ftp right click -> sorting -> by entention click the first file with that extention, hold down shift, click the last file. then add to queue. then do that for each type of extention you want. __________________ I host with Vacares

05-10-2003, 03:05 AM	#4
beemk CLICK HERE Industry Role: Join Date: Jan 2002 Posts: 20,829	mabye you could hide all the other files? or better yet, just download them all. then go to find-> find files or folders in windows and type the path for the folder you downloaded under "look in" then theres a thing on the top to click to sort by type of file. then delete all un-necessary files. problem solved. __________________ I host with Vacares

05-10-2003, 03:13 AM	#5
Phoenix66 Confirmed User Join Date: Oct 2002 Posts: 823	I was going to say that it may be possible to download them all and then sort, but previous post is about it. It's not a right way if you have a lot of other files though. As far as I remember TeleportPro (or something similar to it) can download only files with specified extentions. I'm not sure if it can work with FTP, but I think you can get those files via http as well. __________________ Adult Niche Traffic Exchange

05-10-2003, 03:25 AM	#8
beemk CLICK HERE Industry Role: Join Date: Jan 2002 Posts: 20,829	you can search and search, but i would start downloading now. you might finish the download before you're done searching. __________________ I host with Vacares

05-10-2003, 03:01 AM	#3
ldinternet Confirmed User Join Date: Apr 2001 Posts: 8,245	Thanks... the problem is that I have hundreds and hundreds of folders, some within another folder, some within a folder that's within another folder, etc. Looks like I'll have to use that method if there's nothing else. It would be fantastic if I could select the root folder, and have the program download everything that ends with .html or .php, rather than having to enter each folder and select the files manually.

05-10-2003, 03:26 AM	#9
ldinternet Confirmed User Join Date: Apr 2001 Posts: 8,245	ahahahaha, true.

05-10-2003, 04:21 AM	#10
phish Registered User Join Date: May 2003 Posts: 1	ok this is my first post but im pretty sure this should help you download wget ( *nix version \| windows version ) its a command line utility but it should work for example wget -r --accept=gif,jpg,htm ftp://user@pass:myserver.com would download all files from your server that hat the extensions .gif .jpg and .htm i hope thats what youre searching for have a nice day...

05-10-2003, 04:45 AM	#11
ldinternet Confirmed User Join Date: Apr 2001 Posts: 8,245	Thanks.

05-10-2003, 05:03 AM	#13
Stramm Confirmed User Join Date: Jan 2003 Location: NL Posts: 342	use tar to compress all files of the type you need. Then download the tarfile and uncompress it.. done.. and downloading one massive archive is 100x faster then downloading thousands of crappy lil files

05-10-2003, 07:04 AM	#14
grumpy Too lazy to set a custom title Join Date: Jan 2002 Location: Holland Posts: 9,870	ftp in windows let you do that get .jpg __________________ Don't let greediness blur your vision* \| You gotta let some shit slide icq - 441-456-888