Is there a spider program that.. - GoFuckYourself.com

Tala · 08-09-2005, 05:30 PM

..can go through a folder and make html code for all the .html items in that folder?

For example: spider through domain.com/folder/ and pick out all the .html extensions, creating an html link to each? Like <a href="http://www.domain.com/folder/pic.html">

Tala · 08-09-2005, 05:45 PM

bumpity

psili · 08-09-2005, 05:47 PM

Are you talking about a local folder on a windows box, a folder you can browse via a telnet / secure shell, or a folder that's accessed via HTTP with directory listing turned on ?

Tala · 08-09-2005, 05:55 PM

Quote:

Originally Posted by psili

Are you talking about a local folder on a windows box, a folder you can browse via a telnet / secure shell, or a folder that's accessed via HTTP with directory listing turned on ?

Something I can use via ftp, if possible. Turn it loose on a directory and let it go nuts.

High Plains Drifter · 08-09-2005, 06:05 PM

Quote:

Originally Posted by Tala

Something I can use via ftp, if possible. Turn it loose on a directory and let it go nuts.

you're looking for a script that you can upload via ftp, let loose on a directory, and create an html page full of the links to pages it finds? si?

tungsten · 08-09-2005, 06:06 PM

hmm thats a tough one, bump for the more savvy

Tala · 08-09-2005, 06:12 PM

Quote:

Originally Posted by skinnywussy

you're looking for a script that you can upload via ftp, let loose on a directory, and create an html page full of the links to pages it finds? si?

Something like that, yes.

Saves me from having to hard code an assload of links.

psili · 08-09-2005, 06:13 PM

If you can get a directory listing via the FTP program, download it to your local machine, there's a cheesy way to get what you want via Excel.

If you have shell / terminal access, there's also a way to get an output of all *.html files with HREF tags wrapped around them output to a text file.

I'm sure there's other ways as well, but just via an FTP program, I haven't seen that myself. I'm sure we'll keep bumping this thread for you until something comes up for ya.

psili · 08-09-2005, 06:17 PM

Quote:

Originally Posted by Tala

Something like that, yes.

Saves me from having to hard code an assload of links.

Oh.

If someone has a web accessible script (php / perl / ??) you can upload to a root web directory, hit via a browser and scan a bunch of folders thus creating a master file of links to all *.html files?

Yea. Someone has one. If not, someone can program one. And if not, post it as an email to the impoverished noobs board and someone / I'll try and make one in free time.

Tala · 08-09-2005, 06:21 PM

Quote:

Originally Posted by psili

Oh.

If someone has a web accessible script (php / perl / ??) you can upload to a root web directory, hit via a browser and scan a bunch of folders thus creating a master file of links to all *.html files?

Yea. Someone has one. If not, someone can program one. And if not, post it as an email to the impoverished noobs board and someone / I'll try and make one in free time.

Kick ass.

I'll drop an email about it. Thank you.

08-09-2005, 05:30 PM	#1
Tala Fucked if I know Join Date: Dec 2002 Location: Do you have a flag? Posts: 23,368	Is there a spider program that.. ..can go through a folder and make html code for all the .html items in that folder? For example: spider through domain.com/folder/ and pick out all the .html extensions, creating an html link to each? Like <a href="http://www.domain.com/folder/pic.html">

08-09-2005, 05:47 PM	#3
psili Confirmed User Join Date: Apr 2003 Location: Loveland, CO Posts: 5,526	Are you talking about a local folder on a windows box, a folder you can browse via a telnet / secure shell, or a folder that's accessed via HTTP with directory listing turned on ? __________________ Your post count means nothing.

08-09-2005, 06:06 PM	#6
tungsten Too lazy to set a custom title Join Date: Mar 2004 Posts: 10,579	hmm thats a tough one, bump for the more savvy __________________ VOYEUR /HOMEMADE, HENTAI / CARTOON, Reality, Amateur, Shemale, Hardcore, Cuckold, Celebrity, Retro/Vintage, ect...ALL OUR SITES >> Unbelievable Ratio \| High % of Rebills \| Bi-Monthly Payments (also to E-Passporte) Ton's of EXCLUSIVE Free content & FHG's \|=> GREAT REVENUE $$$ GUARANTEED!

08-09-2005, 06:13 PM	#8
psili Confirmed User Join Date: Apr 2003 Location: Loveland, CO Posts: 5,526	If you can get a directory listing via the FTP program, download it to your local machine, there's a cheesy way to get what you want via Excel. If you have shell / terminal access, there's also a way to get an output of all *.html files with HREF tags wrapped around them output to a text file. I'm sure there's other ways as well, but just via an FTP program, I haven't seen that myself. I'm sure we'll keep bumping this thread for you until something comes up for ya. __________________ Your post count means nothing.

08-09-2005, 05:45 PM	#2
Tala Fucked if I know Join Date: Dec 2002 Location: Do you have a flag? Posts: 23,368	bumpity