GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   Is there a spider program that.. (https://gfy.com/showthread.php?t=501669)

Tala 08-09-2005 05:30 PM

Is there a spider program that..
 
..can go through a folder and make html code for all the .html items in that folder?

For example: spider through domain.com/folder/ and pick out all the .html extensions, creating an html link to each? Like <a href="http://www.domain.com/folder/pic.html">

:helpme

Tala 08-09-2005 05:45 PM

bumpity

:helpme

psili 08-09-2005 05:47 PM

Are you talking about a local folder on a windows box, a folder you can browse via a telnet / secure shell, or a folder that's accessed via HTTP with directory listing turned on ?

Tala 08-09-2005 05:55 PM

Quote:

Originally Posted by psili
Are you talking about a local folder on a windows box, a folder you can browse via a telnet / secure shell, or a folder that's accessed via HTTP with directory listing turned on ?

Something I can use via ftp, if possible. Turn it loose on a directory and let it go nuts.

High Plains Drifter 08-09-2005 06:05 PM

Quote:

Originally Posted by Tala
Something I can use via ftp, if possible. Turn it loose on a directory and let it go nuts.

you're looking for a script that you can upload via ftp, let loose on a directory, and create an html page full of the links to pages it finds? si?

tungsten 08-09-2005 06:06 PM

hmm thats a tough one, bump for the more savvy

Tala 08-09-2005 06:12 PM

Quote:

Originally Posted by skinnywussy
you're looking for a script that you can upload via ftp, let loose on a directory, and create an html page full of the links to pages it finds? si?

Something like that, yes. :) Saves me from having to hard code an assload of links.

psili 08-09-2005 06:13 PM

If you can get a directory listing via the FTP program, download it to your local machine, there's a cheesy way to get what you want via Excel.

If you have shell / terminal access, there's also a way to get an output of all *.html files with HREF tags wrapped around them output to a text file.

I'm sure there's other ways as well, but just via an FTP program, I haven't seen that myself. I'm sure we'll keep bumping this thread for you until something comes up for ya.

psili 08-09-2005 06:17 PM

Quote:

Originally Posted by Tala
Something like that, yes. :) Saves me from having to hard code an assload of links.

Oh.

If someone has a web accessible script (php / perl / ??) you can upload to a root web directory, hit via a browser and scan a bunch of folders thus creating a master file of links to all *.html files?

Yea. Someone has one. If not, someone can program one. And if not, post it as an email to the impoverished noobs board and someone / I'll try and make one in free time.

Tala 08-09-2005 06:21 PM

Quote:

Originally Posted by psili
Oh.

If someone has a web accessible script (php / perl / ??) you can upload to a root web directory, hit via a browser and scan a bunch of folders thus creating a master file of links to all *.html files?

Yea. Someone has one. If not, someone can program one. And if not, post it as an email to the impoverished noobs board and someone / I'll try and make one in free time.

Kick ass. :) I'll drop an email about it. Thank you. :)


All times are GMT -7. The time now is 10:26 AM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2026, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123