Is there a spider program that..

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Tala
    Fucked if I know
    • Dec 2002
    • 23368

    #1

    Is there a spider program that..

    ..can go through a folder and make html code for all the .html items in that folder?

    For example: spider through domain.com/folder/ and pick out all the .html extensions, creating an html link to each? Like <a href="http://www.domain.com/folder/pic.html">


    ICQ: 11120676 | Google: mindcrime | Skype: suitemindcrime|E-Mail: mindcrime AT gmail.com|PR girl with great writing skills for hire!!!! Contact me to work for YOU!|TECHIEMEDIA? 24/7 support from some of the best techs in the biz. Tell Jim that I sent you.
  • Tala
    Fucked if I know
    • Dec 2002
    • 23368

    #2
    bumpity


    ICQ: 11120676 | Google: mindcrime | Skype: suitemindcrime|E-Mail: mindcrime AT gmail.com|PR girl with great writing skills for hire!!!! Contact me to work for YOU!|TECHIEMEDIA? 24/7 support from some of the best techs in the biz. Tell Jim that I sent you.

    Comment

    • psili
      Confirmed User
      • Apr 2003
      • 5526

      #3
      Are you talking about a local folder on a windows box, a folder you can browse via a telnet / secure shell, or a folder that's accessed via HTTP with directory listing turned on ?
      Your post count means nothing.

      Comment

      • Tala
        Fucked if I know
        • Dec 2002
        • 23368

        #4
        Originally posted by psili
        Are you talking about a local folder on a windows box, a folder you can browse via a telnet / secure shell, or a folder that's accessed via HTTP with directory listing turned on ?
        Something I can use via ftp, if possible. Turn it loose on a directory and let it go nuts.

        ICQ: 11120676 | Google: mindcrime | Skype: suitemindcrime|E-Mail: mindcrime AT gmail.com|PR girl with great writing skills for hire!!!! Contact me to work for YOU!|TECHIEMEDIA? 24/7 support from some of the best techs in the biz. Tell Jim that I sent you.

        Comment

        • High Plains Drifter
          Confirmed User
          • Jun 2005
          • 2341

          #5
          Originally posted by Tala
          Something I can use via ftp, if possible. Turn it loose on a directory and let it go nuts.
          you're looking for a script that you can upload via ftp, let loose on a directory, and create an html page full of the links to pages it finds? si?

          Comment

          • tungsten
            Too lazy to set a custom title
            • Mar 2004
            • 10579

            #6
            hmm thats a tough one, bump for the more savvy
            • VOYEUR /HOMEMADE, HENTAI / CARTOON, Reality, Amateur, Shemale, Hardcore, Cuckold, Celebrity, Retro/Vintage, ect...ALL OUR SITES >>
            • Unbelievable Ratio | High % of Rebills | Bi-Monthly Payments (also to E-Passporte)
            • Ton's of EXCLUSIVE Free content & FHG's |=> GREAT REVENUE $$$ GUARANTEED!

            Comment

            • Tala
              Fucked if I know
              • Dec 2002
              • 23368

              #7
              Originally posted by skinnywussy
              you're looking for a script that you can upload via ftp, let loose on a directory, and create an html page full of the links to pages it finds? si?
              Something like that, yes. Saves me from having to hard code an assload of links.

              ICQ: 11120676 | Google: mindcrime | Skype: suitemindcrime|E-Mail: mindcrime AT gmail.com|PR girl with great writing skills for hire!!!! Contact me to work for YOU!|TECHIEMEDIA? 24/7 support from some of the best techs in the biz. Tell Jim that I sent you.

              Comment

              • psili
                Confirmed User
                • Apr 2003
                • 5526

                #8
                If you can get a directory listing via the FTP program, download it to your local machine, there's a cheesy way to get what you want via Excel.

                If you have shell / terminal access, there's also a way to get an output of all *.html files with HREF tags wrapped around them output to a text file.

                I'm sure there's other ways as well, but just via an FTP program, I haven't seen that myself. I'm sure we'll keep bumping this thread for you until something comes up for ya.
                Your post count means nothing.

                Comment

                • psili
                  Confirmed User
                  • Apr 2003
                  • 5526

                  #9
                  Originally posted by Tala
                  Something like that, yes. Saves me from having to hard code an assload of links.
                  Oh.

                  If someone has a web accessible script (php / perl / ??) you can upload to a root web directory, hit via a browser and scan a bunch of folders thus creating a master file of links to all *.html files?

                  Yea. Someone has one. If not, someone can program one. And if not, post it as an email to the impoverished noobs board and someone / I'll try and make one in free time.
                  Your post count means nothing.

                  Comment

                  • Tala
                    Fucked if I know
                    • Dec 2002
                    • 23368

                    #10
                    Originally posted by psili
                    Oh.

                    If someone has a web accessible script (php / perl / ??) you can upload to a root web directory, hit via a browser and scan a bunch of folders thus creating a master file of links to all *.html files?

                    Yea. Someone has one. If not, someone can program one. And if not, post it as an email to the impoverished noobs board and someone / I'll try and make one in free time.
                    Kick ass. I'll drop an email about it. Thank you.

                    ICQ: 11120676 | Google: mindcrime | Skype: suitemindcrime|E-Mail: mindcrime AT gmail.com|PR girl with great writing skills for hire!!!! Contact me to work for YOU!|TECHIEMEDIA? 24/7 support from some of the best techs in the biz. Tell Jim that I sent you.

                    Comment

                    Working...