Looking For A Program That Will...

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • European Lee
    Confirmed User
    • Dec 2002
    • 7133

    #1

    Looking For A Program That Will...

    Crawl a specific url and make a file (or a list to be saved) of links on the page that is being crawled.

    Anyone know if such a program exisis and if so, where to find it?

    I really cant be bothered manually pulling a heap of links into text from one of my sites this would make it much easier lol

    Thanks in advance for any help.

    Regards,

    Lee
    YOUR TRAFFIC IS SAFE WITH US - CONDOM CASH
    PUTTING THE GAY ADULT INDUSTRY ON YOUR PC!!
    AFFORDABLE 2257 COMPLIANT GAY + BI CONTENT
  • BigFrog
    Confirmed User
    • Sep 2002
    • 2057

    #2
    Teleport Pro

    Comment

    • BlueDesignStudios
      Confirmed User
      • Feb 2003
      • 9492

      #3
      If you try searching for 'crawler' in download.com there are a bunch of programs that perform tasks similar to what you desire, you might find one of those there can do the job.

      Blue Design Studios - Adult Design Specialists!
      Email me for a free quote: [email protected]

      Comment

      • Swoit
        Confirmed User
        • Apr 2003
        • 256

        #4
        I am 99.9% sure lynx does it.

        Use it with the -dump option and i think there's another option to just display any URL's on the page.

        Failing that, it gives you a list of all the URL's on the page at the bottom of the output anyway
        SIG TOO BIG! Maximum 120x60 button and no more than 3 text lines of DEFAULT SIZE and COLOR. Unless your sig is for a GFY top banner sponsor, then you may use a 624x80 instead of a 120x60.

        Comment

        Working...