![]() |
Looking For A Program That Will...
Crawl a specific url and make a file (or a list to be saved) of links on the page that is being crawled.
Anyone know if such a program exisis and if so, where to find it? I really cant be bothered manually pulling a heap of links into text from one of my sites this would make it much easier lol Thanks in advance for any help. Regards, Lee |
Teleport Pro
|
If you try searching for 'crawler' in download.com there are a bunch of programs that perform tasks similar to what you desire, you might find one of those there can do the job.
|
I am 99.9% sure lynx does it.
Use it with the -dump option and i think there's another option to just display any URL's on the page. Failing that, it gives you a list of all the URL's on the page at the bottom of the output anyway |
| All times are GMT -7. The time now is 08:28 PM. |
Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2026, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc123