|
Script To Spider My Server?
As you all know if you have been doing this for a long time and you have been lazy like myself then you have a server full of thousands and thousands of gallery or site urls on your server....
Well i would like to see or have something that you can put on your server and click a button to spider your server for all index pages that exsist on it then compile them into a nice html page and see everything you have out there...
Hope this make sence? anyone know of anything that might be availiable?
Thanks
Tom
|