Quote:
Originally Posted by holograph
What I?m saying is if you have a spider collecting urls technically it?s possible to have it revisit and recheck pages automatically or have a different spider doing specifically just that. Even if you collect hand submissions it?s better to have something on the background periodically checking listed urls.
|
On top of that give your visitors easy reporting means to report bad links so your system could react to it instantaneously. bad link sent to the system, system sends that link to spider to check out if anything has changed there...