GoFuckYourself.com - Adult Webmaster Forum - View Single Post

Dusen · 09-21-2003, 12:10 PM

Anyone aware of a decent open sourced search engine spider I could use to spider my sites and make them searchable?

Like give it a starting point, let it go, then have some way to search it.

09-21-2003, 12:10 PM
Dusen Confirmed User Join Date: Aug 2002 Location: East Coast. Posts: 2,251	Open sourced Search Engine Spider Anyone aware of a decent open sourced search engine spider I could use to spider my sites and make them searchable? Like give it a starting point, let it go, then have some way to search it. __________________ Penis Pill Sponsor List and Reviews: http://www.pillsponsors.com