Open sourced Search Engine Spider

[Dusen]

Anyone aware of a decent open sourced search engine spider I could use to spider my sites and make them searchable?

Like give it a starting point, let it go, then have some way to search it.

[candyflip]

Not sure if it's what you are looking for...just trying to help:

http://www.digvid.info/isearch/home/

[brazz]

If you are good enough with Unix:

http://sourceforge.net/projects/webharvest/