GoFuckYourself.com - Adult Webmaster Forum - View Single Post - are there any spiders/crawlers out there like "zeus"?

Suckitbitch · 12-28-2003, 10:17 PM

except a tad more spiffy and a lot more configurable as far as blocking rules... done in perl so it can run on a server 24/7

12-28-2003, 10:17 PM
Suckitbitch Confirmed User Join Date: Jul 2003 Posts: 278	are there any spiders/crawlers out there like "zeus"? except a tad more spiffy and a lot more configurable as far as blocking rules... done in perl so it can run on a server 24/7