GoFuckYourself.com - Adult Webmaster Forum - View Single Post - Anybody know some good screen scraper software?

gornyhuy · 10-05-2008, 08:36 AM

I usually write my own custom scraper scripts for mainstream data acquisition purposes, but for once I'm up against a system that has good IP activity detection and it is defeating all my tricks.

Does anybody have a reliable proxy service that actually has all working proxies, that I can access from within a script and that I can hit a few times a second without getting banned?

PS: this has nothing to do with spam, email slurping, or anything shady. Its totally legit, but the publishers of the data are total pricks so I have to jump through these ridiculous hoops.

10-05-2008, 08:36 AM
gornyhuy Chafed. Join Date: May 2002 Location: Face Down in Pussy Posts: 18,041	I usually write my own custom scraper scripts for mainstream data acquisition purposes, but for once I'm up against a system that has good IP activity detection and it is defeating all my tricks. Does anybody have a reliable proxy service that actually has all working proxies, that I can access from within a script and that I can hit a few times a second without getting banned? PS: this has nothing to do with spam, email slurping, or anything shady. Its totally legit, but the publishers of the data are total pricks so I have to jump through these ridiculous hoops. __________________ icq:159548293 Last edited by gornyhuy; 10-05-2008 at 08:38 AM..