Anybody know some good screen scraper software?
 

Spam me!:thumbsup

you mean like this?

http://www.screen-scraper.com/

Yes thanks, but I more after recommendations...

I usually write my own custom scraper scripts for mainstream data acquisition purposes, but for once I'm up against a system that has good IP activity detection and it is defeating all my tricks.

Does anybody have a reliable proxy service that actually has all working proxies, that I can access from within a script and that I can hit a few times a second without getting banned?

PS: this has nothing to do with spam, email slurping, or anything shady. Its totally legit, but the publishers of the data are total pricks so I have to jump through these ridiculous hoops.

*bump*

Screen-Scraper is $2500.... thats a bit steep.

Indeed. Last company I worked at one of our techies wrote a custom one on a couple of hours. If someone wants to do it for a reasonable price I might consider it.

Use Tor

678

Sweet! Looks promising. I was thinking tor was a browser-only type of system, but it looks like I can get it going for my scripts.

Slow as all hell, but I guess thats the price you pay.
Thanks!

:thumbsup