Anybody know some good screen scraper software?

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • Mike Semen
    Confirmed User
    • Dec 2001
    • 2924
    #1

    Anybody know some good screen scraper software?

    Spam me!
    ICQ 1454 81 522 |
    Tags: None
    • grumpy
      Too lazy to set a custom title
      • Jan 2002
      • 9870
      #2
      you mean like this?

      http://www.screen-scraper.com/
      Don't let greediness blur your vision | You gotta let some shit slide
      icq - 441-456-888

        Comment

        • Mike Semen
          Confirmed User
          • Dec 2001
          • 2924
          #3
          Yes thanks, but I more after recommendations...
          ICQ 1454 81 522 |

            Comment

            • gornyhuy
              Chafed.
              • May 2002
              • 18041
              #4
              I usually write my own custom scraper scripts for mainstream data acquisition purposes, but for once I'm up against a system that has good IP activity detection and it is defeating all my tricks.

              Does anybody have a reliable proxy service that actually has all working proxies, that I can access from within a script and that I can hit a few times a second without getting banned?

              PS: this has nothing to do with spam, email slurping, or anything shady. Its totally legit, but the publishers of the data are total pricks so I have to jump through these ridiculous hoops.
              Last edited by gornyhuy; 10-05-2008, 07:38 AM.

              icq:159548293

                Comment

                • gornyhuy
                  Chafed.
                  • May 2002
                  • 18041
                  #5
                  *bump*

                  Screen-Scraper is $2500.... thats a bit steep.

                  icq:159548293

                    Comment

                    • Mike Semen
                      Confirmed User
                      • Dec 2001
                      • 2924
                      #6
                      Originally posted by gornyhuy
                      *bump*

                      Screen-Scraper is $2500.... thats a bit steep.
                      Indeed. Last company I worked at one of our techies wrote a custom one on a couple of hours. If someone wants to do it for a reasonable price I might consider it.
                      ICQ 1454 81 522 |

                        Comment

                        • Rorschach
                          So Fucking Banned
                          • Aug 2002
                          • 5579
                          #7
                          Originally posted by gornyhuy
                          I usually write my own custom scraper scripts for mainstream data acquisition purposes, but for once I'm up against a system that has good IP activity detection and it is defeating all my tricks.

                          Does anybody have a reliable proxy service that actually has all working proxies, that I can access from within a script and that I can hit a few times a second without getting banned?

                          PS: this has nothing to do with spam, email slurping, or anything shady. Its totally legit, but the publishers of the data are total pricks so I have to jump through these ridiculous hoops.
                          Use Tor

                          678

                            Comment

                            • gornyhuy
                              Chafed.
                              • May 2002
                              • 18041
                              #8
                              Originally posted by Rorschach
                              Use Tor

                              678
                              Sweet! Looks promising. I was thinking tor was a browser-only type of system, but it looks like I can get it going for my scripts.

                              Slow as all hell, but I guess thats the price you pay.
                              Thanks!


                              icq:159548293

                                Comment

                                Previous template Next
                                Working...