Web page downloader/scraper...or whatever it's called...

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • FlexxAeon
    Confirmed User
    • May 2003
    • 3765
    #1

    Web page downloader/scraper...or whatever it's called...

    Seems like there should be some type of application that can do this I just am not sure what the proper term for it would be (never used one). I need to:

    - Input several URL's (to FHG's) to batch
    - Program will download the pages and the elements it links to (need to at least get the thumbs and the videos)

    Anyone know an app that will accomplish this? Or what an app like this would be called? Preferably a freebie as I don't see myself using it very often after this task gets completed
    flexx [dot] aeon [at] gmail
    Tags: None
    • CYF
      Coupon Guru
      • Mar 2009
      • 10973
      #2
      Curl
      wget

      both are free and will download or mirror a whole website.
      Webmaster Coupons Coupons and discounts for hosting, domains, SSL Certs, and more!
      AmeriNOC Coupons | Certified Hosting Coupons | Hosting Coupons | Domain Name Coupons

        Comment

        • cLin
          Registered User
          • May 2009
          • 94
          #3
          On the flip side, how do we stop site ripping? =\ I was thinking javascript but that screws the people who don't use it (which I really shouldn't care about but whatever).
          Chris
          The Ex Girlfriend Pics

            Comment

            • raymor
              Confirmed User
              • Oct 2002
              • 3745
              #4
              Originally posted by cLin
              On the flip side, how do we stop site ripping? =\ I was thinking javascript but that screws the people who don't use it (which I really shouldn't care about but whatever).
              Strongbox has a couple of anti-ripping features - one that's automatic and one
              you can activate. Throttlebox is all about preventing ripping.
              For historical display only. This information is not current:
              support@bettercgi.com ICQ 7208627
              Strongbox - The next generation in site security
              Throttlebox - The next generation in bandwidth control
              Clonebox - Backup and disaster recovery on steroids

                Comment

                Previous template Next
                Working...