Curl or Wget

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Vapid - BANNED FOR LIFE
    Barterer
    • Aug 2004
    • 4864

    #1

    Curl or Wget

    What do you prefer
    Last edited by Vapid - BANNED FOR LIFE; 12-06-2012, 04:47 AM.
  • EddyTheDog
    Just Doing My Own Thing
    • Jan 2011
    • 25433

    #2
    Curl....

    Comment

    • Vapid - BANNED FOR LIFE
      Barterer
      • Aug 2004
      • 4864

      #3
      #1 curl ^

      Comment

      • HomerSimpson
        Too lazy to set a custom title
        • Sep 2005
        • 13826

        #4
        cURL
        Make a bank with Chaturbate - the best selling webcam program
        Ads that can't be block with AdBlockers !!! /// Best paying popup program (Bitcoin payouts) !!!

        PHP, MySql, Smarty, CodeIgniter, Laravel, WordPress, NATS... fixing stuff, server migrations & optimizations... My ICQ: 27429884 | Email:

        Comment

        • fris
          Too lazy to set a custom title
          • Aug 2002
          • 55679

          #5
          curl from php/ruby/python,etc

          use curl and wget from console
          Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence.

          Comment

          • bns666
            Confirmed Fetishist
            • Mar 2005
            • 11554

            #6
            wget , using it from shell only.
            CAM SODASTRIPCHAT
            CHATURBATEX LOVE CAM

            Comment

            • ottopottomouse
              She is ugly, bad luck.
              • Jan 2010
              • 13177

              #7
              curl + php
              ↑ see post ↑
              13101

              Comment

              • V_RocKs
                Damn Right I Kiss Ass!
                • Nov 2003
                • 32449

                #8
                depends on what I am doing...

                Comment

                • AndrewX
                  Confirmed User
                  • Jan 2004
                  • 574

                  #9
                  Originally posted by V_RocKs
                  depends on what I am doing...
                  From console wget is easier to use and is available even when curl is not installed (yet).

                  █ ► XenLayer - Paravirtualization Professionals since 2008 - [ICQ: 297820698]
                  █ ► Reseller Hosting | OpenVZ VPS | XEN VPS | Dedicated Servers

                  Comment

                  • seeandsee
                    Check SIG!
                    • Mar 2006
                    • 50945

                    #10
                    Curl i guess :D
                    BUY MY SIG - 50$/Year

                    Contact here

                    Comment

                    • Stann
                      Registered User
                      • Dec 2012
                      • 11

                      #11
                      wget from shell

                      Comment

                      • Killswitch
                        REVOLUTIONARY
                        • Oct 2012
                        • 2569

                        #12
                        Originally posted by fris
                        curl from php/ruby/python,etc

                        use curl and wget from console

                        Comment

                        • JamesM
                          Confirmed User
                          • Nov 2012
                          • 732

                          #13
                          for downloading wget from shell.,

                          for doing automation curl and php.


                          Ex GF Films | Grab Dollars
                          Up To 80% Rev-Share | 255 Day Cookie | Legal Content | Variety of Promo Tools | CCBill Program | GF Niche
                          james[at]grabdollars[dot]com | ICQ::611-99-zero-zero-20

                          Comment

                          • shake
                            frc
                            • Jul 2003
                            • 4663

                            #14
                            As most others have said, curl for programming, wget is a nice program to use on it's own from the command line.
                            Crazy fast VPS for $10 a month. Try with $20 free credit

                            Comment

                            • idolbucks
                              Confirmed User
                              • Dec 2008
                              • 914

                              #15
                              wget -i list.txt is nice for dl'ing a huge list of things
                              Idol Bucks - always more...

                              Comment

                              • moeloubani
                                Confirmed User
                                • Dec 2007
                                • 4235

                                #16
                                im actually in the early stages of planning something here and im thinking of using curl but still trying to figure out how to do what i need to do with it

                                basically i need to use a login form on one site to log into another site - easy
                                then i need to display what was on that other site onto the new site - easy

                                the tricky part is i want to change the links on the new site and on the page gathered from the old one so that when someone clicks on them they stay on the new site instead of navigating out

                                any ideas? maybe set up some sort of iframe after the initial login? i have access to both sites

                                Comment

                                • AutumnBH
                                  Confirmed User
                                  • Oct 2012
                                  • 298

                                  #17
                                  Same as everyone else, curl + php or wget from the command line...

                                  However the other day I was scraping an ebook archive. I used curl + php to scrape the html pages and get the actual pdf urls. Then in the next stage I downloaded all the pdfs using a shell script. However I found some hosts would issue a 206 error (partial content) when using wget. I ended up having to use curl from the command line to get the goods.

                                  Comment

                                  • MrCain
                                    Confirmed User
                                    • Jun 2006
                                    • 3332

                                    #18
                                    Wget from the shell. CURL in PHP.
                                    Sigmund

                                    Comment

                                    • pornsprite
                                      Confirmed User
                                      • Dec 2009
                                      • 1643

                                      #19
                                      wget with perl and the command line curl with php
                                      Go Fuck Yourself

                                      Comment

                                      • fris
                                        Too lazy to set a custom title
                                        • Aug 2002
                                        • 55679

                                        #20
                                        Here is an example i did recently with wget

                                        Code:
                                        #!/bin/bash
                                        
                                        # grab images from fishki.net blog posts
                                        
                                        if [ $# -ne 1 ]
                                        then
                                        	echo "fishki.net url to grab images needed."
                                        	exit
                                        fi
                                        
                                        if [[ "$1" == http://fishki.net/comment.php?id=* ]]
                                        then
                                        	echo "downloading..."
                                        	dir=`date "+%Y-%m-%d_%H:%M"`;
                                        	wget -r -p -q -nd -e robots=off -P images_$dir -A '*.jpg' -R 'tn.jpg' -H -D 'ru.fishki.net' $1
                                        	echo -n "images saved: " ; ls images_$dir/ | grep ".jpg" -c
                                        else
                                        	echo "invalid url: must contain http://fishki.net/comment.php?id=xxxxx"
                                        fi
                                        exit 64
                                        ;;
                                        esac
                                        ;)
                                        Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence.

                                        Comment

                                        • mafia_man
                                          Confirmed User
                                          • Jul 2005
                                          • 1965

                                          #21
                                          http://aria2.sourceforge.net/
                                          I'm out.

                                          Comment

                                          • fris
                                            Too lazy to set a custom title
                                            • Aug 2002
                                            • 55679

                                            #22
                                            get the latest 20 popular images from 500px.com

                                            Code:
                                            for line in `wget --quiet -O- http://500px.com/popular | grep "from=popular" | sed -n 's/.*<img src="\([^"]*\)".*/\1/p' | sed s/"3.jpg"/"4.jpg"/ | sed s/"?t".*$//`; do wget -O $RANDOM.jpg --quiet "$line"; done
                                            Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence.

                                            Comment

                                            • VenusBlogger
                                              So Fucking Banned
                                              • Nov 2011
                                              • 1540

                                              #23
                                              I'm suprised so much people here are programmers...

                                              so where are the people that never used CURL+WGET?

                                              You dont wonder or ask why they use it? Are you not curious at all?

                                              Maybe its something that could be helpful and help in your webmaster tasks.. but nobody that never used it jumps into this thread, im very surprised... No curiosity? NOBODY?... That's how humans discover things, with curiosity...

                                              I personally used WGET in SSH before, but only a few times.
                                              Last edited by VenusBlogger; 12-09-2012, 03:40 PM.

                                              Comment

                                              • Miguel T
                                                ♦ Web Developer ♦
                                                • May 2005
                                                • 12473

                                                #24
                                                cURL all the way!

                                                Full Stack Webdeveloper: HTML5/CSS3, jQuery, AJAX, ElevatedX, NATS, MechBunny, Wordpress

                                                Comment

                                                • CYF
                                                  Coupon Guru
                                                  • Mar 2009
                                                  • 10973

                                                  #25
                                                  wget for command line, curl for scripts and stuff.
                                                  Webmaster Coupons Coupons and discounts for hosting, domains, SSL Certs, and more!
                                                  AmeriNOC Coupons | Certified Hosting Coupons | Hosting Coupons | Domain Name Coupons

                                                  Comment

                                                  • edgeprod
                                                    Permanently Gone
                                                    • Mar 2004
                                                    • 10019

                                                    #26
                                                    I don't think I've ever used curl OUTSIDE of a script, or wget INSIDE of one, so I see them as environment-based tools. I've been coding cURL stuff all weekend, so I'd definitely say I use cURL a lot more FREQUENTLY, if that's the question.

                                                    The answer of "this or that" is usually "the right tool for the job" .. so what's the job?

                                                    Comment

                                                    • sandman!
                                                      Icq: 14420613
                                                      • Mar 2001
                                                      • 15431

                                                      #27
                                                      wget.....
                                                      Need WebHosting ? Email me for some great deals [email protected]

                                                      Comment

                                                      Working...