Copying 10 Million Thumbs, Fuck!

Collapse
X
Collapse
 
  • Page of 2
  • Time
  • Show
Clear All
new posts
Previous 1 2 template Next
  • rickdu
    Confirmed User
    • Mar 2005
    • 239
    #1

    Copying 10 Million Thumbs, Fuck!

    Here's an unexpected mind fuck... 10 million thumbs, 500 gigs, from one drive to another on the same server... estimated time, 4 fucking days!
    Tags: None
    • borked
      Totally Borked
      • Feb 2005
      • 6284
      #2
      would have been much quicker to zip them then transfer the zip.

      For coding work - hit me up on andy // borkedcoder // com
      (consider figuring out the email as test #1)


      All models are wrong, but some are useful. George E.P. Box. p202

        Comment

        • rickdu
          Confirmed User
          • Mar 2005
          • 239
          #3
          i tried that first, copied all in just a few hours, but then needed 9 days to extract.. so i deleted the gzip and started over with copy

            Comment

            • EddyTheDog
              Just Doing My Own Thing
              • Jan 2011
              • 25433
              #4
              Originally posted by borked
              would have been much quicker to zip them then transfer the zip.
              Yep - You can set with no compression.

                Comment

                • rickdu
                  Confirmed User
                  • Mar 2005
                  • 239
                  #5
                  my second attempt has been running 13 hours now.. no compression sounds interesting, but not sure if the performance gain will be worth starting over now.. with compression was 9 days to extract.. without, maybe half? which would be the same as copy then...

                    Comment

                    • FlowerKid
                      Confirmed User
                      • Sep 2005
                      • 1045
                      #6
                      WTF, one of your thumbs is as big as 50MB? Normally a thumb is below 10kB.

                        Comment

                        • rickdu
                          Confirmed User
                          • Mar 2005
                          • 239
                          #7
                          160px × 120px, average 15 KB each.. in this case it's not the size, it's the number.

                            Comment

                            • FlowerKid
                              Confirmed User
                              • Sep 2005
                              • 1045
                              #8
                              My calculation: 500GB/10M=50MB
                              Last edited by FlowerKid; 02-25-2012, 10:42 PM.

                                Comment

                                • EddyTheDog
                                  Just Doing My Own Thing
                                  • Jan 2011
                                  • 25433
                                  #9
                                  Originally posted by FlowerKid
                                  My calculation: 500GB/10M=50MB
                                  That would be 500TBs - I think.....

                                    Comment

                                    • Socks
                                      Confirmed User
                                      • May 2002
                                      • 8475
                                      #10
                                      I'm sure you're in unix, but on the off chance, I'll leave this here

                                      http://codesector.com/teracopy

                                        Comment

                                        • GFED
                                          Confirmed User
                                          • May 2002
                                          • 8121
                                          #11
                                          Originally posted by flowerkid
                                          my calculation: 500gb/10m=50mb
                                          (500*10^9)/(10*10^6)=(500*10^3)/(10)=(50*10^3)/(1)=50kb
                                          https://www.flow.page/savethechildren

                                            Comment

                                            • rickdu
                                              Confirmed User
                                              • Mar 2005
                                              • 239
                                              #12
                                              i'm guesstimating... roughly 500k sets of 20 thumbs each, filled a 500gb drive 92%.. some thumbs are 10kb, some are 35kb.. and roughly 10-million of them..

                                              edit.. was off by 172,000 set.. total is 672k sets for 20
                                              Last edited by rickdu; 02-26-2012, 12:37 AM.

                                                Comment

                                                • fris
                                                  Too lazy to set a custom title
                                                  • Aug 2002
                                                  • 55679
                                                  #13
                                                  windows or unix?
                                                  Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence.

                                                    Comment

                                                    • rickdu
                                                      Confirmed User
                                                      • Mar 2005
                                                      • 239
                                                      #14
                                                      unix.. freebsd 8

                                                        Comment

                                                        • Paul&John
                                                          Confirmed User
                                                          • Aug 2005
                                                          • 8643
                                                          #15
                                                          Originally posted by EddyTheDog
                                                          Yep - You can set with no compression.
                                                          Would try this one also..
                                                          Use coupon 'pauljohn' for a $1 discount at already super cheap NameSilo!
                                                          Anal Webcams | Kinky Trans Cams Live | Hotwife XXX Tube | Get your Proxies here

                                                            Comment

                                                            Previous 1 2 template Next
                                                            Working...