AI Video upscaling question

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • 2MuchMark
    Mark of 2Much.net
    • Aug 2004
    • 50911
    #1

    AI Video upscaling question

    Hi Everyone,

    I have been experimenting with AI Video upscaling. Please take a look at this screenshot and tell me what you think:



    The source (top image) is from an ancient .asf file in 522x300 resolution. The bottom is upconverted to 720p. The screenshots are taken a few seconds apart so the model's expression is different.

    On the plus side, you can see that the video noise is removed and the image looks clearer. Unfortunately the AI generates a few artifacts of its own.

    Do you think its worth up-converting old unplayable .ASF files in 522x300 res up to modern sizes like 720p, HD, 2K and even 4K, even if it introduces AI artifacts? Or do they prefer the noisy originals?
    Tags: None
    • Mindi
      So Fucking Banned
      • Aug 2024
      • 1215
      #2
      Is someone gonna tell him that his screenshot doesn’t load?

      Imgbb.com uploading this content requires registration

        Comment

        • digitalfantasies
          Confirmed User
          • Sep 2010
          • 2755
          #3
          your screenshot doesn't load

            Comment

            • cerulean
              Web & App Development
              • Oct 2023
              • 229
              #4
              I've written an ffmpeg script to upscale VHS video to 720p and 1080p, and while it's not amazing because it can't invent pixels, it is decent enough for my needs and some client needs. You might want to try that if you are concerned about AI artifacting, or finding a happy middle-ground between the two.
              Cerulean Software Specializes in Website and App Development. Email me today!
              Get a Custom Landing Page with TapClick.Link - For Small Businesses and Creators
              Keep Your Business and Members Area Secure with LoginBlue Password and Content Protection

                Comment

                • 2MuchMark
                  Mark of 2Much.net
                  • Aug 2004
                  • 50911
                  #5
                  oops! lets try that again.

                    Comment

                    • 2MuchMark
                      Mark of 2Much.net
                      • Aug 2004
                      • 50911
                      #6
                      Originally posted by cerulean
                      I've written an ffmpeg script to upscale VHS video to 720p and 1080p, and while it's not amazing because it can't invent pixels, it is decent enough for my needs and some client needs. You might want to try that if you are concerned about AI artifacting, or finding a happy middle-ground between the two.
                      Thats cool!!

                      For me personally the artifacting doesn't bother me because the rest of it is a huge improvement, but I also know how bad and grainy the original source material is so maybe my opionion is a little bias...

                      What do you think typical end users would think?

                        Comment

                        • xxxclusive
                          Confirmed User
                          • Oct 2012
                          • 787
                          #7
                          Which AI tool do you use?

                          I also have this topic on the radar, but still wait as the AI tools are developing and better first start to batch convert when the results are better.

                            Comment

                            • 2MuchMark
                              Mark of 2Much.net
                              • Aug 2004
                              • 50911
                              #8
                              Originally posted by xxxclusive
                              Which AI tool do you use?

                              I also have this topic on the radar, but still wait as the AI tools are developing and better first start to batch convert when the results are better.
                              I wrote the tool myself, but the engine is realesrgan-ncnn-vulkan. It works but its really slow, so I'm going to experiment.

                                Comment

                                • fastball
                                  Confirmed User
                                  • Apr 2021
                                  • 6270
                                  #9
                                  Originally posted by 2MuchMark
                                  Thats cool!!

                                  For me personally the artifacting doesn't bother me because the rest of it is a huge improvement, but I also know how bad and grainy the original source material is so maybe my opionion is a little bias...

                                  What do you think typical end users would think?
                                  I think it is rescues the older video. I have a huge back catalogue that suffers from terrible conversions from back in the day and I am waiting for something great to come along. When it is a plug in to adobe premiere, you will know.

                                    Comment

                                    • cerulean
                                      Web & App Development
                                      • Oct 2023
                                      • 229
                                      #10
                                      Originally posted by 2MuchMark
                                      Thats cool!!

                                      For me personally the artifacting doesn't bother me because the rest of it is a huge improvement, but I also know how bad and grainy the original source material is so maybe my opionion is a little bias...

                                      What do you think typical end users would think?
                                      I don't think people would care, honestly.

                                      I do think you might be spending too much time on something Topaz Labs already figured out, though!

                                      I wrote my FFMpeg wrapper in order to do VHS upscale much cheaper than BlackMagic was doing with Teranex. By the time I finished my wrapper and started writing an Electron app for it, Topaz dropped their AI solution and I gave up on making it anything more than a command line app. I have a few clients who bought Topaz when it was $299 for a lifetime license and I really should have jumped on that!
                                      Cerulean Software Specializes in Website and App Development. Email me today!
                                      Get a Custom Landing Page with TapClick.Link - For Small Businesses and Creators
                                      Keep Your Business and Members Area Secure with LoginBlue Password and Content Protection

                                        Comment

                                        • Tubevideditor
                                          Confirmed User
                                          • Sep 2013
                                          • 352
                                          #11
                                          Originally posted by cerulean
                                          I don't think people would care, honestly.

                                          I do think you might be spending too much time on something Topaz Labs already figured out, though!

                                          I wrote my FFMpeg wrapper in order to do VHS upscale much cheaper than BlackMagic was doing with Teranex. By the time I finished my wrapper and started writing an Electron app for it, Topaz dropped their AI solution and I gave up on making it anything more than a command line app. I have a few clients who bought Topaz when it was $299 for a lifetime license and I really should have jumped on that!
                                          Yeah Topaz is prob the only option out there now. Its still a bit clunky, some updates often introduce problems and its doubled in price almost.

                                          You also need a beefy system to run it and even with a 5090 card, be prepared to wait.
                                          Its not optimized for Mac OS very well and even with a current top end Mac Studio (M3 Ultra/M4 Max), its much slower than a PC running a recent Nvidia card.

                                            Comment

                                            • martinwoll
                                              Confirmed User
                                              • Dec 2025
                                              • 79
                                              #12
                                              Oh, look at you all, reinventing the wheel while Topaz Labs is already selling the car. Why not just stick a rocket on that VHS while you're at it?

                                                Comment

                                                Previous template Next
                                                Working...