AI Video upscaling question
 

Hi Everyone,

I have been experimenting with AI Video upscaling. Please take a look at this screenshot and tell me what you think:

https://i.ibb.co/jZR1JX4R/2much-colo...achers-pet.jpg

The source (top image) is from an ancient .asf file in 522x300 resolution. The bottom is upconverted to 720p. The screenshots are taken a few seconds apart so the model's expression is different.

On the plus side, you can see that the video noise is removed and the image looks clearer. Unfortunately the AI generates a few artifacts of its own.

Do you think its worth up-converting old unplayable .ASF files in 522x300 res up to modern sizes like 720p, HD, 2K and even 4K, even if it introduces AI artifacts? Or do they prefer the noisy originals?

Is someone gonna tell him that his screenshot doesn’t load?

Imgbb.com uploading this content requires registration

your screenshot doesn't load

I've written an ffmpeg script to upscale VHS video to 720p and 1080p, and while it's not amazing because it can't invent pixels, it is decent enough for my needs and some client needs. You might want to try that if you are concerned about AI artifacting, or finding a happy middle-ground between the two.

oops! lets try that again.

https://2much.net/gfy/2much-colossus...chers-pet.webp

Thats cool!!

For me personally the artifacting doesn't bother me because the rest of it is a huge improvement, but I also know how bad and grainy the original source material is so maybe my opionion is a little bias...

What do you think typical end users would think?

Which AI tool do you use?

I also have this topic on the radar, but still wait as the AI tools are developing and better first start to batch convert when the results are better.

I wrote the tool myself, but the engine is realesrgan-ncnn-vulkan. It works but its really slow, so I'm going to experiment.

I think it is rescues the older video. I have a huge back catalogue that suffers from terrible conversions from back in the day and I am waiting for something great to come along. When it is a plug in to adobe premiere, you will know.

I don't think people would care, honestly.

I do think you might be spending too much time on something Topaz Labs already figured out, though!

I wrote my FFMpeg wrapper in order to do VHS upscale much cheaper than BlackMagic was doing with Teranex. By the time I finished my wrapper and started writing an Electron app for it, Topaz dropped their AI solution and I gave up on making it anything more than a command line app. I have a few clients who bought Topaz when it was $299 for a lifetime license and I really should have jumped on that!