Sample Frame Cleansing - jhogsett/EMA-VFI-WebUI GitHub Wiki

Frame Cleansing and Image Stabilization through Video Frame Interpolation

30 seconds of heavily soiled, massively reduplicated and badly mishandled 8mm film from the 1970s

https://www.youtube.com/shorts/lKtY2CHqA98 (YouTube)

What To See

• TOP - Original Frames have lots of dust from years of mishandling and a very shaky picture from the duplication process
• BOTTOM - Cleansed Frames are much cleaner and image-stabilized after using Resynthesize Video

Resynthesis is the process of creating all new frames from a video by using Video Frame Interpolation to reconstruct them from adjacent images. For example, given three frames, to create frame #2, the content of frames #1 and #3 are fed to the VFI engine, which creates a likely middle frame. Then the same process is repeated for all frames.

Why this works:

• VFI ignores small features that don't exist in both frames
• The video appears more stable because the VFI process dampens the positional noise present in the discarded original frame (handheld camera and reduplication shakiness)