DAIN-APP – depth aware video interpolation
DAIN-APP is a windows application that allows the user to interpolate frames and smooth out low-framerate video, but examples also show it working well for tweening in pixel art and stop motion animation. The Dain-App is actually a friendly UI that manages and sends movies to the DAIN (short for Depth-Aware Video Frame Interpolation) backbone that is able to understand the depth of the scene and prioritise those objects that are closer to the viewer.
DAIN-APP is free to download and use, but users are invited to contribute to development on Patreon. Any profits are split 50:50 with the DAIN-APP developer and Wenbo Bao who created the DAIN backend. To see examples, visit the developer’s YouTube page or to download the application, go to Patreon.
Source: Warrior3d
This is wicked. I love the effect, and reminds me of how my Sony TV does something similar, though with more artifacts, but makes cartoons more fluid.
I wonder if the depth map is usable in any way after computation. Like using it to add depth of field, darken the background, etc. I will have to play with this if I ever get time.
You can also do the depth map effect and apply the algorithm after 🙂