How to Create Interpolation Videos with Stable Diffusion and Deform
Generative AI
Introduction
Everywhere you look, you see images generated by algorithms such as Stable Diffusion and Midjourney. Video, however, is a far more challenging prospect.
I work with a media production company, and AI videos have a long way to go before they become widely used within the industry. The quality is not there yet, by a mile.
Challenges
There are several challenges, such as flickering between frames, resolution, and computation, to name a few.
I should also mention the ongoing debate about copyright issues for algorithms trained on content from the internet. It's clear that the current approach is too liberal. I'll follow this development with great interest.
Current use-cases
However, media production is all about creating engaging and unique content, and AI can certainly be a component of that already.
One use case is to add a different style to an original video, as they did in the crow, where they first recorded a dancer and then had an algorithm adjust each frame.
We will see progress on that topic constantly going forward, but in this post, I'll show you a simple approach to get you started. We will create a short video by transforming images through interpolation using DeForum.
Let's get started!
