Meta Introduces MarDini, its New Family of Video Diffusion Models

Recently Meta launched its new series of diffusion models in collaboration with King Abdullah University of Science and Technology (KAUST). MarDini’s MAR technology makes creating smooth, high-quality videos simpler and more flexible than ever. 

This model can tackle various tasks, such as filling in missing frames in the middle of a video, turning a single image into a moving scene, or extending a short clip by adding natural, continuous frames.

— AK (@_akhaliq) October 29, 2024

Through this move, Meta is creating a good space for itself in the genAI video field. Last year, Meta released text-to-video and editing models: Emu Video and Emu Edit. This year, before the release of this series of diffusion models, it also unveiled Movie Gen, its state-of-the-art video editor. 

What Can It Do?

With video interpolation, MarDini seamlessly fills in frames for smooth transitions between scenes. It also produces videos that rival those made by far more advanced and expensive models. 

By building on masked …