Movie Gen
A sentence in, a 16-second film with its own score out
Latest: Movie Gen (Oct 2024); succeeded by Muse Video (2026 preview)
Meta's media-foundation research suite (October 2024): a 30B-parameter video model generating up to 16 seconds of 1080p footage at 16 fps, a 13B synchronized-audio model, personalized video from a single reference photo, and precise text-driven video editing. Published with detailed research and the Movie Gen Bench evaluation suite, but weights stayed closed.
Why it matters
A 30B video model producing 16 seconds of 1080p footage, a 13B synchronized-audio model, personalization from one photo and text-driven editing, published with a detailed paper and the Movie Gen Bench prompts. Weights stayed closed, but it set the bar for Meta's Muse Video and for open evaluation of video generators.
Facts
- Type a sentence, get a 16-second HD film with its own synchronized orchestral score — from one system.
- The personalization feature could cast you as the star of a generated clip from one photo.
- Meta said at announcement it was planned for Instagram in 2025 — the consumer path ultimately arrived via the Vibes feed and Edits app instead.
- A 92-page report with 88 credited authors; trained on the order of 100 million videos and 1 billion images using up to 6,144 H100 GPUs.
- Its personalization mode makes a video starring you from one reference photo.
Try it yourself
Official Movie Gen research page ↗ Movie Gen Video Bench on Hugging Face ↗ Read the paper ↗
Lineage
Sources
arXiv ↗Meta AI blog ↗Meta AI research ↗Meta AI ↗