Emu Video & Emu Edit
Two Emu offshoots: 4-second clips and edit-by-instruction — demos only
Latest: Emu Video / Emu Edit (Nov 2023)
Twin research models announced November 2023. Emu Video generates 4-second 512px videos by factorizing text-to-video into image generation then image-conditioned video generation, winning head-to-head human evals against contemporaries. Emu Edit performs precise instruction-based image editing via multi-task training on 10 million samples. Demos only; weights never released.
Why it matters
Emu Video's factorized recipe (generate an image, then animate it) won head-to-head human evaluations against contemporaries, and Emu Edit showed instruction-based editing could be precise when trained as multi-task recognition plus generation on 10 million samples. Both fed directly into the production image and video features Meta shipped next.
Facts
- In human evaluations Meta reported Emu Video was preferred over Runway Gen-2 and Pika at the time; Emu Edit's trick was recognizing the edit task type from the instruction itself.
Try it yourself
Emu Video demo site ↗ Emu Edit showcase site ↗ Read the Emu Video paper ↗