Video Generation

Text2Video-Zero, from Picsart AI Research, turns a text-to-image diffusion model into a zero-shot video generator with no video training data at all. This write-up explains the method, the motion dynamics and cross-frame attention that keep a generated sequence coherent, and reports what the model produced when run, including where the results break down.