AI video

Evolution of Capabilities

Early

• November 2016: Sync-Draw
• April 2021: GODIVA
• October 2022: Meta Make-a-video
• October 2022: Google Imagen video

2023

• April 2023: Will Smith eating spaghetti
• April 2023: Runway Gen 2
• April 2023: Nvidia latents
• December 2023: Fei-Fei Li

2024

• January 2024: Google VideoPoet
• January 2024: Google Lumiere
• February 2024: OpenAI Sora
• April 2024: Vidu
• May 2024: Veo
• May 2024: Kling
• June 2024: Luma DreamMachine
• June 2024: RunwayML Gen-3 Alpha
• July 2024: Examples:
  • Toys-R-Us Commercial made using Sora
  • Motorola commercial made using genAI
• July 2024: haiper.ai
• August 2024: Hotshot (examples, more examples)
• August 2024: Luma Dream Machine v1.5
• August 2024: Examples:
  • Runway Gen3 music video
  • Runway Gen3 for adding FX to live action (another example)
  • Midjourney + Runway Gen3: Hey It’s Snowing
  • Flux/LoRA image + Runway Gen3 woman presenter
  • McDonald’s AI commercial
  • Sora used by Izanami AI Art to create dreamlike video and by Alexia Adana to create sci-fi film concept
• September 2024: Hailuo Minimax (examples)
• September 2024: Examples:
  • Space colonization
  • Consistent characters
  • Sea monsters
  • Music video
  • Animated characters
  • AI influencer
  • Ten short examples
  • Seven examples
  • Clip from horror film
  • "Gone" featuring astronaut and something ethereal
  • Two dancers (surprisingly good consistency despite movement)
  • Music video about flying
  • The Paperclip Maximizer
  • La Baie Aréa
  • "To Dear Me" by Gisele Tong (winner of AI shorts film festival)
  • Various scenes
  • Directing emotions
• September 2024: Kling 1.5 (examples, showing emotions)
• September 2024: Examples:
  • Runway video-to-video to restyle classic video games
  • Realistic presenter
  • Skateboarding (demonstrates getting closer to meaningfully simulating motion/physics)
  • Examples of short clips with cinematic feel
  • Short: 4 Minutes to Live
  • Short: Neon Nights (Arcade)
  • Random Access Memories: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage
  • Sora used to make a sort of weird dreamlike video
• October 2024: Pika v1.5, including Pikaffects (explode, melt, inflate, and cake-ify; examples: 1, 2, 3, 4, 5, 6)
• October 2024: Examples:
  • AI avatar with good lip-sync
  • Battalion: 5 minute short about war
  • Short film: To Wonderland (credits)
  • 9 to 5: Created with Luma Dream Machine keyframes and camera features; music by Suno
• October 2024: Meta Movie Gen
• October 2024: Examples:
  • AI Avatar (using HeyGen)
  • Generic Movies
  • Pyramid-flow (open source) model: examples
  • Building the Pyramids
  • People showing realistic emotion (using Hailuo AI)
  • Keyframes and Luma AI to make novel speed-ramp motion
• October 2024: Genmo Mochi 1 (open source)
• October 2024: Examples:
  • Meta Movie Gen examples
  • Emotional range of Minimax
  • Car commercial: Bear
  • Diner conversation
  • Loved and Lost (a meditation on grief)
• November 2024: Examples:
  • Pasta Doble
  • Bird protecting young
  • Camera moving around sushi
  • Various examples of Hailuo AI
  • Trains
  • Light of Imagination
  • Bringing historic images to life
  • Plants dancing
  • Insect on tree
  • Trailers for The Silmarillion and The Fall of Gondolin (by Abandoned Films)
  • Moody sci-fi
  • Migration (made by combining Runway ML Gen3-Alpha and traditional animation)
  • After the Winter (music made using Suno v4)
  • Horror: Ridge to Southwest
  • The Gardener (by Machine Mythos)
  • Coca-Cola holiday ad and parody thereof
  • A Dream Within A Dream (by PZF, selected for the Czech International AI Film Festival)
  • Making Friends (by Everett World; see also Childhood Dream and City Echoes)
  • Anime: test shots, Ultimate Ceremony, Echoes of Love
  • Echoes of Grace (KakuDrop using Sora)
  • Morphing hands, hands and faces (Vibeke Bertelsen)
  • Dragon Ball Z live action
  • Pitch Black (abstract and dark)
  • Animals Running (zoomed-in ultra-wide camera)
  • Dreams of Tomorrow (panning shots of high-tech car, Scottish manor)
  • Desert Planet Cinematics
• November 2024: Leaked Sora turbo model; examples, Dog chasing Cat in snow
• December 2024: Examples:
  • Realistic (Minimax by Hailuo AI)
  • Trailer for Paradise Lost (to be released on Sandwatch AI)
  • Music video example with consistent characters
  • Human expressions (u/Kind_Distance9504 on Reddit, using Hailuo)
  • Vodafone ad: The Rhythm Of Life
  • 10 minute Batman film
• December 2024: Tencent Hunyuan Video open-source video model (example)
• December 2024: Sora release (examples)
• December 2024: MinT video improves consistency and control (preprint, examples)
• December 2024: Google Veo 2 (examples, more examples, natural movement examples, abstract, realistic physics, crowds, dancing, animals)
• December 2024: Pika 2.0 with Scene Ingredients
• December 2024: Examples:
  • Synthetic Youth: Takenoko Zoku · Made by Emi Kusano with Sora
  • Car race (Higgsfield AI storytelling)
  • Slicing meat; comparison of modern video generators
  • Challenging prompt: A cat roars while looking at its reflection in the mirror but instead sees itself as a lion roaring (Veo 2) (comparison to other models)
  • Anime trailer
  • Snorlax at Mount Fuji and Psyduck at Colosseum (Kling 1.6)
  • Horror visuals (with MMAudio sound)
  • The Heist (Veo 2)
  • Various Veo 2 examples
  • Live Action Titans
  • Cats Cooking
  • Aesthetic from alternate timelines: 1, 2, 3
  • Examples approaching cinematic quality
  • Cosmic Spider (winner at AI film festival)
  • Trailer for Newton's Cradle (full film on 2025-01-01)
  • Car vs. Jet drag race
  • California Monsters
  • Various examples (Hailuo AI)
  • Will Smith eating spaghetti (c.f. April 2023)
  • Sorceress and Arachnid Steed (Kling v1.6)
  • Music video (Hailuo AI)
  • Akụkọ (Story) (22 minute short) - A Lagos Boy's Thrilling Snack Run Nightmare
  • Son of the Dragon (8 minute short)
  • Endless Journey music video (music by Suno)
  • Once Again (retrospective)
  • Fade Out (Veo 2)
  • Roadkill (12 minute short)

2025

January

• January 2025: Progress over the last 1.5 years, by comparing Runway Gen 2 and Veo 2.
• January 2025: Examples:
  • Delivery (unofficial Nike ad)
  • Gucci ad (Sora)
  • Conquest
  • Newton's Cradle (6 minute short)
  • Singer
  • Brain vomit (music video)
  • Vibe (Kling v1.6)
  • Will Smith eating spaghetti (c.f. April 2023, December 2024)
  • Zorgop Knows All (2 minute short)
  • The Breach (2 minute short; Veo2, Runway ActOne, MMaudio)
  • Aesthetics from an alternate timeline
  • Immortal Awakens
  • The Faded Line
  • Dear Dad
  • Mad Max chase
  • Patience is Key
  • The Almost Famous Show (talent show parody)
  • Proof-of-concept trailer for a medieval adult animated series
  • Variety (unofficial Cadbury ad)
  • Kitsune (5 minute animated short, Veo 2)
• January 2025: MiniMax Hailuo Subject Reference enables consistent characters (examples)
• January 2025: AI (de-aging deepfakes, Magnific) used in the film "Here".
• January 2025: Luma Ray2
• January 2025: Pika 2.1 (examples)
• January 2025: Examples:
  • Light projections onto people (challenging task, Ray2)
  • BMW ad
  • John Wick in Severance (Hunyuan vid2vid)
  • Biopic (7 minutes)
  • Give It To Me (music video)
  • Where do we go from here? (music video, Veo 2)
  • Party like there's no tomorrow (music video)
  • S.T.O.R.I. (Midjourney and Pika 2.1)

February

• February 2025: Examples:
  • Long Steampunk scene
  • City destruction
  • Consistent character acting
  • Kaiju Katastrophe (by Mean Orange Cat)
  • The Greyhound
  • Fluid simulation video2video
  • High resolution macro shots
  • Chrysalids
  • Boring realistic images (HunyuanVideo w/ LoRA)
  • Anime intro (Hunyuan w/ custom LoRAs)
  • Automotive ad test (Kling w/ custom model)
  • Random cinematic clips (Midjourney and Kling)
  • Crossing Paths
  • Miniature food
• February 2025: Meta VideoJAM
• February 2025: ByteDance OmniHuman-1
• February 2025: ByteDance Goku (paper, examples)