AI video

Evolution of Capabilities

• Nov 2016: Sync-Draw
• April 2021: GODIVA
• Oct 2022: Meta Make-a-video
• Oct 2022: Google Imagen video
• April 2023: Will Smith eating spaghetti
• April 2023: Runway Gen 2
• April 2023: Nvidia latents
• December 2023: Fei-Fei Li
• January 2024: Google VideoPoet
• January 2024: Google Lumiere
• February 2024: OpenAI Sora
• April 2024: Vidu
• May 2024: Veo
• May 2024: Kling
• June 2024: Luma DreamMachine
• June 2024: RunwayML Gen-3 Alpha
• July 2024: Examples:
  • Toys-R-Us Commercial made using Sora
  • Motorola commercial made using genAI
• July 2024: haiper.ai
• August 2024: Hotshot (examples, more examples)
• August 2024: Luma Dream Machine v1.5
• August 2024: Examples:
  • Runway Gen3 music video
  • Runway Gen3 for adding FX to live action (another example)
  • Midjourney + Runway Gen3: Hey It’s Snowing
  • Flux/LoRA image + Runway Gen3 woman presenter
  • McDonald’s AI commercial
  • Sora used by Izanami AI Art to create dreamlike video and by Alexia Adana to create sci-fi film concept
• September 2024: Hailuo Minimax (examples)
• September 2024: Examples:
  • Space colonization
  • Consistent characters
  • Sea monsters
  • Music video
  • Animated characters
  • AI influencer
  • Ten short examples
  • Seven examples
  • Clip from horror film
  • "Gone" featuring astronaut and something ethereal
  • Two dancers (surprisingly good consistency despite movement)
  • Music video about flying
  • The Paperclip Maximizer
  • La Baie Aréa
  • "To Dear Me" by Gisele Tong (winner of AI shorts film festival)
  • Various scenes
  • Directing emotions
• September 2024: Kling 1.5 (examples, showing emotions)
• September 2024: Examples:
  • Runway video-to-video to restyle classic video games
  • Realistic presenter
  • Skateboarding (demonstrates getting closer to meaningfully simulating motion/physics)
  • Examples of short clips with cinematic feel
  • Short: 4 Minutes to Live
  • Short: Neon Nights (Arcade)
  • Random Access Memories: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage