Difference between revisions of "AI video"

Latest revision as of 11:31, 28 July 2025

Evolution of Capabilities

Early

November 2016: Sync-Draw
April 2021: GODIVA
October 2022: Meta Make-a-video
October 2022: Google Imagen video

2023

April 2023: Will Smith eating spaghetti
April 2023: Runway Gen 2
April 2023: Nvidia latents
December 2023: Fei-Fei Li

2024

Early 2024

January 2024: Google VideoPoet
January 2024: Google Lumiere
February 2024: OpenAI Sora
April 2024: Vidu
May 2024: Veo
May 2024: Kling
June 2024: Luma DreamMachine
June 2024: RunwayML Gen-3 Alpha
July 2024: Examples:
- Toys-R-Us Commercial made using Sora
- Motorola commercial made using genAI
July 2024: haiper.ai

August 2024

August 2024: Hotshot (examples, more examples)
August 2024: Luma Dream Machine v1.5
August 2024: Examples:
- Runway Gen3 music video
- Runway Gen3 for adding FX to live action (another example)
- Midjourney + Runway Gen3: Hey It’s Snowing
- Flux/LoRA image + Runway Gen3 woman presenter
- McDonald’s AI commercial
- Sora used by Izanami AI Art to create dreamlike video and by Alexia Adana to create sci-fi film concept

September 2024

September 2024: Hailuo Minimax (examples)
September 2024: Examples:
- Space colonization
- Consistent characters
- Sea monsters
- Music video
- Animated characters
- AI influencer
- Ten short examples
- Seven examples
- Clip from horror film
- "Gone" featuring astronaut and something ethereal
- Two dancers (surprisingly good consistency despite movement)
- Music video about flying
- The Paperclip Maximizer
- La Baie Aréa
- "To Dear Me" by Gisele Tong (winner of AI shorts film festival)
- Various scenes
- Directing emotions
September 2024: Kling 1.5 (examples, showing emotions)
September 2024: Examples:
- Runway video-to-video to restyle classic video games
- Realistic presenter
- Skateboarding (demonstrates getting closer to meaningfully simulating motion/physics)
- Examples of short clips with cinematic feel
- Short: 4 Minutes to Live
- Short: Neon Nights (Arcade)
- Random Access Memories: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage
- Sora used to make a sort of weird dreamlike video

October 2024

October 2024: Pika v1.5, including Pikaffects (explode, melt, inflate, and cake-ify; examples: 1, 2, 3, 4, 5, 6)
October 2024: Examples:
- AI avatar with good lip-sync
- Battalion: 5 minute short about war
- Short film: To Wonderland (credits)
- 9 to 5: Created with Luma Dream Machine keyframes and camera features; music by Suno
October 2024: Meta Movie Gen
October 2024: Examples:
- AI Avatar (using HeyGen)
- Generic Movies
- Pyramid-flow (open source) model: examples
- Building the Pyramids
- People showing realistic emotion (using Hailuo AI)
- Keyframes and Luma AI to make novel speed-ramp motion
October 2024: Pollo AI platform offers selection among a diversity of video models
October 2024: Genmo Mochi 1 (open source)
October 2024: Examples:
- Meta Movie Gen examples
- Emotional range of Minimax
- Car commercial: Bear
- Diner conversation
- Loved and Lost (a meditation on grief)

November 2024

November 2024: Examples:
- Pasta Doble
- Bird protecting young
- Camera moving around sushi
- Various examples of Hailuo AI
- Trains
- Light of Imagination
- Bringing historic images to life
- Plants dancing
- Insect on tree
- Trailers for The Silmarillion and The Fall of Gondolin (by Abandoned Films)
- Moody sci-fi
- Migration (made by combining Runway ML Gen3-Alpha and traditional animation)
- After the Winter (music made using Suno v4)
- Horror: Ridge to Southwest
- The Gardener (by Machine Mythos)
- Coca-Cola holiday ad and parody thereof
- A Dream Within A Dream (by PZF, selected for the Czech International AI Film Festival)
- Making Friends (by Everett World; see also Childhood Dream and City Echoes)
- Anime: test shots, Ultimate Ceremony, Echoes of Love
- Echoes of Grace (KakuDrop using Sora)
- Morphing hands, hands and faces (Vibeke Bertelsen)
- Dragon Ball Z live action
- Pitch Black (abstract and dark)
- Animals Running (zoomed-in ultra-wide camera)
- Dreams of Tomorrow (panning shots of high-tech car, Scottish manor)
- Desert Planet Cinematics
November 2024: Leaked Sora turbo model; examples, Dog chasing Cat in snow

December 2024

December 2024: Examples:
- Realistic (Minimax by Hailuo AI)
- Trailer for Paradise Lost (to be released on Sandwatch AI)
- Music video example with consistent characters
- Human expressions (u/Kind_Distance9504 on Reddit, using Hailuo)
- Vodafone ad: The Rhythm Of Life
- 10 minute Batman film
December 2024: Tencent Hunyuan Video open-source video model (example)
December 2024: Sora release (examples)
December 2024: MinT video improves consistency and control (preprint, examples)
December 2024: Google Veo 2 (examples, more examples, natural movement examples, abstract, realistic physics, crowds, dancing, animals)
December 2024: Pika 2.0 with Scene Ingredients
December 2024: Examples:
- Synthetic Youth: Takenoko Zoku · Made by Emi Kusano with Sora
- Car race (Higgsfield AI storytelling)
- Slicing meat; comparison of modern video generators
- Challenging prompt: A cat roars while looking at its reflection in the mirror but instead sees itself as a lion roaring (Veo 2) (comparison to other models)
- Anime trailer
- Snorlax at Mount Fuji and Psyduck at Colosseum (Kling 1.6)
- Horror visuals (with MMAudio sound)
- The Heist (Veo 2)
- Various Veo 2 examples
- Live Action Titans
- Cats Cooking
- Aesthetic from alternate timelines: 1, 2, 3
- Examples approaching cinematic quality
- Cosmic Spider (winner at AI film festival)
- Trailer for Newton's Cradle (full film on 2025-01-01)
- Car vs. Jet drag race
- California Monsters
- Various examples (Hailuo AI)
- Will Smith eating spaghetti (c.f. April 2023)
- Sorceress and Arachnid Steed (Kling v1.6)
- Music video (Hailuo AI)
- Akụkọ (Story) (22 minute short) - A Lagos Boy's Thrilling Snack Run Nightmare
- Son of the Dragon (8 minute short)
- Endless Journey music video (music by Suno)
- Once Again (retrospective)
- Fade Out (Veo 2)
- Roadkill (12 minute short)

2025

January 2025

January 2025: Progress over the last 1.5 years, by comparing Runway Gen 2 and Veo 2.
January 2025: Examples:
- Delivery (unofficial Nike ad)
- Gucci ad (Sora)
- Conquest
- Newton's Cradle (6 minute short)
- Singer
- Brain vomit (music video)
- Vibe (Kling v1.6)
- Will Smith eating spaghetti (c.f. April 2023, December 2024)
- Zorgop Knows All (2 minute short)
- The Breach (2 minute short; Veo2, Runway ActOne, MMaudio)
- Aesthetics from an alternate timeline
- Immortal Awakens
- The Faded Line
- Dear Dad
- Mad Max chase
- Patience is Key
- The Almost Famous Show (talent show parody)
- Proof-of-concept trailer for a medieval adult animated series
- Variety (unofficial Cadbury ad)
- Kitsune (5 minute animated short, Veo 2)
January 2025: MiniMax Hailuo Subject Reference enables consistent characters (examples)
January 2025: AI (de-aging deepfakes, Magnific) used in the film "Here".
January 2025: Luma Ray2
January 2025: Pika 2.1 (examples)
January 2025: Examples:
- Light projections onto people (challenging task, Ray2)
- BMW ad
- John Wick in Severance (Hunyuan vid2vid)
- Biopic (7 minutes)
- Give It To Me (music video)
- Where do we go from here? (music video, Veo 2)
- Party like there's no tomorrow (music video)
- S.T.O.R.I. (Midjourney and Pika 2.1)

February 2025

February 2025: Examples:
- Long Steampunk scene
- City destruction
- Consistent character acting
- Kaiju Katastrophe (by Mean Orange Cat)
- The Greyhound
- Fluid simulation video2video
- High resolution macro shots
- Chrysalids
- Boring realistic images (HunyuanVideo w/ LoRA)
- Anime intro (Hunyuan w/ custom LoRAs)
- Automotive ad test (Kling w/ custom model)
- Random cinematic clips (Midjourney and Kling)
- Crossing Paths
- Miniature food
- Animals
- Star Wars - The Ghost's Apprentice (Fan Film)
- Ray2 image-to-video examples
- New Horizons (miniatures going to Mars)
- Black Sun (trailer)
- AI avatars (Argil AI)
- Adding elements to real video (other example)
- Glitch
- Anime: sci-fi (Ray2), sci-fi (Ray 2), 90s sci-fi (Luma) and moody (Midjourney and Ray2)
February 2025: Meta VideoJAM
February 2025: ByteDance OmniHuman-1
February 2025: ByteDance Goku (paper, examples)
February 2025: Step-Video-T2V open-source model (paper, code, demo, examples)
February 2025: Pika Pikaswaps (examples of modifying regions, swapping items)
February 2025: Alibaba Wan 2.1 open-source (examples)
February 2025: Twin AI: compose videos with provided character, object, location (example)
February 2025: Examples:
- Infected (Pika swaps and additions)
- Hostile Government Takeover (Veo2)
- Dual Mechanism (Pikaframes 2.2)

March 2025

March 2025: Examples:
- Doors (music video)
- Drum and Bass (music video; Kling, audio from Riffusion)
- Woman's face (Sora)
- Skating (Ray2)
- Filming commercial on Mars
- Original Source commercial (AI and real footage)
- Time-lapses (Pika 2.2)
- Hallucination
- Macro video of bubbles
March 2025: HunyuanVideo-I2V image-to-video
March 2025: Google Whisk Animate (based on Veo2, examples)
March 2025: Examples:
- Recursion (horror) (Kling)
- Will Smith Eating Spaghetti while Sitting Inside a Bag (c.f. April 2023, December 2024, January 2025)
- Paper Jam (Kling with custom workflows to enable precise control)
- Cinematic shots (Google Whisk and Luma)
- Perfunctory Horizons
- A Hard Winter
- Consistent character example
- Anthropomorphic Animals
- Realistic (influencer-style)
- I Feel Cultured (music video with surrealist vibes)
- journey of utmost importance
- Karen: Unleashed
- Yarn Cat
- Ned's Wet Deli (Runway)
- BOOTS, a.k.a. "Our enemies are cartoon monsters" (music video based on poem by Rudyard Kipling; Veo2)
- Flying in a dream: 1, 2
- Commercial for Mercedes-Benz and FYI Radio
- Selfie video (Luma)
- Podcasts: Rottenly Roasted and Worst Date Ever (Imagen 3, Hedra, Elevenlabs, Topaz)
- Ambience (Midjourney, Luma)
- The Bridge (2 minute short; Veo2)
- Pulp Fiction (Wan video editing)
- Camera Controls (Luma Ray2)
March 2025: Hedra Character 3
March 2025: Open Sora v2 (code)
March 2025: Amazon Prime debuts House of David, with special effects created by Wonder Project using a combination of traditional and AI methods (reportedly including Midjourney and Runway)
March 2025: Examples:
- What if Studio Ghibli directed Lord of the Rings? (OpenAI GPT-4o in-context image generation, Kling)
- RŌHKI
- Why
- Commercial for Puma (research/test)
- Commercial for KFC (concept ad)
March 2025: Runway ML Gen-4
- The Lonely Little Flame
- The Herd
- The Retrieval
- NYC is a Zoo
- Scimmia Vede (music video)
- More examples: various, art direction, mannequins, taxi, small things, long shot (1m)

April 2025

April 2025: Examples:
- Age of Beyond
- Commercial for Coca-Cola (Higgsfield)
- Anime scene (3m) (Wan 2.1 with LoRa)
- Taxes then Death (Pika multikeyframe)
April 2025: Krea Video Re-Style
April 2025: ByteDance DreamActor-M1 performance transfer
April 2025: Examples:
- Mercs (Midjourney v7, Ray2)
- Cat at theme park
- Timelapse history (Runway Gen4)
- Examples for use in advertising
- Sci-fi scapes
- Avα
- The Bureau
- Beaver and Sock (3m)
- Organic Waste (5m) (Runway)
- Fly (Runway Gen4)
April 2025: Alibaba FantasyTalking lipsync (paper, examples)
April 2025: Tencent Hunyuan Sonic image animation/lipsync to audio (examples)
April 2025: ByteDance Seaweed-7B (preprint, examples)
April 2025: Kling 2.0 (video)
April 2025: Skyworks SkyReels V2 (open-source, unlimited extension; examples)
April 2025: Sand AI Magi-1 (open source, unlimited extension; examples, more examples)
April 2025: Examples:
- Mars 2035 (3m) (Kling 2.0)
- Kingdom (dragon battle, 3m)
- Reflection (3m) (Gen4)
- Pizza Galaxy (1m) (MJ and Gen4)
- Snoop Dogg music video: Last Dance with Mary Jane (blend of traditional and AI effects)
- Realistic human motion
- Inception loop (Gen4)
- Tuesday (1m) (Gen4)
- Deus in Machina Automata (4m) (Gen4)
- Outsiders (3m music video)

@@ Line 400: / Line 400: @@
 ** [https://x.com/Kavanthekid/status/1947696716981145971 Perfect Dark - Concept Trailer (1.5m)]
 ** [https://x.com/StelfieTT/status/1948753090858885131 Exodus (2m trailer)]
+** [https://x.com/Jett_Collective/status/1949140450553540841 A Walk Together - Life and love in motion (1m, Midjourney Video)]
 * July 2025: Netflix sci-fi show [https://en.wikipedia.org/wiki/The_Eternaut_(TV_series) The Eternaut] [https://x.com/omooretweets/status/1946290797399400662 used genAI] for a particular scene (building collapse)
-* July 2025: Google Veo [https://x.com/GoogleLabs/status/1948477692715700718 emergent annotation direction] ([https://x.com/venturetwins/status/1948771505783144641 example], [https://x.com/bilawalsidhu/status/1948844167603310660 example])
+* July 2025: Google Veo [https://x.com/GoogleLabs/status/1948477692715700718 emergent annotation direction] ([https://x.com/venturetwins/status/1948771505783144641 example], [https://x.com/bilawalsidhu/status/1948844167603310660 example], [https://x.com/jboogx_creative/status/1949230927504371765 example], [https://x.com/Ror_Fly/status/1949606017739747625 example])
-* July 2025: Runway [https://runwayml.com/research/introducing-runway-aleph Aleph] contextual editing.
+* July 2025: Runway [https://runwayml.com/research/introducing-runway-aleph Aleph] contextual editing
+* July 2025: Wan 2.2 (open source, [https://x.com/Alibaba_Wan/status/1949804551655276989 examples])

Difference between revisions of "AI video"

Latest revision as of 11:31, 28 July 2025

Contents

Evolution of Capabilities

Early

2023

2024

Early 2024

August 2024

September 2024

October 2024

November 2024

December 2024

2025

January 2025

February 2025

March 2025

April 2025

May 2025

June 2025

July 2025

Navigation menu

Personal tools

Namespaces

Variants

Views

More

Search

Navigation

Tools