Difference between revisions of "AI video"
KevinYager (talk | contribs) (→Evolution of Capabilities) |
KevinYager (talk | contribs) (→March 2025) |
||
(182 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
==Evolution of Capabilities== | ==Evolution of Capabilities== | ||
− | * | + | ===Early=== |
+ | * November 2016: [https://arxiv.org/abs/1611.10314 Sync-Draw] | ||
* April 2021: [https://arxiv.org/abs/2104.14806 GODIVA] | * April 2021: [https://arxiv.org/abs/2104.14806 GODIVA] | ||
− | * | + | * October 2022: [https://makeavideo.studio/ Meta Make-a-video] |
− | * | + | * October 2022: [https://imagen.research.google/video/ Google Imagen video] |
+ | |||
+ | ===2023=== | ||
* April 2023: [https://www.youtube.com/watch?v=XQr4Xklqzw8 Will Smith eating spaghetti] | * April 2023: [https://www.youtube.com/watch?v=XQr4Xklqzw8 Will Smith eating spaghetti] | ||
* April 2023: [https://x.com/mrjonfinger/status/1645953033636048896?cxt=HHwWgMDT7YfkzNctAAAA Runway Gen 2] | * April 2023: [https://x.com/mrjonfinger/status/1645953033636048896?cxt=HHwWgMDT7YfkzNctAAAA Runway Gen 2] | ||
* April 2023: [https://research.nvidia.com/labs/toronto-ai/VideoLDM/ Nvidia latents] | * April 2023: [https://research.nvidia.com/labs/toronto-ai/VideoLDM/ Nvidia latents] | ||
* December 2023: [https://www.threads.net/@luokai/post/C0vvEnTP4Oj Fei-Fei Li] | * December 2023: [https://www.threads.net/@luokai/post/C0vvEnTP4Oj Fei-Fei Li] | ||
+ | ===2024=== | ||
+ | ====Early 2024==== | ||
* January 2024: [https://sites.research.google/videopoet/ Google VideoPoet] | * January 2024: [https://sites.research.google/videopoet/ Google VideoPoet] | ||
* January 2024: [https://lumiere-video.github.io/ Google Lumiere] | * January 2024: [https://lumiere-video.github.io/ Google Lumiere] | ||
Line 20: | Line 25: | ||
** [https://www.youtube.com/watch?v=CSfw_NjqQ2o Motorola commercial made using genAI] | ** [https://www.youtube.com/watch?v=CSfw_NjqQ2o Motorola commercial made using genAI] | ||
* July 2024: [https://x.com/rowancheung/status/1813258518159585723 haiper.ai] | * July 2024: [https://x.com/rowancheung/status/1813258518159585723 haiper.ai] | ||
+ | ====August 2024==== | ||
* August 2024: [http://hotshot.co/ Hotshot] ([https://x.com/maxescu/status/1825459083635536081 examples], [https://x.com/EccentrismArt/status/1825550841534972027 more examples]) | * August 2024: [http://hotshot.co/ Hotshot] ([https://x.com/maxescu/status/1825459083635536081 examples], [https://x.com/EccentrismArt/status/1825550841534972027 more examples]) | ||
* August 2024: Luma Dream Machine [https://x.com/LumaLabsAI/status/1825639918539817101 v1.5] | * August 2024: Luma Dream Machine [https://x.com/LumaLabsAI/status/1825639918539817101 v1.5] | ||
Line 29: | Line 35: | ||
** [https://x.com/CharaspowerAI/status/1825274421256356106 McDonald’s AI commercial] | ** [https://x.com/CharaspowerAI/status/1825274421256356106 McDonald’s AI commercial] | ||
** Sora used by [https://www.facebook.com/izanamiaiart/ Izanami AI Art] to create [https://x.com/kimmonismus/status/1824102316229759114 dreamlike video] and by [https://x.com/alexiaadana Alexia Adana] to create [https://x.com/basedjensen/status/1824386717123743940 sci-fi film concept] | ** Sora used by [https://www.facebook.com/izanamiaiart/ Izanami AI Art] to create [https://x.com/kimmonismus/status/1824102316229759114 dreamlike video] and by [https://x.com/alexiaadana Alexia Adana] to create [https://x.com/basedjensen/status/1824386717123743940 sci-fi film concept] | ||
+ | ====September 2024==== | ||
* September 2024: [https://hailuoai.com/video/ Hailuo Minimax] ([https://x.com/minchoi/status/1829995683124035766 examples]) | * September 2024: [https://hailuoai.com/video/ Hailuo Minimax] ([https://x.com/minchoi/status/1829995683124035766 examples]) | ||
* September 2024: Examples: | * September 2024: Examples: | ||
Line 58: | Line 65: | ||
** [https://www.youtube.com/watch?v=CcrGSA-kSrI Random Access Memories]: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage | ** [https://www.youtube.com/watch?v=CcrGSA-kSrI Random Access Memories]: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage | ||
** Sora used to make a sort of [https://x.com/niceaunties/status/1837271244774715505 weird dreamlike video] | ** Sora used to make a sort of [https://x.com/niceaunties/status/1837271244774715505 weird dreamlike video] | ||
+ | ====October 2024==== | ||
* October 2024: Pika v1.5, including Pikaffects (explode, melt, inflate, and cake-ify; examples: [https://x.com/justin_hart/status/1841144350572413259 1], [https://x.com/arthur_hyper88/status/1841156544538521646 2], [https://x.com/ytjessie_/status/1841168925301842263 3], [https://x.com/bilawalsidhu/status/1841195247184781420 4], [https://x.com/minchoi/status/1841189035454447636 5], [https://x.com/ytjessie_/status/1841209415514669501 6]) | * October 2024: Pika v1.5, including Pikaffects (explode, melt, inflate, and cake-ify; examples: [https://x.com/justin_hart/status/1841144350572413259 1], [https://x.com/arthur_hyper88/status/1841156544538521646 2], [https://x.com/ytjessie_/status/1841168925301842263 3], [https://x.com/bilawalsidhu/status/1841195247184781420 4], [https://x.com/minchoi/status/1841189035454447636 5], [https://x.com/ytjessie_/status/1841209415514669501 6]) | ||
* October 2024: Examples: | * October 2024: Examples: | ||
Line 72: | Line 80: | ||
** [https://x.com/maxescu/status/1844716998854349217 People showing realistic emotion] (using [https://hailuoai.video/ Hailuo AI]) | ** [https://x.com/maxescu/status/1844716998854349217 People showing realistic emotion] (using [https://hailuoai.video/ Hailuo AI]) | ||
** Keyframes and Luma AI to make novel [https://x.com/CoffeeVectors/status/1845188179332051005 speed-ramp motion] | ** Keyframes and Luma AI to make novel [https://x.com/CoffeeVectors/status/1845188179332051005 speed-ramp motion] | ||
+ | * October 2024: [https://pollo.ai/ Pollo AI] platform offers selection among a diversity of video models | ||
* October 2024: [https://www.genmo.ai/ Genmo] [https://x.com/genmoai/status/1848762405779574990 Mochi 1] (open source) | * October 2024: [https://www.genmo.ai/ Genmo] [https://x.com/genmoai/status/1848762405779574990 Mochi 1] (open source) | ||
* October 2024: Examples: | * October 2024: Examples: | ||
Line 79: | Line 88: | ||
** [https://x.com/runwayml/status/1848785913918218517 Diner conversation] | ** [https://x.com/runwayml/status/1848785913918218517 Diner conversation] | ||
** [https://x.com/Uncanny_Harry/status/1849275871716159989 Loved and Lost] (a meditation on grief) | ** [https://x.com/Uncanny_Harry/status/1849275871716159989 Loved and Lost] (a meditation on grief) | ||
+ | ====November 2024==== | ||
* November 2024: Examples: | * November 2024: Examples: | ||
** [https://x.com/blizaine/status/1852092147643699356 Pasta Doble] | ** [https://x.com/blizaine/status/1852092147643699356 Pasta Doble] | ||
Line 99: | Line 109: | ||
** [https://x.com/WorldEverett/status/1859273222597775843 Making Friends] (by [https://x.com/WorldEverett Everett World]; see also [https://x.com/WorldEverett/status/1858563716834275562 Childhood Dream] and [https://x.com/WorldEverett/status/1858945634067202429 City Echoes]) | ** [https://x.com/WorldEverett/status/1859273222597775843 Making Friends] (by [https://x.com/WorldEverett Everett World]; see also [https://x.com/WorldEverett/status/1858563716834275562 Childhood Dream] and [https://x.com/WorldEverett/status/1858945634067202429 City Echoes]) | ||
** Anime: [https://x.com/naegiko/status/1857754626742726893 test shots], [https://x.com/naegiko/status/1858978557424210401 Ultimate Ceremony], [https://x.com/naegiko/status/1835434668294074462 Echoes of Love] | ** Anime: [https://x.com/naegiko/status/1857754626742726893 test shots], [https://x.com/naegiko/status/1858978557424210401 Ultimate Ceremony], [https://x.com/naegiko/status/1835434668294074462 Echoes of Love] | ||
− | ** [https://x.com/KakuDrop/status/ | + | ** [https://x.com/KakuDrop/status/1866309309384323257 Echoes of Grace] ([https://x.com/KakuDrop KakuDrop] using Sora) |
** [https://x.com/vibeke_udart/status/1859879367071203662 Morphing hands], [https://x.com/vibeke_udart/status/1858772719224975630 hands and faces] ([https://x.com/vibeke_udart Vibeke Bertelsen]) | ** [https://x.com/vibeke_udart/status/1859879367071203662 Morphing hands], [https://x.com/vibeke_udart/status/1858772719224975630 hands and faces] ([https://x.com/vibeke_udart Vibeke Bertelsen]) | ||
** [https://www.reddit.com/r/aivideo/comments/1gxi29x/dbzlicious/ Dragon Ball Z live action] | ** [https://www.reddit.com/r/aivideo/comments/1gxi29x/dbzlicious/ Dragon Ball Z live action] | ||
Line 107: | Line 117: | ||
** [https://x.com/nickfloats/status/1861206978690691165 Desert Planet Cinematics] | ** [https://x.com/nickfloats/status/1861206978690691165 Desert Planet Cinematics] | ||
* November 2024: [https://huggingface.co/spaces/PR-Puppets/PR-Puppet-Sora Leaked] Sora turbo model; [https://x.com/rowancheung/status/1861455031603503234 examples], [https://x.com/chatgpt21/status/1861504511153451517 Dog chasing Cat in snow] | * November 2024: [https://huggingface.co/spaces/PR-Puppets/PR-Puppet-Sora Leaked] Sora turbo model; [https://x.com/rowancheung/status/1861455031603503234 examples], [https://x.com/chatgpt21/status/1861504511153451517 Dog chasing Cat in snow] | ||
+ | ====December 2024==== | ||
* December 2024: Examples: | * December 2024: Examples: | ||
** [https://x.com/minchoi/status/1863243880553976235 Realistic] (Minimax by Hailuo AI) | ** [https://x.com/minchoi/status/1863243880553976235 Realistic] (Minimax by Hailuo AI) | ||
** Trailer for [https://x.com/TheReelRobot/status/1861824847149670840 Paradise Lost] (to be released on [https://www.sandwatch.ai/ Sandwatch AI]) | ** Trailer for [https://x.com/TheReelRobot/status/1861824847149670840 Paradise Lost] (to be released on [https://www.sandwatch.ai/ Sandwatch AI]) | ||
** [https://x.com/EHuanglu/status/1863607136271716418 Music video example] with consistent characters | ** [https://x.com/EHuanglu/status/1863607136271716418 Music video example] with consistent characters | ||
+ | ** [https://x.com/venturetwins/status/1863666366764687581 Human expressions] ([https://www.reddit.com/r/ChatGPT/comments/1h4r13x/ai_generated_expressions/ u/Kind_Distance9504 on Reddit], using Hailuo) | ||
+ | ** Vodafone ad: [https://www.youtube.com/watch?v=9AyEC_K9kBg The Rhythm Of Life] | ||
+ | ** [https://www.reddit.com/r/midjourney/comments/1h5u2gw/we_made_a_10_minute_gen_ai_batman_film/ 10 minute Batman film] | ||
+ | * December 2024: Tencent [https://aivideo.hunyuan.tencent.com/ Hunyuan Video] open-source video model ([https://x.com/CharaspowerAI/status/1863862585554010530 example]) | ||
+ | * December 2024: [https://sora.com/ Sora] release ([https://x.com/CharaspowerAI/status/1866203050982916532 examples]) | ||
+ | * December 2024: [https://mint-video.github.io/ MinT video] improves consistency and control ([https://arxiv.org/abs/2412.05263 preprint], [https://x.com/EHuanglu/status/1868278456565531061 examples]) | ||
+ | * December 2024: Google [https://blog.google/technology/google-labs/video-image-generation-update-december-2024/ Veo 2] ([https://x.com/sundarpichai/status/1868709099644334518 examples], [https://x.com/EHuanglu/status/1869008306322522342 more examples], [https://x.com/_Borriss_/status/1869267571532320966 natural movement examples], [https://x.com/jerrod_lew/status/1870816560027246715 abstract], [https://x.com/jerrod_lew/status/1869427407415058660 realistic physics], [https://x.com/jerrod_lew/status/1873096585002786944 crowds], [https://x.com/minchoi/status/1873590350515929380 dancing], [https://x.com/jerrod_lew/status/1874440442269565351 animals]) | ||
+ | * December 2024: [https://x.com/pika_labs/status/1867651381840040304 Pika 2.0] with Scene Ingredients | ||
+ | * December 2024: Examples: | ||
+ | ** [https://www.youtube.com/watch?v=c_kKKRQ5gYw Synthetic Youth: Takenoko Zoku · Made by Emi Kusano with Sora] | ||
+ | ** [https://x.com/higgsfield_ai/status/1868698886761837041 Car race] ([https://higgsfield.ai/ Higgsfield AI] storytelling) | ||
+ | ** [https://x.com/blizaine/status/1868850653759783033 Slicing meat]; comparison of modern video generators | ||
+ | ** Challenging prompt: [https://x.com/RubenEVillegas/status/1868864410720325844 A cat roars while looking at its reflection in the mirror but instead sees itself as a lion roaring (Veo 2)] ([https://x.com/anukaakash/status/1869417975071330550 comparison to other models]) | ||
+ | ** [https://x.com/PJaccetturo/status/1869829338868412865 Anime trailer] | ||
+ | ** [https://x.com/ring_hyacinth/status/1870386506776674376 Snorlax at Mount Fuji] and [https://x.com/ring_hyacinth/status/1871105733443592696 Psyduck at Colosseum] (Kling 1.6) | ||
+ | ** [https://x.com/machine_mythos/status/1870565287789056320 Horror visuals] (with [https://mmaudio.net/ MMAudio] sound) | ||
+ | ** [https://www.youtube.com/watch?v=lFc1jxLHhyM The Heist] (Veo 2) | ||
+ | ** [https://x.com/minchoi/status/1871263616806129863 Various Veo 2 examples] | ||
+ | ** [https://x.com/minchoi/status/1872390429108486320 Live Action Titans] | ||
+ | ** [https://x.com/kimmonismus/status/1873094065841193222 Cats] [https://x.com/PostsOfCats/status/1872530207585825058 Cooking] | ||
+ | ** Aesthetic from alternate timelines: [https://x.com/BrianRoemmele/status/1871753358782120068 1], [https://x.com/BrianRoemmele/status/1872105833456423216 2], [https://x.com/brain_racked/status/1872340717978390583 3] | ||
+ | ** [https://x.com/minchoi/status/1872486717145706793 Examples approaching cinematic quality] | ||
+ | ** [https://x.com/JaicSam/status/1872903054221033693 Cosmic Spider] (winner at AI film festival) | ||
+ | ** [https://www.youtube.com/watch?v=dbdYPMRi_Nk Trailer for Newton's Cradle] (full film [https://x.com/JeffSynthesized/status/1872705173451358293 on] 2025-01-01) | ||
+ | ** [https://x.com/Ror_Fly/status/1873036384077828499 Car vs. Jet drag race] | ||
+ | ** [https://x.com/Diesol/status/1873415500149199066 California Monsters] | ||
+ | ** [https://x.com/heyshrutimishra/status/1873631383584924078 Various examples] (Hailuo AI) | ||
+ | ** [https://x.com/kimmonismus/status/1873568693357294014 Will Smith eating spaghetti] (c.f. [https://www.youtube.com/watch?v=XQr4Xklqzw8 April 2023]) | ||
+ | ** [https://x.com/StevieMac03/status/1873998177193648438 Sorceress and Arachnid Steed] (Kling v1.6) | ||
+ | ** [https://x.com/dustinhollywood/status/1873940924016779425 Music video] (Hailuo AI) | ||
+ | ** [https://www.youtube.com/watch?v=iQg2udCHMdI Akụkọ (Story)] (22 minute short) - A Lagos Boy's Thrilling Snack Run Nightmare | ||
+ | ** [https://x.com/cinerobot/status/1873766976306455019 Son of the Dragon] (8 minute short) | ||
+ | ** [https://x.com/SynthReveries/status/1873624586857886071 Endless Journey] music video ([https://suno.com/song/fa90fa5e-25c7-48ad-b291-42a8a8c51cf9 music] by Suno) | ||
+ | ** [https://x.com/anukaakash/status/1870504167653228980 Once Again] (retrospective) | ||
+ | ** [https://x.com/jasonzada/status/1873470586053414928 Fade Out] (Veo 2) | ||
+ | ** [https://x.com/talkboysstudio/status/1869085014513865027 Roadkill] (12 minute short) | ||
+ | |||
+ | ===2025=== | ||
+ | ====January 2025==== | ||
+ | * January 2025: [https://x.com/kimmonismus/status/1877351050748871038 Progress] over the last 1.5 years, by comparing Runway Gen 2 and Veo 2. | ||
+ | * January 2025: Examples: | ||
+ | ** [https://x.com/AllarHaltsonen/status/1874557865576542655 Delivery] (unofficial Nike ad) | ||
+ | ** [https://x.com/Diesol/status/1875237221735002299 Gucci ad] (Sora) | ||
+ | ** [https://x.com/EccentrismArt/status/1874498145910149412 Conquest] | ||
+ | ** [https://www.youtube.com/watch?v=RJZCMfaS-io Newton's Cradle] (6 minute short) | ||
+ | ** [https://x.com/AngryTomtweets/status/1874627041934602410 Singer] | ||
+ | ** [https://x.com/DumpsterBud/status/1874807352794182019 Brain vomit] (music video) | ||
+ | ** [https://x.com/mxvdxn/status/1874796628210778618 Vibe] (Kling v1.6) | ||
+ | ** [https://x.com/_deepfates/status/1875215969452523785 Will Smith eating spaghetti] (c.f. [https://www.youtube.com/watch?v=XQr4Xklqzw8 April 2023], [https://x.com/kimmonismus/status/1873568693357294014 December 2024]) | ||
+ | ** [https://www.youtube.com/watch?v=BL9-jHGnxyc Zorgop Knows All] (2 minute short) | ||
+ | ** [https://x.com/ButchersBrain/status/1875130428518269406 The Breach] (2 minute short; Veo2, Runway ActOne, MMaudio) | ||
+ | ** [https://x.com/Rainmaker1973c/status/1875261591043850477 Aesthetics from an alternate timeline] | ||
+ | ** [https://x.com/StevieMac03/status/1875440611849072841 Immortal Awakens] | ||
+ | ** [https://x.com/isaachorror/status/1875624519588835400 The Faded Line] | ||
+ | ** [https://www.youtube.com/watch?v=4fy8H38rm-4 Dear Dad] | ||
+ | ** [https://x.com/maxescu/status/1877060580680311242 Mad Max chase] | ||
+ | ** [https://x.com/kimmonismus/status/1877408247906447633 Patience is Key] | ||
+ | ** [https://x.com/techhalla/status/1879967230093586555 The Almost Famous Show] (talent show parody) | ||
+ | ** [https://x.com/thefuzzysignal/status/1879295176990154755 Proof-of-concept trailer for a medieval adult animated series] | ||
+ | ** [https://x.com/JeffSynthesized/status/1879555151499034869 Variety] (unofficial Cadbury ad) | ||
+ | ** [https://x.com/henrydaubrez/status/1879883806947115446 Kitsune] (5 minute animated short, Veo 2) | ||
+ | * January 2025: MiniMax Hailuo [https://www.minimaxi.com/en/news/s2v-01-release Subject Reference] enables consistent characters ([https://x.com/minchoi/status/1881707687362412924 examples]) | ||
+ | * January 2025: AI (de-aging deepfakes, [https://magnific.ai/ Magnific]) [https://x.com/JeffSynthesized/status/1878630652377178502 used in the film] [https://www.imdb.com/title/tt18272208/ "Here"]. | ||
+ | * January 2025: Luma [https://lumalabs.ai/ray Ray2] | ||
+ | * January 2025: [https://pikartai.com/pika-2-1/ Pika 2.1] ([https://x.com/OrctonAI/status/1883925754653905049 examples]) | ||
+ | * January 2025: Examples: | ||
+ | ** [https://x.com/wyzborrero/status/1879949477764804873 Light projections onto people] (challenging task, Ray2) | ||
+ | ** [https://x.com/AllarHaltsonen/status/1881261042753589547 BMW ad] | ||
+ | ** [https://x.com/AIWarper/status/1880658326645878821 John Wick in Severance] (Hunyuan vid2vid) | ||
+ | ** [https://x.com/TheReelRobot/status/1881771800595444193 Biopic] (7 minutes) | ||
+ | ** [https://x.com/misslaidlaw/status/1882180619582791784 Give It To Me] (music video) | ||
+ | ** [https://x.com/paultrillo/status/1882091702506459394 Where do we go from here?] (music video, Veo 2) | ||
+ | ** [https://x.com/WorldEverett/status/1882235057076580502 Party like there's no tomorrow] (music video) | ||
+ | ** [https://x.com/Diesol/status/1884696027942498779 S.T.O.R.I.] (Midjourney and Pika 2.1) | ||
+ | ====February 2025==== | ||
+ | * February 2025: Examples: | ||
+ | ** [https://x.com/OrctonAI/status/1885839287913955597 Long Steampunk scene] | ||
+ | ** [https://x.com/jerrod_lew/status/1885787580685562226 City destruction] | ||
+ | ** [https://x.com/EHuanglu/status/1885736840344551763 Consistent character acting] | ||
+ | ** [https://x.com/MeanOrangeCat/status/1884295241534185890 Kaiju Katastrophe] (by [https://x.com/MeanOrangeCat Mean Orange Cat]) | ||
+ | ** [https://x.com/Diesol/status/1886433799690748210 The Greyhound] | ||
+ | ** [https://x.com/CoffeeVectors/status/1886146242029195391 Fluid simulation video2video] | ||
+ | ** [https://x.com/toolstelegraph/status/1886622772828254403 High resolution macro shots] | ||
+ | ** [https://www.youtube.com/watch?v=p0J1LDWERS0 Chrysalids] | ||
+ | ** [https://x.com/multimodalart/status/1887817996220940737 Boring realistic images] (HunyuanVideo w/ LoRA) | ||
+ | ** [https://www.youtube.com/watch?v=PcVRfa1JyyQ Anime intro] ([https://www.reddit.com/r/StableDiffusion/comments/1ijvua0/opensource_almostconsistent_real_anime_made_with/ Hunyuan w/ custom LoRAs]) | ||
+ | ** [https://x.com/AllarHaltsonen/status/1888294811750318114 Automotive ad test] (Kling w/ custom model) | ||
+ | ** [https://x.com/AngryTomtweets/status/1888758524303269928 Random cinematic clips] (Midjourney and Kling) | ||
+ | ** [https://x.com/juliewdesign_/status/1888666757302263828 Crossing Paths] | ||
+ | ** [https://x.com/weirdai_art/status/1888794894187041200 Miniature food] | ||
+ | ** [https://x.com/CaptainHaHaa/status/1889573017745035463 Animals] | ||
+ | ** [https://x.com/Kavanthekid/status/1889371011667144724 Star Wars - The Ghost's Apprentice (Fan Film)] | ||
+ | ** [https://x.com/AngryTomtweets/status/1889768184716423573 Ray2 image-to-video examples] | ||
+ | ** [https://x.com/weirdai_art/status/1889890470987518069 New Horizons] (miniatures going to Mars) | ||
+ | ** [https://x.com/karim_yourself/status/1890100168378536155 Black Sun (trailer)] | ||
+ | ** [https://x.com/BrivaelLp/status/1890122101153231288 AI avatars] ([https://www.argil.ai/ Argil AI]) | ||
+ | ** [https://x.com/mrjonfinger/status/1890783411679236473 Adding elements to real video] ([https://x.com/mrjonfinger/status/1891337081923772918 other example]) | ||
+ | ** [https://x.com/SynthReveries/status/1892278954137940289 Glitch] | ||
+ | ** Anime: [https://x.com/freeeebird2300/status/1889119007707689146 sci-fi] (Ray2), [https://x.com/Artedeingenio/status/1891173784188756069 sci-fi] (Ray 2), [https://x.com/seiiiiiiiiiiru/status/1890980673743474931 90s sci-fi] (Luma) and [https://x.com/TomLikesRobots/status/1891209369804591447 moody] (Midjourney and Ray2) | ||
+ | * February 2025: Meta [https://hila-chefer.github.io/videojam-paper.github.io/ VideoJAM] | ||
+ | * February 2025: ByteDance [https://omnihuman-lab.github.io/ OmniHuman-1] | ||
+ | * February 2025: ByteDance [https://saiyan-world.github.io/goku/ Goku] ([https://arxiv.org/abs/2502.04896 paper], [https://x.com/ai_for_success/status/1888821141495844991 examples]) | ||
+ | * February 2025: [https://huggingface.co/stepfun-ai/stepvideo-t2v Step-Video-T2V] open-source model ([https://arxiv.org/abs/2502.10248 paper], [https://github.com/stepfun-ai/Step-Video-T2V code], [https://yuewen.cn/videos demo], [https://x.com/ai_for_success/status/1891369136082854129 examples]) | ||
+ | * February 2025: Pika [https://x.com/pika_labs/status/1892620122818294109 Pikaswaps] (examples of [https://x.com/FreddyChavezO/status/1892678426487881805 modifying regions], [https://x.com/CharaspowerAI/status/1893216710141919637 swapping items]) | ||
+ | * February 2025: Alibaba [https://wanai.pro/ Wan 2.1] [https://huggingface.co/blog/LLMhacker/wanai-wan21 open-source] ([https://x.com/fofrAI/status/1894862403260596371 examples]) | ||
+ | * February 2025: [https://thetwinai.com/ Twin AI]: compose videos with provided character, object, location ([https://x.com/EHuanglu/status/1901277394729930984 example]) | ||
+ | * February 2025: Examples: | ||
+ | ** [https://x.com/mrjonfinger/status/1893109598627750164 Infected] (Pika swaps and additions) | ||
+ | ** [https://x.com/amli_art/status/1893447314913796253 Hostile Government Takeover] (Veo2) | ||
+ | ** [https://x.com/KarolineGeorges/status/1895226395812561399 Dual Mechanism] (Pikaframes 2.2) | ||
+ | |||
+ | ====March 2025==== | ||
+ | * March 2025: Examples: | ||
+ | ** [https://x.com/SynthReveries/status/1895826068617252901 Doors] (music video) | ||
+ | ** [https://x.com/bind_lux/status/1894492032414224792 Drum and Bass] (music video; Kling, audio from [https://www.riffusion.com/?filter=staff-picks Riffusion]) | ||
+ | ** [https://x.com/RileyRalmuto/status/1896088776151269523 Woman's face] (Sora) | ||
+ | ** [https://x.com/ryanwpatterson/status/1896968881731948844 Skating] (Ray2) | ||
+ | ** [https://www.threads.net/@evolving.ai/post/DGlRyRoO7c9?xmt=AQGz6T_8VppPoAqb5aPwAJ2zzRLUP-YXi8SabAT0IIEA9Q Filming commercial on Mars] | ||
+ | ** [https://www.threads.net/@evolving.ai/post/DGycqyhuETS?xmt=AQGz6T_8VppPoAqb5aPwAJ2zzRLUP-YXi8SabAT0IIEA9Q Original Source commercial] (AI and real footage) | ||
+ | ** [https://x.com/maxescu/status/1896926229204496788 Time-lapses] (Pika 2.2) | ||
+ | ** [https://www.youtube.com/watch?v=2RhkcJyhg0E Hallucination] | ||
+ | ** [https://x.com/town_in_new/status/1897354572139782620 Macro video of bubbles] | ||
+ | * March 2025: [https://github.com/Tencent/HunyuanVideo-I2V HunyuanVideo-I2V] image-to-video | ||
+ | * March 2025: Google [https://x.com/labsdotgoogle/status/1897376700666626233 Whisk Animate] (based on Veo2, [https://x.com/maxescu/status/1902742535618888025 examples]) | ||
+ | * March 2025: Examples: | ||
+ | ** [https://x.com/jdp2oo/status/1897874927367160114 Recursion (horror)] (Kling) | ||
+ | ** [https://x.com/blizaine/status/1897826177970028614 Will Smith Eating Spaghetti while Sitting Inside a Bag] (c.f. [https://www.youtube.com/watch?v=XQr4Xklqzw8 April 2023], [https://x.com/kimmonismus/status/1873568693357294014 December 2024], [https://x.com/_deepfates/status/1875215969452523785 January 2025]) | ||
+ | ** [https://x.com/mickmumpitz/status/1897979382687297697 Paper Jam] (Kling with custom workflows to enable precise control) | ||
+ | ** [https://x.com/maxescu/status/1899155936645722216 Cinematic shots] (Google Whisk and Luma) | ||
+ | ** [https://x.com/weirdai_art/status/1899631013002711409 Perfunctory Horizons] | ||
+ | ** [https://x.com/maxescu/status/1900243840499368319 A Hard Winter] | ||
+ | ** [https://x.com/RoyalKongz/status/1900315389139014074 Consistent character example] | ||
+ | ** [https://x.com/maxescu/status/1900652266362650853 Anthropomorphic Animals] | ||
+ | ** [https://x.com/kimmonismus/status/1900457543299727718 Realistic (influencer-style)] | ||
+ | ** [https://x.com/SunoMusic/status/1900942410584043579 I Feel Cultured] (music video with surrealist vibes) | ||
+ | ** [https://rodeo.club/post/0x30b45c56d62751D763D3B8bFe4D18c4BB65EDF2c/209 journey of utmost importance] | ||
+ | ** [https://x.com/aiordieshow/status/1901930851127984291 Karen: Unleashed] | ||
+ | ** [https://x.com/minchoi/status/1901783767364092232 Yarn Cat] | ||
+ | ** [https://x.com/andyorsow/status/1901619535180091509 Ned's Wet Deli] (Runway) | ||
+ | ** [https://www.youtube.com/watch?v=KVoiooE8C0c BOOTS], a.k.a. [https://x.com/RuairiRobinson/status/1902027217137484117 "Our enemies are cartoon monsters"] (music video based on poem by Rudyard Kipling; Veo2) | ||
+ | ** Flying in a dream: [https://x.com/minchoi/status/1902197944826183864 1], [https://x.com/venturetwins/status/1901796679063626060 2] | ||
+ | ** [https://x.com/jasonzada/status/1902129567659389443 Commercial for Mercedes-Benz and FYI Radio] | ||
+ | ** [https://x.com/maxescu/status/1903108496666542562 Selfie video] (Luma) | ||
+ | ** Podcasts: [https://www.reddit.com/r/singularity/comments/1jintit/rottenly_roasted_now_full_script_is_also_not/ Rottenly Roasted] and [https://www.reddit.com/r/aivideo/comments/1jerh56/worst_date_ever/ Worst Date Ever] [https://x.com/OriZilbershtein/status/1903503438744318002 (Imagen 3, Hedra, Elevenlabs, Topaz)] | ||
+ | ** [https://x.com/DexploreArts/status/1903822122150986000 Ambience] (Midjourney, Luma) | ||
+ | ** [https://x.com/TheoMediaAI/status/1904207679511572845 The Bridge] (2 minute short; Veo2) | ||
+ | ** [https://x.com/peteromallet/status/1904268944992829462 Pulp Fiction] (Wan video editing) | ||
+ | ** [https://x.com/madpencil_/status/1906765750624493650 Camera Controls] (Luma Ray2) | ||
+ | * March 2025: [https://www.hedra.com/ Hedra] [https://x.com/hedra_labs/status/1897699010632466469 Character 3] | ||
+ | * March 2025: [https://huggingface.co/hpcai-tech/Open-Sora-v2 Open Sora v2] ([https://github.com/hpcaitech/Open-Sora code]) | ||
+ | * March 2025: Amazon Prime debuts [https://en.wikipedia.org/wiki/House_of_David_(TV_series) House of David], with special effects created by [https://www.thewonderproject.com/ Wonder Project] using a [https://x.com/PJaccetturo/status/1903126616831676792 combination of traditional and AI methods] (reportedly including Midjourney and Runway) | ||
+ | * March 2025: Examples: | ||
+ | ** [https://x.com/PJaccetturo/status/1905151190872309907 What if Studio Ghibli directed Lord of the Rings?] (OpenAI GPT-4o in-context image generation, Kling) | ||
+ | ** [https://x.com/ROHKI/status/1906039022662963269 RŌHKI] | ||
+ | ** [https://x.com/iaveras/status/1906362437487534296 Why] | ||
+ | ** [https://x.com/BrianRoemmele/status/1906476721236570508 Commercial for Puma] (research/test) | ||
+ | ** [https://x.com/Salmaaboukarr/status/1906776503343325469 Commercial for KFC] (concept ad) | ||
+ | * March 2025: Runway ML [https://runwayml.com/research/introducing-runway-gen-4 Gen-4] | ||
+ | ** [https://www.youtube.com/watch?v=c8IBmK7GZP8 The Lonely Little Flame] | ||
+ | ** [https://www.youtube.com/watch?v=Z0P6qjMUl34&t=1s The Herd] | ||
+ | ** [https://www.youtube.com/watch?v=9HzdNhOe09I The Retrieval] | ||
+ | ** [https://www.youtube.com/watch?v=xEhgxhrAjE4 NYC is a Zoo] | ||
+ | ** [https://www.youtube.com/watch?v=ENGKp5wn344 Scimmia Vede] (music video) | ||
+ | |||
+ | ====April 2025==== | ||
+ | * April 2025: Examples: | ||
+ | ** TBD |
Revision as of 15:24, 31 March 2025
Contents
Evolution of Capabilities
Early
- November 2016: Sync-Draw
- April 2021: GODIVA
- October 2022: Meta Make-a-video
- October 2022: Google Imagen video
2023
- April 2023: Will Smith eating spaghetti
- April 2023: Runway Gen 2
- April 2023: Nvidia latents
- December 2023: Fei-Fei Li
2024
Early 2024
- January 2024: Google VideoPoet
- January 2024: Google Lumiere
- February 2024: OpenAI Sora
- April 2024: Vidu
- May 2024: Veo
- May 2024: Kling
- June 2024: Luma DreamMachine
- June 2024: RunwayML Gen-3 Alpha
- July 2024: Examples:
- July 2024: haiper.ai
August 2024
- August 2024: Hotshot (examples, more examples)
- August 2024: Luma Dream Machine v1.5
- August 2024: Examples:
- Runway Gen3 music video
- Runway Gen3 for adding FX to live action (another example)
- Midjourney + Runway Gen3: Hey It’s Snowing
- Flux/LoRA image + Runway Gen3 woman presenter
- McDonald’s AI commercial
- Sora used by Izanami AI Art to create dreamlike video and by Alexia Adana to create sci-fi film concept
September 2024
- September 2024: Hailuo Minimax (examples)
- September 2024: Examples:
- Space colonization
- Consistent characters
- Sea monsters
- Music video
- Animated characters
- AI influencer
- Ten short examples
- Seven examples
- Clip from horror film
- "Gone" featuring astronaut and something ethereal
- Two dancers (surprisingly good consistency despite movement)
- Music video about flying
- The Paperclip Maximizer
- La Baie Aréa
- "To Dear Me" by Gisele Tong (winner of AI shorts film festival)
- Various scenes
- Directing emotions
- September 2024: Kling 1.5 (examples, showing emotions)
- September 2024: Examples:
- Runway video-to-video to restyle classic video games
- Realistic presenter
- Skateboarding (demonstrates getting closer to meaningfully simulating motion/physics)
- Examples of short clips with cinematic feel
- Short: 4 Minutes to Live
- Short: Neon Nights (Arcade)
- Random Access Memories: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage
- Sora used to make a sort of weird dreamlike video
October 2024
- October 2024: Pika v1.5, including Pikaffects (explode, melt, inflate, and cake-ify; examples: 1, 2, 3, 4, 5, 6)
- October 2024: Examples:
- AI avatar with good lip-sync
- Battalion: 5 minute short about war
- Short film: To Wonderland (credits)
- 9 to 5: Created with Luma Dream Machine keyframes and camera features; music by Suno
- October 2024: Meta Movie Gen
- October 2024: Examples:
- AI Avatar (using HeyGen)
- Generic Movies
- Pyramid-flow (open source) model: examples
- Building the Pyramids
- People showing realistic emotion (using Hailuo AI)
- Keyframes and Luma AI to make novel speed-ramp motion
- October 2024: Pollo AI platform offers selection among a diversity of video models
- October 2024: Genmo Mochi 1 (open source)
- October 2024: Examples:
- Meta Movie Gen examples
- Emotional range of Minimax
- Car commercial: Bear
- Diner conversation
- Loved and Lost (a meditation on grief)
November 2024
- November 2024: Examples:
- Pasta Doble
- Bird protecting young
- Camera moving around sushi
- Various examples of Hailuo AI
- Trains
- Light of Imagination
- Bringing historic images to life
- Plants dancing
- Insect on tree
- Trailers for The Silmarillion and The Fall of Gondolin (by Abandoned Films)
- Moody sci-fi
- Migration (made by combining Runway ML Gen3-Alpha and traditional animation)
- After the Winter (music made using Suno v4)
- Horror: Ridge to Southwest
- The Gardener (by Machine Mythos)
- Coca-Cola holiday ad and parody thereof
- A Dream Within A Dream (by PZF, selected for the Czech International AI Film Festival)
- Making Friends (by Everett World; see also Childhood Dream and City Echoes)
- Anime: test shots, Ultimate Ceremony, Echoes of Love
- Echoes of Grace (KakuDrop using Sora)
- Morphing hands, hands and faces (Vibeke Bertelsen)
- Dragon Ball Z live action
- Pitch Black (abstract and dark)
- Animals Running (zoomed-in ultra-wide camera)
- Dreams of Tomorrow (panning shots of high-tech car, Scottish manor)
- Desert Planet Cinematics
- November 2024: Leaked Sora turbo model; examples, Dog chasing Cat in snow
December 2024
- December 2024: Examples:
- Realistic (Minimax by Hailuo AI)
- Trailer for Paradise Lost (to be released on Sandwatch AI)
- Music video example with consistent characters
- Human expressions (u/Kind_Distance9504 on Reddit, using Hailuo)
- Vodafone ad: The Rhythm Of Life
- 10 minute Batman film
- December 2024: Tencent Hunyuan Video open-source video model (example)
- December 2024: Sora release (examples)
- December 2024: MinT video improves consistency and control (preprint, examples)
- December 2024: Google Veo 2 (examples, more examples, natural movement examples, abstract, realistic physics, crowds, dancing, animals)
- December 2024: Pika 2.0 with Scene Ingredients
- December 2024: Examples:
- Synthetic Youth: Takenoko Zoku · Made by Emi Kusano with Sora
- Car race (Higgsfield AI storytelling)
- Slicing meat; comparison of modern video generators
- Challenging prompt: A cat roars while looking at its reflection in the mirror but instead sees itself as a lion roaring (Veo 2) (comparison to other models)
- Anime trailer
- Snorlax at Mount Fuji and Psyduck at Colosseum (Kling 1.6)
- Horror visuals (with MMAudio sound)
- The Heist (Veo 2)
- Various Veo 2 examples
- Live Action Titans
- Cats Cooking
- Aesthetic from alternate timelines: 1, 2, 3
- Examples approaching cinematic quality
- Cosmic Spider (winner at AI film festival)
- Trailer for Newton's Cradle (full film on 2025-01-01)
- Car vs. Jet drag race
- California Monsters
- Various examples (Hailuo AI)
- Will Smith eating spaghetti (c.f. April 2023)
- Sorceress and Arachnid Steed (Kling v1.6)
- Music video (Hailuo AI)
- Akụkọ (Story) (22 minute short) - A Lagos Boy's Thrilling Snack Run Nightmare
- Son of the Dragon (8 minute short)
- Endless Journey music video (music by Suno)
- Once Again (retrospective)
- Fade Out (Veo 2)
- Roadkill (12 minute short)
2025
January 2025
- January 2025: Progress over the last 1.5 years, by comparing Runway Gen 2 and Veo 2.
- January 2025: Examples:
- Delivery (unofficial Nike ad)
- Gucci ad (Sora)
- Conquest
- Newton's Cradle (6 minute short)
- Singer
- Brain vomit (music video)
- Vibe (Kling v1.6)
- Will Smith eating spaghetti (c.f. April 2023, December 2024)
- Zorgop Knows All (2 minute short)
- The Breach (2 minute short; Veo2, Runway ActOne, MMaudio)
- Aesthetics from an alternate timeline
- Immortal Awakens
- The Faded Line
- Dear Dad
- Mad Max chase
- Patience is Key
- The Almost Famous Show (talent show parody)
- Proof-of-concept trailer for a medieval adult animated series
- Variety (unofficial Cadbury ad)
- Kitsune (5 minute animated short, Veo 2)
- January 2025: MiniMax Hailuo Subject Reference enables consistent characters (examples)
- January 2025: AI (de-aging deepfakes, Magnific) used in the film "Here".
- January 2025: Luma Ray2
- January 2025: Pika 2.1 (examples)
- January 2025: Examples:
- Light projections onto people (challenging task, Ray2)
- BMW ad
- John Wick in Severance (Hunyuan vid2vid)
- Biopic (7 minutes)
- Give It To Me (music video)
- Where do we go from here? (music video, Veo 2)
- Party like there's no tomorrow (music video)
- S.T.O.R.I. (Midjourney and Pika 2.1)
February 2025
- February 2025: Examples:
- Long Steampunk scene
- City destruction
- Consistent character acting
- Kaiju Katastrophe (by Mean Orange Cat)
- The Greyhound
- Fluid simulation video2video
- High resolution macro shots
- Chrysalids
- Boring realistic images (HunyuanVideo w/ LoRA)
- Anime intro (Hunyuan w/ custom LoRAs)
- Automotive ad test (Kling w/ custom model)
- Random cinematic clips (Midjourney and Kling)
- Crossing Paths
- Miniature food
- Animals
- Star Wars - The Ghost's Apprentice (Fan Film)
- Ray2 image-to-video examples
- New Horizons (miniatures going to Mars)
- Black Sun (trailer)
- AI avatars (Argil AI)
- Adding elements to real video (other example)
- Glitch
- Anime: sci-fi (Ray2), sci-fi (Ray 2), 90s sci-fi (Luma) and moody (Midjourney and Ray2)
- February 2025: Meta VideoJAM
- February 2025: ByteDance OmniHuman-1
- February 2025: ByteDance Goku (paper, examples)
- February 2025: Step-Video-T2V open-source model (paper, code, demo, examples)
- February 2025: Pika Pikaswaps (examples of modifying regions, swapping items)
- February 2025: Alibaba Wan 2.1 open-source (examples)
- February 2025: Twin AI: compose videos with provided character, object, location (example)
- February 2025: Examples:
- Infected (Pika swaps and additions)
- Hostile Government Takeover (Veo2)
- Dual Mechanism (Pikaframes 2.2)
March 2025
- March 2025: Examples:
- Doors (music video)
- Drum and Bass (music video; Kling, audio from Riffusion)
- Woman's face (Sora)
- Skating (Ray2)
- Filming commercial on Mars
- Original Source commercial (AI and real footage)
- Time-lapses (Pika 2.2)
- Hallucination
- Macro video of bubbles
- March 2025: HunyuanVideo-I2V image-to-video
- March 2025: Google Whisk Animate (based on Veo2, examples)
- March 2025: Examples:
- Recursion (horror) (Kling)
- Will Smith Eating Spaghetti while Sitting Inside a Bag (c.f. April 2023, December 2024, January 2025)
- Paper Jam (Kling with custom workflows to enable precise control)
- Cinematic shots (Google Whisk and Luma)
- Perfunctory Horizons
- A Hard Winter
- Consistent character example
- Anthropomorphic Animals
- Realistic (influencer-style)
- I Feel Cultured (music video with surrealist vibes)
- journey of utmost importance
- Karen: Unleashed
- Yarn Cat
- Ned's Wet Deli (Runway)
- BOOTS, a.k.a. "Our enemies are cartoon monsters" (music video based on poem by Rudyard Kipling; Veo2)
- Flying in a dream: 1, 2
- Commercial for Mercedes-Benz and FYI Radio
- Selfie video (Luma)
- Podcasts: Rottenly Roasted and Worst Date Ever (Imagen 3, Hedra, Elevenlabs, Topaz)
- Ambience (Midjourney, Luma)
- The Bridge (2 minute short; Veo2)
- Pulp Fiction (Wan video editing)
- Camera Controls (Luma Ray2)
- March 2025: Hedra Character 3
- March 2025: Open Sora v2 (code)
- March 2025: Amazon Prime debuts House of David, with special effects created by Wonder Project using a combination of traditional and AI methods (reportedly including Midjourney and Runway)
- March 2025: Examples:
- What if Studio Ghibli directed Lord of the Rings? (OpenAI GPT-4o in-context image generation, Kling)
- RŌHKI
- Why
- Commercial for Puma (research/test)
- Commercial for KFC (concept ad)
- March 2025: Runway ML Gen-4
- The Lonely Little Flame
- The Herd
- The Retrieval
- NYC is a Zoo
- Scimmia Vede (music video)
April 2025
- April 2025: Examples:
- TBD