Difference between revisions of "AI video"

From GISAXS
Jump to: navigation, search
(→‎Evolution of Capabilities)
(→‎May 2025)
(243 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
==Evolution of Capabilities==
 
==Evolution of Capabilities==
−
* Nov 2016: [https://arxiv.org/abs/1611.10314 Sync-Draw]
+
===Early===
 +
* November 2016: [https://arxiv.org/abs/1611.10314 Sync-Draw]
 
* April 2021: [https://arxiv.org/abs/2104.14806 GODIVA]
 
* April 2021: [https://arxiv.org/abs/2104.14806 GODIVA]
−
* Oct 2022: [https://makeavideo.studio/ Meta Make-a-video]
+
* October 2022: [https://makeavideo.studio/ Meta Make-a-video]
−
* Oct 2022: [https://imagen.research.google/video/ Google Imagen video]
+
* October 2022: [https://imagen.research.google/video/ Google Imagen video]
 +
 
 +
===2023===
 
* April 2023: [https://www.youtube.com/watch?v=XQr4Xklqzw8 Will Smith eating spaghetti]
 
* April 2023: [https://www.youtube.com/watch?v=XQr4Xklqzw8 Will Smith eating spaghetti]
 
* April 2023: [https://x.com/mrjonfinger/status/1645953033636048896?cxt=HHwWgMDT7YfkzNctAAAA Runway Gen 2]
 
* April 2023: [https://x.com/mrjonfinger/status/1645953033636048896?cxt=HHwWgMDT7YfkzNctAAAA Runway Gen 2]
 
* April 2023: [https://research.nvidia.com/labs/toronto-ai/VideoLDM/ Nvidia latents]
 
* April 2023: [https://research.nvidia.com/labs/toronto-ai/VideoLDM/ Nvidia latents]
 
* December 2023: [https://www.threads.net/@luokai/post/C0vvEnTP4Oj Fei-Fei Li]
 
* December 2023: [https://www.threads.net/@luokai/post/C0vvEnTP4Oj Fei-Fei Li]
 +
===2024===
 +
====Early 2024====
 
* January 2024: [https://sites.research.google/videopoet/ Google VideoPoet]
 
* January 2024: [https://sites.research.google/videopoet/ Google VideoPoet]
 
* January 2024: [https://lumiere-video.github.io/ Google Lumiere]
 
* January 2024: [https://lumiere-video.github.io/ Google Lumiere]
Line 20: Line 25:
 
** [https://www.youtube.com/watch?v=CSfw_NjqQ2o Motorola commercial made using genAI]
 
** [https://www.youtube.com/watch?v=CSfw_NjqQ2o Motorola commercial made using genAI]
 
* July 2024: [https://x.com/rowancheung/status/1813258518159585723 haiper.ai]
 
* July 2024: [https://x.com/rowancheung/status/1813258518159585723 haiper.ai]
 +
====August 2024====
 
* August 2024: [http://hotshot.co/ Hotshot] ([https://x.com/maxescu/status/1825459083635536081 examples], [https://x.com/EccentrismArt/status/1825550841534972027 more examples])
 
* August 2024: [http://hotshot.co/ Hotshot] ([https://x.com/maxescu/status/1825459083635536081 examples], [https://x.com/EccentrismArt/status/1825550841534972027 more examples])
 
* August 2024: Luma Dream Machine [https://x.com/LumaLabsAI/status/1825639918539817101 v1.5]
 
* August 2024: Luma Dream Machine [https://x.com/LumaLabsAI/status/1825639918539817101 v1.5]
Line 29: Line 35:
 
** [https://x.com/CharaspowerAI/status/1825274421256356106 McDonald’s AI commercial]
 
** [https://x.com/CharaspowerAI/status/1825274421256356106 McDonald’s AI commercial]
 
** Sora used by [https://www.facebook.com/izanamiaiart/ Izanami AI Art] to create [https://x.com/kimmonismus/status/1824102316229759114 dreamlike video] and by [https://x.com/alexiaadana Alexia Adana] to create [https://x.com/basedjensen/status/1824386717123743940 sci-fi film concept]
 
** Sora used by [https://www.facebook.com/izanamiaiart/ Izanami AI Art] to create [https://x.com/kimmonismus/status/1824102316229759114 dreamlike video] and by [https://x.com/alexiaadana Alexia Adana] to create [https://x.com/basedjensen/status/1824386717123743940 sci-fi film concept]
 +
====September 2024====
 
* September 2024: [https://hailuoai.com/video/ Hailuo Minimax] ([https://x.com/minchoi/status/1829995683124035766 examples])
 
* September 2024: [https://hailuoai.com/video/ Hailuo Minimax] ([https://x.com/minchoi/status/1829995683124035766 examples])
 
* September 2024: Examples:
 
* September 2024: Examples:
Line 58: Line 65:
 
** [https://www.youtube.com/watch?v=CcrGSA-kSrI Random Access Memories]: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage
 
** [https://www.youtube.com/watch?v=CcrGSA-kSrI Random Access Memories]: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage
 
** Sora used to make a sort of [https://x.com/niceaunties/status/1837271244774715505 weird dreamlike video]
 
** Sora used to make a sort of [https://x.com/niceaunties/status/1837271244774715505 weird dreamlike video]
 +
====October 2024====
 
* October 2024: Pika v1.5, including Pikaffects (explode, melt, inflate, and cake-ify; examples: [https://x.com/justin_hart/status/1841144350572413259 1], [https://x.com/arthur_hyper88/status/1841156544538521646 2], [https://x.com/ytjessie_/status/1841168925301842263 3], [https://x.com/bilawalsidhu/status/1841195247184781420 4], [https://x.com/minchoi/status/1841189035454447636 5], [https://x.com/ytjessie_/status/1841209415514669501 6])
 
* October 2024: Pika v1.5, including Pikaffects (explode, melt, inflate, and cake-ify; examples: [https://x.com/justin_hart/status/1841144350572413259 1], [https://x.com/arthur_hyper88/status/1841156544538521646 2], [https://x.com/ytjessie_/status/1841168925301842263 3], [https://x.com/bilawalsidhu/status/1841195247184781420 4], [https://x.com/minchoi/status/1841189035454447636 5], [https://x.com/ytjessie_/status/1841209415514669501 6])
 
* October 2024: Examples:
 
* October 2024: Examples:
Line 72: Line 80:
 
** [https://x.com/maxescu/status/1844716998854349217 People showing realistic emotion] (using [https://hailuoai.video/ Hailuo AI])
 
** [https://x.com/maxescu/status/1844716998854349217 People showing realistic emotion] (using [https://hailuoai.video/ Hailuo AI])
 
** Keyframes and Luma AI to make novel [https://x.com/CoffeeVectors/status/1845188179332051005 speed-ramp motion]
 
** Keyframes and Luma AI to make novel [https://x.com/CoffeeVectors/status/1845188179332051005 speed-ramp motion]
 +
* October 2024: [https://pollo.ai/ Pollo AI] platform offers selection among a diversity of video models
 
* October 2024: [https://www.genmo.ai/ Genmo] [https://x.com/genmoai/status/1848762405779574990 Mochi 1] (open source)
 
* October 2024: [https://www.genmo.ai/ Genmo] [https://x.com/genmoai/status/1848762405779574990 Mochi 1] (open source)
 
* October 2024: Examples:
 
* October 2024: Examples:
Line 79: Line 88:
 
** [https://x.com/runwayml/status/1848785913918218517 Diner conversation]
 
** [https://x.com/runwayml/status/1848785913918218517 Diner conversation]
 
** [https://x.com/Uncanny_Harry/status/1849275871716159989 Loved and Lost] (a meditation on grief)
 
** [https://x.com/Uncanny_Harry/status/1849275871716159989 Loved and Lost] (a meditation on grief)
 +
====November 2024====
 
* November 2024: Examples:
 
* November 2024: Examples:
 
** [https://x.com/blizaine/status/1852092147643699356 Pasta Doble]
 
** [https://x.com/blizaine/status/1852092147643699356 Pasta Doble]
Line 99: Line 109:
 
** [https://x.com/WorldEverett/status/1859273222597775843 Making Friends] (by [https://x.com/WorldEverett Everett World]; see also [https://x.com/WorldEverett/status/1858563716834275562 Childhood Dream] and [https://x.com/WorldEverett/status/1858945634067202429 City Echoes])
 
** [https://x.com/WorldEverett/status/1859273222597775843 Making Friends] (by [https://x.com/WorldEverett Everett World]; see also [https://x.com/WorldEverett/status/1858563716834275562 Childhood Dream] and [https://x.com/WorldEverett/status/1858945634067202429 City Echoes])
 
** Anime: [https://x.com/naegiko/status/1857754626742726893 test shots], [https://x.com/naegiko/status/1858978557424210401 Ultimate Ceremony], [https://x.com/naegiko/status/1835434668294074462 Echoes of Love]
 
** Anime: [https://x.com/naegiko/status/1857754626742726893 test shots], [https://x.com/naegiko/status/1858978557424210401 Ultimate Ceremony], [https://x.com/naegiko/status/1835434668294074462 Echoes of Love]
−
** [https://x.com/KakuDrop/status/1859387013054726510 Echoes of Grace] ([https://x.com/KakuDrop KakuDrop] using Sora)
+
** [https://x.com/KakuDrop/status/1866309309384323257 Echoes of Grace] ([https://x.com/KakuDrop KakuDrop] using Sora)
 
** [https://x.com/vibeke_udart/status/1859879367071203662 Morphing hands], [https://x.com/vibeke_udart/status/1858772719224975630 hands and faces] ([https://x.com/vibeke_udart Vibeke Bertelsen])
 
** [https://x.com/vibeke_udart/status/1859879367071203662 Morphing hands], [https://x.com/vibeke_udart/status/1858772719224975630 hands and faces] ([https://x.com/vibeke_udart Vibeke Bertelsen])
 
** [https://www.reddit.com/r/aivideo/comments/1gxi29x/dbzlicious/ Dragon Ball Z live action]
 
** [https://www.reddit.com/r/aivideo/comments/1gxi29x/dbzlicious/ Dragon Ball Z live action]
Line 105: Line 115:
 
** [https://x.com/cfryant/status/1861050528932765710 Animals Running] (zoomed-in ultra-wide camera)
 
** [https://x.com/cfryant/status/1861050528932765710 Animals Running] (zoomed-in ultra-wide camera)
 
** [https://x.com/WorldEverett/status/1860730214487118290 Dreams of Tomorrow] (panning shots of high-tech car, Scottish manor)
 
** [https://x.com/WorldEverett/status/1860730214487118290 Dreams of Tomorrow] (panning shots of high-tech car, Scottish manor)
−
** [https://x.com/rowancheung/status/1861455031603503234 Examples] from the [https://huggingface.co/spaces/PR-Puppets/PR-Puppet-Sora leaked] Sora turbo model; another example: [https://x.com/chatgpt21/status/1861504511153451517 Dog chasing Cat in snow].
 
 
** [https://x.com/nickfloats/status/1861206978690691165 Desert Planet Cinematics]
 
** [https://x.com/nickfloats/status/1861206978690691165 Desert Planet Cinematics]
 +
* November 2024: [https://huggingface.co/spaces/PR-Puppets/PR-Puppet-Sora Leaked] Sora turbo model; [https://x.com/rowancheung/status/1861455031603503234 examples], [https://x.com/chatgpt21/status/1861504511153451517 Dog chasing Cat in snow]
 +
====December 2024====
 +
* December 2024: Examples:
 +
** [https://x.com/minchoi/status/1863243880553976235 Realistic] (Minimax by Hailuo AI)
 +
** Trailer for [https://x.com/TheReelRobot/status/1861824847149670840 Paradise Lost] (to be released on [https://www.sandwatch.ai/ Sandwatch AI])
 +
** [https://x.com/EHuanglu/status/1863607136271716418 Music video example] with consistent characters
 +
** [https://x.com/venturetwins/status/1863666366764687581 Human expressions] ([https://www.reddit.com/r/ChatGPT/comments/1h4r13x/ai_generated_expressions/ u/Kind_Distance9504 on Reddit], using Hailuo)
 +
** Vodafone ad: [https://www.youtube.com/watch?v=9AyEC_K9kBg The Rhythm Of Life]
 +
** [https://www.reddit.com/r/midjourney/comments/1h5u2gw/we_made_a_10_minute_gen_ai_batman_film/ 10 minute Batman film]
 +
* December 2024: Tencent [https://aivideo.hunyuan.tencent.com/ Hunyuan Video] open-source video model ([https://x.com/CharaspowerAI/status/1863862585554010530 example])
 +
* December 2024: [https://sora.com/ Sora] release ([https://x.com/CharaspowerAI/status/1866203050982916532 examples])
 +
* December 2024: [https://mint-video.github.io/ MinT video] improves consistency and control ([https://arxiv.org/abs/2412.05263 preprint], [https://x.com/EHuanglu/status/1868278456565531061 examples])
 +
* December 2024: Google [https://blog.google/technology/google-labs/video-image-generation-update-december-2024/ Veo 2] ([https://x.com/sundarpichai/status/1868709099644334518 examples], [https://x.com/EHuanglu/status/1869008306322522342 more examples], [https://x.com/_Borriss_/status/1869267571532320966 natural movement examples], [https://x.com/jerrod_lew/status/1870816560027246715 abstract], [https://x.com/jerrod_lew/status/1869427407415058660 realistic physics], [https://x.com/jerrod_lew/status/1873096585002786944 crowds], [https://x.com/minchoi/status/1873590350515929380 dancing], [https://x.com/jerrod_lew/status/1874440442269565351 animals])
 +
* December 2024: [https://x.com/pika_labs/status/1867651381840040304 Pika 2.0] with Scene Ingredients
 +
* December 2024: Examples:
 +
** [https://www.youtube.com/watch?v=c_kKKRQ5gYw Synthetic Youth: Takenoko Zoku · Made by Emi Kusano with Sora]
 +
** [https://x.com/higgsfield_ai/status/1868698886761837041 Car race] ([https://higgsfield.ai/ Higgsfield AI] storytelling)
 +
** [https://x.com/blizaine/status/1868850653759783033 Slicing meat]; comparison of modern video generators
 +
** Challenging prompt: [https://x.com/RubenEVillegas/status/1868864410720325844 A cat roars while looking at its reflection in the mirror but instead sees itself as a lion roaring (Veo 2)] ([https://x.com/anukaakash/status/1869417975071330550 comparison to other models])
 +
** [https://x.com/PJaccetturo/status/1869829338868412865 Anime trailer]
 +
** [https://x.com/ring_hyacinth/status/1870386506776674376 Snorlax at Mount Fuji] and [https://x.com/ring_hyacinth/status/1871105733443592696 Psyduck at Colosseum] (Kling 1.6)
 +
** [https://x.com/machine_mythos/status/1870565287789056320 Horror visuals] (with [https://mmaudio.net/ MMAudio] sound)
 +
** [https://www.youtube.com/watch?v=lFc1jxLHhyM The Heist] (Veo 2)
 +
** [https://x.com/minchoi/status/1871263616806129863 Various Veo 2 examples]
 +
** [https://x.com/minchoi/status/1872390429108486320 Live Action Titans]
 +
** [https://x.com/kimmonismus/status/1873094065841193222 Cats] [https://x.com/PostsOfCats/status/1872530207585825058 Cooking]
 +
** Aesthetic from alternate timelines: [https://x.com/BrianRoemmele/status/1871753358782120068 1], [https://x.com/BrianRoemmele/status/1872105833456423216 2], [https://x.com/brain_racked/status/1872340717978390583 3]
 +
** [https://x.com/minchoi/status/1872486717145706793 Examples approaching cinematic quality]
 +
** [https://x.com/JaicSam/status/1872903054221033693 Cosmic Spider] (winner at AI film festival)
 +
** [https://www.youtube.com/watch?v=dbdYPMRi_Nk Trailer for Newton's Cradle] (full film [https://x.com/JeffSynthesized/status/1872705173451358293 on] 2025-01-01)
 +
** [https://x.com/Ror_Fly/status/1873036384077828499 Car vs. Jet drag race]
 +
** [https://x.com/Diesol/status/1873415500149199066 California Monsters]
 +
** [https://x.com/heyshrutimishra/status/1873631383584924078 Various examples] (Hailuo AI)
 +
** [https://x.com/kimmonismus/status/1873568693357294014 Will Smith eating spaghetti] (c.f. [https://www.youtube.com/watch?v=XQr4Xklqzw8 April 2023])
 +
** [https://x.com/StevieMac03/status/1873998177193648438 Sorceress and Arachnid Steed] (Kling v1.6)
 +
** [https://x.com/dustinhollywood/status/1873940924016779425 Music video] (Hailuo AI)
 +
** [https://www.youtube.com/watch?v=iQg2udCHMdI Akụkọ (Story)] (22 minute short) - A Lagos Boy's Thrilling Snack Run Nightmare
 +
** [https://x.com/cinerobot/status/1873766976306455019 Son of the Dragon] (8 minute short)
 +
** [https://x.com/SynthReveries/status/1873624586857886071 Endless Journey] music video ([https://suno.com/song/fa90fa5e-25c7-48ad-b291-42a8a8c51cf9 music] by Suno)
 +
** [https://x.com/anukaakash/status/1870504167653228980 Once Again] (retrospective)
 +
** [https://x.com/jasonzada/status/1873470586053414928 Fade Out] (Veo 2)
 +
** [https://x.com/talkboysstudio/status/1869085014513865027 Roadkill] (12 minute short)
 +
 +
===2025===
 +
====January 2025====
 +
* January 2025: [https://x.com/kimmonismus/status/1877351050748871038 Progress] over the last 1.5 years, by comparing Runway Gen 2 and Veo 2.
 +
* January 2025: Examples:
 +
** [https://x.com/AllarHaltsonen/status/1874557865576542655 Delivery] (unofficial Nike ad)
 +
** [https://x.com/Diesol/status/1875237221735002299 Gucci ad] (Sora)
 +
** [https://x.com/EccentrismArt/status/1874498145910149412 Conquest]
 +
** [https://www.youtube.com/watch?v=RJZCMfaS-io Newton's Cradle] (6 minute short)
 +
** [https://x.com/AngryTomtweets/status/1874627041934602410 Singer]
 +
** [https://x.com/DumpsterBud/status/1874807352794182019 Brain vomit] (music video)
 +
** [https://x.com/mxvdxn/status/1874796628210778618 Vibe] (Kling v1.6)
 +
** [https://x.com/_deepfates/status/1875215969452523785 Will Smith eating spaghetti] (c.f. [https://www.youtube.com/watch?v=XQr4Xklqzw8 April 2023], [https://x.com/kimmonismus/status/1873568693357294014 December 2024])
 +
** [https://www.youtube.com/watch?v=BL9-jHGnxyc Zorgop Knows All] (2 minute short)
 +
** [https://x.com/ButchersBrain/status/1875130428518269406 The Breach] (2 minute short; Veo2, Runway ActOne, MMaudio)
 +
** [https://x.com/Rainmaker1973c/status/1875261591043850477 Aesthetics from an alternate timeline]
 +
** [https://x.com/StevieMac03/status/1875440611849072841 Immortal Awakens]
 +
** [https://x.com/isaachorror/status/1875624519588835400 The Faded Line]
 +
** [https://www.youtube.com/watch?v=4fy8H38rm-4 Dear Dad]
 +
** [https://x.com/maxescu/status/1877060580680311242 Mad Max chase]
 +
** [https://x.com/kimmonismus/status/1877408247906447633 Patience is Key]
 +
** [https://x.com/techhalla/status/1879967230093586555 The Almost Famous Show] (talent show parody)
 +
** [https://x.com/thefuzzysignal/status/1879295176990154755 Proof-of-concept trailer for a medieval adult animated series]
 +
** [https://x.com/JeffSynthesized/status/1879555151499034869 Variety] (unofficial Cadbury ad)
 +
** [https://x.com/henrydaubrez/status/1879883806947115446 Kitsune] (5 minute animated short, Veo 2)
 +
* January 2025: MiniMax Hailuo [https://www.minimaxi.com/en/news/s2v-01-release Subject Reference] enables consistent characters ([https://x.com/minchoi/status/1881707687362412924 examples])
 +
* January 2025: AI (de-aging deepfakes, [https://magnific.ai/ Magnific]) [https://x.com/JeffSynthesized/status/1878630652377178502 used in the film] [https://www.imdb.com/title/tt18272208/ "Here"].
 +
* January 2025: Luma [https://lumalabs.ai/ray Ray2]
 +
* January 2025: [https://pikartai.com/pika-2-1/ Pika 2.1] ([https://x.com/OrctonAI/status/1883925754653905049 examples])
 +
* January 2025: Examples:
 +
** [https://x.com/wyzborrero/status/1879949477764804873 Light projections onto people] (challenging task, Ray2)
 +
** [https://x.com/AllarHaltsonen/status/1881261042753589547 BMW ad]
 +
** [https://x.com/AIWarper/status/1880658326645878821 John Wick in Severance] (Hunyuan vid2vid)
 +
** [https://x.com/TheReelRobot/status/1881771800595444193 Biopic] (7 minutes)
 +
** [https://x.com/misslaidlaw/status/1882180619582791784 Give It To Me] (music video)
 +
** [https://x.com/paultrillo/status/1882091702506459394 Where do we go from here?] (music video, Veo 2)
 +
** [https://x.com/WorldEverett/status/1882235057076580502 Party like there's no tomorrow] (music video)
 +
** [https://x.com/Diesol/status/1884696027942498779 S.T.O.R.I.] (Midjourney and Pika 2.1)
 +
====February 2025====
 +
* February 2025: Examples:
 +
** [https://x.com/OrctonAI/status/1885839287913955597 Long Steampunk scene]
 +
** [https://x.com/jerrod_lew/status/1885787580685562226 City destruction]
 +
** [https://x.com/EHuanglu/status/1885736840344551763 Consistent character acting]
 +
** [https://x.com/MeanOrangeCat/status/1884295241534185890 Kaiju Katastrophe] (by [https://x.com/MeanOrangeCat Mean Orange Cat])
 +
** [https://x.com/Diesol/status/1886433799690748210 The Greyhound]
 +
** [https://x.com/CoffeeVectors/status/1886146242029195391 Fluid simulation video2video]
 +
** [https://x.com/toolstelegraph/status/1886622772828254403 High resolution macro shots]
 +
** [https://www.youtube.com/watch?v=p0J1LDWERS0 Chrysalids]
 +
** [https://x.com/multimodalart/status/1887817996220940737 Boring realistic images] (HunyuanVideo w/ LoRA)
 +
** [https://www.youtube.com/watch?v=PcVRfa1JyyQ Anime intro] ([https://www.reddit.com/r/StableDiffusion/comments/1ijvua0/opensource_almostconsistent_real_anime_made_with/ Hunyuan w/ custom LoRAs])
 +
** [https://x.com/AllarHaltsonen/status/1888294811750318114 Automotive ad test] (Kling w/ custom model)
 +
** [https://x.com/AngryTomtweets/status/1888758524303269928 Random cinematic clips] (Midjourney and Kling)
 +
** [https://x.com/juliewdesign_/status/1888666757302263828 Crossing Paths]
 +
** [https://x.com/weirdai_art/status/1888794894187041200 Miniature food]
 +
** [https://x.com/CaptainHaHaa/status/1889573017745035463 Animals]
 +
** [https://x.com/Kavanthekid/status/1889371011667144724 Star Wars - The Ghost's Apprentice (Fan Film)]
 +
** [https://x.com/AngryTomtweets/status/1889768184716423573 Ray2 image-to-video examples]
 +
** [https://x.com/weirdai_art/status/1889890470987518069 New Horizons] (miniatures going to Mars)
 +
** [https://x.com/karim_yourself/status/1890100168378536155 Black Sun (trailer)]
 +
** [https://x.com/BrivaelLp/status/1890122101153231288 AI avatars] ([https://www.argil.ai/ Argil AI])
 +
** [https://x.com/mrjonfinger/status/1890783411679236473 Adding elements to real video] ([https://x.com/mrjonfinger/status/1891337081923772918 other example])
 +
** [https://x.com/SynthReveries/status/1892278954137940289 Glitch]
 +
** Anime: [https://x.com/freeeebird2300/status/1889119007707689146 sci-fi] (Ray2), [https://x.com/Artedeingenio/status/1891173784188756069 sci-fi] (Ray 2), [https://x.com/seiiiiiiiiiiru/status/1890980673743474931 90s sci-fi] (Luma) and [https://x.com/TomLikesRobots/status/1891209369804591447 moody] (Midjourney and Ray2)
 +
* February 2025: Meta [https://hila-chefer.github.io/videojam-paper.github.io/ VideoJAM]
 +
* February 2025: ByteDance [https://omnihuman-lab.github.io/ OmniHuman-1]
 +
* February 2025: ByteDance [https://saiyan-world.github.io/goku/ Goku] ([https://arxiv.org/abs/2502.04896 paper], [https://x.com/ai_for_success/status/1888821141495844991 examples])
 +
* February 2025: [https://huggingface.co/stepfun-ai/stepvideo-t2v Step-Video-T2V] open-source model ([https://arxiv.org/abs/2502.10248 paper], [https://github.com/stepfun-ai/Step-Video-T2V code], [https://yuewen.cn/videos demo], [https://x.com/ai_for_success/status/1891369136082854129 examples])
 +
* February 2025: Pika [https://x.com/pika_labs/status/1892620122818294109 Pikaswaps] (examples of [https://x.com/FreddyChavezO/status/1892678426487881805 modifying regions], [https://x.com/CharaspowerAI/status/1893216710141919637 swapping items])
 +
* February 2025: Alibaba [https://wanai.pro/ Wan 2.1] [https://huggingface.co/blog/LLMhacker/wanai-wan21 open-source] ([https://x.com/fofrAI/status/1894862403260596371 examples])
 +
* February 2025: [https://thetwinai.com/ Twin AI]: compose videos with provided character, object, location ([https://x.com/EHuanglu/status/1901277394729930984 example])
 +
* February 2025: Examples:
 +
** [https://x.com/mrjonfinger/status/1893109598627750164 Infected] (Pika swaps and additions)
 +
** [https://x.com/amli_art/status/1893447314913796253 Hostile Government Takeover] (Veo2)
 +
** [https://x.com/KarolineGeorges/status/1895226395812561399 Dual Mechanism] (Pikaframes 2.2)
 +
 +
====March 2025====
 +
* March 2025: Examples:
 +
** [https://x.com/SynthReveries/status/1895826068617252901 Doors] (music video)
 +
** [https://x.com/bind_lux/status/1894492032414224792 Drum and Bass] (music video; Kling, audio from [https://www.riffusion.com/?filter=staff-picks Riffusion])
 +
** [https://x.com/RileyRalmuto/status/1896088776151269523 Woman's face] (Sora)
 +
** [https://x.com/ryanwpatterson/status/1896968881731948844 Skating] (Ray2)
 +
** [https://www.threads.net/@evolving.ai/post/DGlRyRoO7c9?xmt=AQGz6T_8VppPoAqb5aPwAJ2zzRLUP-YXi8SabAT0IIEA9Q Filming commercial on Mars]
 +
** [https://www.threads.net/@evolving.ai/post/DGycqyhuETS?xmt=AQGz6T_8VppPoAqb5aPwAJ2zzRLUP-YXi8SabAT0IIEA9Q Original Source commercial] (AI and real footage)
 +
** [https://x.com/maxescu/status/1896926229204496788 Time-lapses] (Pika 2.2)
 +
** [https://www.youtube.com/watch?v=2RhkcJyhg0E Hallucination]
 +
** [https://x.com/town_in_new/status/1897354572139782620 Macro video of bubbles]
 +
* March 2025: [https://github.com/Tencent/HunyuanVideo-I2V HunyuanVideo-I2V] image-to-video
 +
* March 2025: Google [https://x.com/labsdotgoogle/status/1897376700666626233 Whisk Animate] (based on Veo2, [https://x.com/maxescu/status/1902742535618888025 examples])
 +
* March 2025: Examples:
 +
** [https://x.com/jdp2oo/status/1897874927367160114 Recursion (horror)] (Kling)
 +
** [https://x.com/blizaine/status/1897826177970028614 Will Smith Eating Spaghetti while Sitting Inside a Bag] (c.f. [https://www.youtube.com/watch?v=XQr4Xklqzw8 April 2023], [https://x.com/kimmonismus/status/1873568693357294014 December 2024], [https://x.com/_deepfates/status/1875215969452523785 January 2025])
 +
** [https://x.com/mickmumpitz/status/1897979382687297697 Paper Jam] (Kling with custom workflows to enable precise control)
 +
** [https://x.com/maxescu/status/1899155936645722216 Cinematic shots] (Google Whisk and Luma)
 +
** [https://x.com/weirdai_art/status/1899631013002711409 Perfunctory Horizons]
 +
** [https://x.com/maxescu/status/1900243840499368319 A Hard Winter]
 +
** [https://x.com/RoyalKongz/status/1900315389139014074 Consistent character example]
 +
** [https://x.com/maxescu/status/1900652266362650853 Anthropomorphic Animals]
 +
** [https://x.com/kimmonismus/status/1900457543299727718 Realistic (influencer-style)]
 +
** [https://x.com/SunoMusic/status/1900942410584043579 I Feel Cultured] (music video with surrealist vibes)
 +
** [https://rodeo.club/post/0x30b45c56d62751D763D3B8bFe4D18c4BB65EDF2c/209 journey of utmost importance]
 +
** [https://x.com/aiordieshow/status/1901930851127984291 Karen: Unleashed]
 +
** [https://x.com/minchoi/status/1901783767364092232 Yarn Cat]
 +
** [https://x.com/andyorsow/status/1901619535180091509 Ned's Wet Deli] (Runway)
 +
** [https://www.youtube.com/watch?v=KVoiooE8C0c BOOTS], a.k.a. [https://x.com/RuairiRobinson/status/1902027217137484117 "Our enemies are cartoon monsters"] (music video based on poem by Rudyard Kipling; Veo2)
 +
** Flying in a dream: [https://x.com/minchoi/status/1902197944826183864 1], [https://x.com/venturetwins/status/1901796679063626060 2]
 +
** [https://x.com/jasonzada/status/1902129567659389443 Commercial for Mercedes-Benz and FYI Radio]
 +
** [https://x.com/maxescu/status/1903108496666542562 Selfie video] (Luma)
 +
** Podcasts: [https://www.reddit.com/r/singularity/comments/1jintit/rottenly_roasted_now_full_script_is_also_not/ Rottenly Roasted] and [https://www.reddit.com/r/aivideo/comments/1jerh56/worst_date_ever/ Worst Date Ever] [https://x.com/OriZilbershtein/status/1903503438744318002 (Imagen 3, Hedra, Elevenlabs, Topaz)]
 +
** [https://x.com/DexploreArts/status/1903822122150986000 Ambience] (Midjourney, Luma)
 +
** [https://x.com/TheoMediaAI/status/1904207679511572845 The Bridge] (2 minute short; Veo2)
 +
** [https://x.com/peteromallet/status/1904268944992829462 Pulp Fiction] (Wan video editing)
 +
** [https://x.com/madpencil_/status/1906765750624493650 Camera Controls] (Luma Ray2)
 +
* March 2025: [https://www.hedra.com/ Hedra] [https://x.com/hedra_labs/status/1897699010632466469 Character 3]
 +
* March 2025: [https://huggingface.co/hpcai-tech/Open-Sora-v2 Open Sora v2] ([https://github.com/hpcaitech/Open-Sora code])
 +
* March 2025: Amazon Prime debuts [https://en.wikipedia.org/wiki/House_of_David_(TV_series) House of David], with special effects created by [https://www.thewonderproject.com/ Wonder Project] using a [https://x.com/PJaccetturo/status/1903126616831676792 combination of traditional and AI methods] (reportedly including Midjourney and Runway)
 +
* March 2025: Examples:
 +
** [https://x.com/PJaccetturo/status/1905151190872309907 What if Studio Ghibli directed Lord of the Rings?] (OpenAI GPT-4o in-context image generation, Kling)
 +
** [https://x.com/ROHKI/status/1906039022662963269 RŌHKI]
 +
** [https://x.com/iaveras/status/1906362437487534296 Why]
 +
** [https://x.com/BrianRoemmele/status/1906476721236570508 Commercial for Puma] (research/test)
 +
** [https://x.com/Salmaaboukarr/status/1906776503343325469 Commercial for KFC] (concept ad)
 +
* March 2025: Runway ML [https://runwayml.com/research/introducing-runway-gen-4 Gen-4]
 +
** [https://www.youtube.com/watch?v=c8IBmK7GZP8 The Lonely Little Flame]
 +
** [https://www.youtube.com/watch?v=Z0P6qjMUl34&t=1s The Herd]
 +
** [https://www.youtube.com/watch?v=9HzdNhOe09I The Retrieval]
 +
** [https://www.youtube.com/watch?v=xEhgxhrAjE4 NYC is a Zoo]
 +
** [https://www.youtube.com/watch?v=ENGKp5wn344 Scimmia Vede] (music video)
 +
** More examples: [https://x.com/techhalla/status/1906807994009993473 various], [https://x.com/c_valenzuelab/status/1907958530369372541 art direction], [https://x.com/c_valenzuelab/status/1908146364741029998 mannequins], [https://x.com/c_valenzuelab/status/1907921566643732612 taxi], [https://x.com/c_valenzuelab/status/1907432109695717798 small things], [https://x.com/c_valenzuelab/status/1907563448902496362 long shot (1m)]
 +
 +
====April 2025====
 +
* April 2025: Examples:
 +
** [https://x.com/AzeAlter/status/1906974768705990794 Age of Beyond]
 +
** [https://x.com/techhalla/status/1907790675057242319 Commercial for Coca-Cola] (Higgsfield)
 +
** [https://www.reddit.com/r/StableDiffusion/comments/1jr6j11/comment/mle9bq5/?context=3 Anime scene (3m)] (Wan 2.1 with LoRa)
 +
** [https://x.com/pika_labs/status/1908263310912610401 Taxes then Death] (Pika multikeyframe)
 +
* April 2025: [https://www.krea.ai/ Krea] [https://x.com/krea_ai/status/1907829389452021853 Video Re-Style]
 +
* April 2025: ByteDance [https://grisoon.github.io/DreamActor-M1/ DreamActor-M1] performance transfer
 +
* April 2025: Examples:
 +
** [https://x.com/Diesol/status/1908535493673050403 Mercs] (Midjourney v7, Ray2)
 +
** [https://x.com/minchoi/status/1909078846126649440 Cat at theme park]
 +
** [https://x.com/c_valenzuelab/status/1909630883218207036 Timelapse history] (Runway Gen4)
 +
** [https://x.com/EHuanglu/status/1909660808973533225 Examples for use in advertising]
 +
** [https://x.com/arohaAIX/status/1910688361221599361 Sci-fi scapes]
 +
** [https://x.com/PJaccetturo/status/1910750148055146708 Avα]
 +
** [https://x.com/imagineFERA/status/1910601934207152576 The Bureau]
 +
** [https://x.com/jasonzada/status/1911812014059733041 Beaver and Sock (3m)]
 +
** [https://x.com/Delachica_/status/1911842237622735052 Organic Waste (5m)] (Runway)
 +
** [https://x.com/c_valenzuelab/status/1912260798270882104 Fly] (Runway Gen4)
 +
* April 2025: Alibaba [https://arxiv.org/abs/2504.04842 FantasyTalking] lipsync ([https://arxiv.org/abs/2504.04842 paper], [https://x.com/EHuanglu/status/1910341110322577442 examples])
 +
* April 2025: Tencent Hunyuan [https://arxiv.org/abs/2411.16331 Sonic] image animation/lipsync to audio ([https://x.com/ai_for_success/status/1911719866958286864 examples])
 +
* April 2025: ByteDance [https://huggingface.co/papers/2504.08685 Seaweed-7B] ([https://arxiv.org/abs/2504.08685 preprint], [https://www.youtube.com/watch?v=OaPI6K2y3rI examples])
 +
* April 2025: [https://app.klingai.com/global/release-notes Kling 2.0] ([https://www.youtube.com/watch?v=Yqvh3M12T_M video])
 +
* April 2025: [https://www.skyreels.ai/home Skyworks] [https://github.com/SkyworkAI/SkyReels-V2 SkyReels V2] (open-source, unlimited extension; [https://x.com/AngryTomtweets/status/1914270477482443142 examples])
 +
* April 2025: [https://sand.ai/ Sand AI] [https://huggingface.co/sand-ai/MAGI-1 Magi-1] (open source, unlimited extension; [https://x.com/AngryTomtweets/status/1914318743578296506 examples], [https://x.com/dreamingtulpa/status/1916035289300275372 more examples])
 +
* April 2025: Examples:
 +
** [https://x.com/maxescu/status/1912100029549994016 Mars 2035 (3m)] (Kling 2.0)
 +
** [https://x.com/ai_for_success/status/1912466999147450600 Kingdom (dragon battle, 3m)]
 +
** [https://x.com/imagineFERA/status/1913156296657756278 Reflection (3m)] (Gen4)
 +
** [https://x.com/Wytsekoetse/status/1913547157493162035 Pizza Galaxy (1m)] (MJ and Gen4)
 +
** [https://www.youtube.com/watch?v=rseqmSGH7xk Snoop Dogg music video: Last Dance with Mary Jane] (blend of traditional and AI effects)
 +
** [https://x.com/dreamingtulpa/status/1915104310448501129 Realistic human motion]
 +
** [https://x.com/KarolineGeorges/status/1915113151546396893 Inception loop] (Gen4)
 +
** [https://x.com/rayisdoingfilm/status/1916468807435952330 Tuesday (1m)] (Gen4)
 +
** [https://www.youtube.com/watch?v=XWdwF1q3kDw Deus in Machina Automata (4m)] (Gen4)
 +
** [https://x.com/machina9000/status/1915090908850049223 Outsiders (3m music video)]
 +
 +
====May 2025====
 +
* May 2025: [https://huggingface.co/Lightricks/LTX-Video LTX-Video 13B] ([https://github.com/Lightricks/LTX-Video  code], [https://x.com/maxescu/status/1919801813987164527 examples], [https://x.com/cubiq/status/1919748210567815551 more examples])
 +
* May 2025: HeyGen Avatar IV (examples: [https://x.com/StevieMac03/status/1919910677860216869 sci-fi], [https://x.com/KarolineGeorges/status/1919801983143211222 Come Closer], [https://x.com/maxescu/status/1920410329454100973 singing], [https://x.com/minchoi/status/1920853859171234165 various])
 +
* May 2025: Tencent [https://hunyuancustom.github.io/ HunyuanCustom]
 +
* May 2025: Examples:
 +
** [https://x.com/lifeofc/status/1920331476157280413 Iris (1.5m)] (Midjourney, Luma, Runway)
 +
** [https://runwayml.com/customers/the-making-of-mars-and-siv Mars and Siv: "No Vacancy" (episode 1, 6m)] (Runway)
 +
** [https://x.com/cfryant/status/1921317318744760817 Go to the East Wing] (Luma)
 +
** [https://x.com/DeryaTR_/status/1921015340827304389 Yu Lanter showreel] (Higgsfield)
 +
** [https://x.com/freeeebird2300/status/1921789387614134652 Cyberpunk anime] (Luma)
 +
** [https://x.com/LittleTinRobot/status/1921692735930589246 Alien animals] (Runway)
 +
* May 2025: [https://runwayml.com/gen48 Gen:48] Fourth Edition winners:
 +
** [https://www.youtube.com/watch?v=NphCYRXjqTI&t=174s Home] (3m)
 +
** [https://www.youtube.com/watch?v=L2DQwCp_DCw The King's Secret] (2m)

Revision as of 09:35, 12 May 2025

Evolution of Capabilities

Early

2023

2024

Early 2024

August 2024

September 2024

October 2024

November 2024

December 2024

2025

January 2025

February 2025

March 2025

April 2025

May 2025

Retrieved from "http://gisaxs.com/index.php?title=AI_video&oldid=7759"