Difference between revisions of "AI video"
KevinYager (talk | contribs) (→Evolution of Capabilities) |
KevinYager (talk | contribs) (→Evolution of Capabilities) |
||
| (6 intermediate revisions by the same user not shown) | |||
| Line 57: | Line 57: | ||
** Short: [https://x.com/dreamingtulpa/status/1836121321526432231 Neon Nights] (Arcade) | ** Short: [https://x.com/dreamingtulpa/status/1836121321526432231 Neon Nights] (Arcade) | ||
** [https://www.youtube.com/watch?v=CcrGSA-kSrI Random Access Memories]: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage | ** [https://www.youtube.com/watch?v=CcrGSA-kSrI Random Access Memories]: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage | ||
| + | ** Sora used to make a sort of [https://x.com/niceaunties/status/1837271244774715505 weird dreamlike video] | ||
| + | * October 2024: Pika v1.5, including Pikaffects (explode, melt, inflate, and cake-ify; examples: [https://x.com/justin_hart/status/1841144350572413259 1], [https://x.com/arthur_hyper88/status/1841156544538521646 2], [https://x.com/ytjessie_/status/1841168925301842263 3], [https://x.com/bilawalsidhu/status/1841195247184781420 4], [https://x.com/minchoi/status/1841189035454447636 5], [https://x.com/ytjessie_/status/1841209415514669501 6]) | ||
| + | * October 2024: Examples: | ||
| + | ** [https://x.com/HalimAlrasihi/status/1839310216602788103 AI avatar with good lip-sync] | ||
| + | ** [https://www.youtube.com/watch?v=5NZubOOeeV0 Battalion]: 5 minute short about war | ||
| + | ** Short film: [https://x.com/MatthieuGB/status/1841173724688536015 To Wonderland] ([https://x.com/MatthieuGB/status/1841174221550207437 credits]) | ||
| + | ** [https://x.com/OnwardsProject/status/1841508441241890975 9 to 5]: Created with Luma Dream Machine keyframes and camera features; music by Suno | ||
| + | * October 2024: [https://ai.meta.com/research/movie-gen/ Meta Movie Gen] | ||
| + | * October 2024: Examples: | ||
| + | ** [https://x.com/CuriousRefuge/status/1844424871335592373 AI Avatar] (using [https://x.com/CuriousRefuge/status/1844424871335592373 HeyGen]) | ||
| + | ** [https://www.youtube.com/watch?v=isW1FLL0K3w Generic Movies] | ||
| + | ** [https://arxiv.org/abs/2410.05954 Pyramid-flow] ([https://huggingface.co/rain1011/pyramid-flow-sd3 open source]) model: [https://x.com/_akhaliq/status/1844239643778351605 examples] | ||
| + | ** [https://x.com/whrumorvid/status/1846209247467491604 Building the Pyramids] | ||
| + | ** [https://x.com/maxescu/status/1844716998854349217 People showing realistic emotion] (using [https://hailuoai.video/ Hailuo AI]) | ||
| + | ** Keyframes and Luma AI to make novel [https://x.com/CoffeeVectors/status/1845188179332051005 speed-ramp motion] | ||
| + | * October 2024: [https://www.genmo.ai/ Genmo] [https://x.com/genmoai/status/1848762405779574990 Mochi 1] (open source) | ||
| + | * October 2024: Examples: | ||
| + | ** [https://x.com/AIatMeta/status/1849134463382680028 Meta Movie Gen examples] | ||
| + | ** [https://x.com/PJaccetturo/status/1847732127598800960 Emotional range of Minimax] | ||
| + | ** [https://x.com/dustinhollywood/status/1848757800807039299 Car commercial: Bear] | ||
| + | ** [https://x.com/runwayml/status/1848785913918218517 Diner conversation] | ||
| + | ** [https://x.com/Uncanny_Harry/status/1849275871716159989 Loved and Lost] (a meditation on grief) | ||
| + | * November 2024: Examples: | ||
| + | ** [https://x.com/blizaine/status/1852092147643699356 Pasta Doble] | ||
| + | ** [https://x.com/kimmonismus/status/1852425015175626876 Bird protecting young] | ||
| + | ** [https://x.com/runwayml/status/1852363190484537666 Camera moving around sushi] | ||
| + | ** [https://x.com/StevieMac03/status/1851969120813629939 Various examples] of [https://hailuoai.video/ Hailuo AI] | ||
| + | ** [https://x.com/kimmonismus/status/1853102779650252978 Trains] | ||
| + | ** [https://www.youtube.com/watch?v=Fh-_g5vev0s Light of Imagination] | ||
| + | ** [https://x.com/LinusEkenstam/status/1854087441122021814 Bringing historic images to life] | ||
| + | ** [https://x.com/DeryaTR_/status/1855637066203218180 Plants dancing] | ||
| + | ** [https://x.com/c_valenzuelab/status/1855078644042944574 Insect on tree] | ||
| + | ** Trailers for [https://x.com/abandonedmovies/status/1827037378009296983 The Silmarillion] and [https://x.com/abandonedmovies/status/1846941183702110211 The Fall of Gondolin] (by [https://x.com/abandonedmovies Abandoned Films]) | ||
| + | ** [https://x.com/Diesol/status/1855475704470884427 Moody sci-fi] | ||
| + | ** [https://x.com/runwayml/status/1857072173631885586 Migration] ([https://runwayml.com/customers/behind-the-scenes-of-migration-with-director-jeremy-higgins made by combining] Runway ML Gen3-Alpha and traditional animation) | ||
| + | ** [https://x.com/AIandDesign/status/1856467856625676752 After the Winter] ([https://suno.com/song/0d6919de-d2bf-434b-8aa6-ede0fb0fde77 music] made using Suno v4) | ||
| + | ** Horror: [https://www.reddit.com/r/aivideo/comments/1gnk27q/ridge_to_southwest/ Ridge to Southwest] | ||
| + | ** [https://www.youtube.com/watch?v=ClStJZmIjBU The Gardener] (by [https://www.youtube.com/@MachineMythos Machine Mythos]) | ||
| + | ** [https://x.com/techhalla/status/1857462526859935813 Coca-Cola holiday ad] and [https://www.youtube.com/watch?v=THdoOgwqjBg parody thereof] | ||
| + | ** [https://x.com/pzf_ai/status/1858312421510992111 A Dream Within A Dream] (by [https://x.com/pzf_ai PZF], selected for the Czech International AI Film Festival) | ||
| + | ** [https://x.com/WorldEverett/status/1859273222597775843 Making Friends] (by [https://x.com/WorldEverett Everett World]; see also [https://x.com/WorldEverett/status/1858563716834275562 Childhood Dream] and [https://x.com/WorldEverett/status/1858945634067202429 City Echoes]) | ||
| + | ** Anime: [https://x.com/naegiko/status/1857754626742726893 test shots], [https://x.com/naegiko/status/1858978557424210401 Ultimate Ceremony], [https://x.com/naegiko/status/1835434668294074462 Echoes of Love] | ||
| + | ** [https://x.com/KakuDrop/status/1859387013054726510 Echoes of Grace] ([https://x.com/KakuDrop KakuDrop] using Sora) | ||
| + | ** [https://x.com/vibeke_udart/status/1859879367071203662 Morphing hands], [https://x.com/vibeke_udart/status/1858772719224975630 hands and faces] ([https://x.com/vibeke_udart Vibeke Bertelsen]) | ||
| + | ** [https://www.reddit.com/r/aivideo/comments/1gxi29x/dbzlicious/ Dragon Ball Z live action] | ||
| + | ** [https://x.com/cfryant/status/1860727980353278386 Pitch Black] (abstract and dark) | ||
| + | ** [https://x.com/cfryant/status/1861050528932765710 Animals Running] (zoomed-in ultra-wide camera) | ||
| + | ** [https://x.com/WorldEverett/status/1860730214487118290 Dreams of Tomorrow] (panning shots of high-tech car, Scottish manor) | ||
| + | ** [https://x.com/rowancheung/status/1861455031603503234 Examples] from the [https://huggingface.co/spaces/PR-Puppets/PR-Puppet-Sora leaked] Sora turbo model. | ||
Latest revision as of 14:59, 26 November 2024
Evolution of Capabilities
- Nov 2016: Sync-Draw
- April 2021: GODIVA
- Oct 2022: Meta Make-a-video
- Oct 2022: Google Imagen video
- April 2023: Will Smith eating spaghetti
- April 2023: Runway Gen 2
- April 2023: Nvidia latents
- December 2023: Fei-Fei Li
- January 2024: Google VideoPoet
- January 2024: Google Lumiere
- February 2024: OpenAI Sora
- April 2024: Vidu
- May 2024: Veo
- May 2024: Kling
- June 2024: Luma DreamMachine
- June 2024: RunwayML Gen-3 Alpha
- July 2024: Examples:
- July 2024: haiper.ai
- August 2024: Hotshot (examples, more examples)
- August 2024: Luma Dream Machine v1.5
- August 2024: Examples:
- Runway Gen3 music video
- Runway Gen3 for adding FX to live action (another example)
- Midjourney + Runway Gen3: Hey It’s Snowing
- Flux/LoRA image + Runway Gen3 woman presenter
- McDonald’s AI commercial
- Sora used by Izanami AI Art to create dreamlike video and by Alexia Adana to create sci-fi film concept
- September 2024: Hailuo Minimax (examples)
- September 2024: Examples:
- Space colonization
- Consistent characters
- Sea monsters
- Music video
- Animated characters
- AI influencer
- Ten short examples
- Seven examples
- Clip from horror film
- "Gone" featuring astronaut and something ethereal
- Two dancers (surprisingly good consistency despite movement)
- Music video about flying
- The Paperclip Maximizer
- La Baie Aréa
- "To Dear Me" by Gisele Tong (winner of AI shorts film festival)
- Various scenes
- Directing emotions
- September 2024: Kling 1.5 (examples, showing emotions)
- September 2024: Examples:
- Runway video-to-video to restyle classic video games
- Realistic presenter
- Skateboarding (demonstrates getting closer to meaningfully simulating motion/physics)
- Examples of short clips with cinematic feel
- Short: 4 Minutes to Live
- Short: Neon Nights (Arcade)
- Random Access Memories: AI-generated, but then projected onto Kodak film stock. Gives the final output some of the dreamy analog quality we associate with nostalgic footage
- Sora used to make a sort of weird dreamlike video
- October 2024: Pika v1.5, including Pikaffects (explode, melt, inflate, and cake-ify; examples: 1, 2, 3, 4, 5, 6)
- October 2024: Examples:
- AI avatar with good lip-sync
- Battalion: 5 minute short about war
- Short film: To Wonderland (credits)
- 9 to 5: Created with Luma Dream Machine keyframes and camera features; music by Suno
- October 2024: Meta Movie Gen
- October 2024: Examples:
- AI Avatar (using HeyGen)
- Generic Movies
- Pyramid-flow (open source) model: examples
- Building the Pyramids
- People showing realistic emotion (using Hailuo AI)
- Keyframes and Luma AI to make novel speed-ramp motion
- October 2024: Genmo Mochi 1 (open source)
- October 2024: Examples:
- Meta Movie Gen examples
- Emotional range of Minimax
- Car commercial: Bear
- Diner conversation
- Loved and Lost (a meditation on grief)
- November 2024: Examples:
- Pasta Doble
- Bird protecting young
- Camera moving around sushi
- Various examples of Hailuo AI
- Trains
- Light of Imagination
- Bringing historic images to life
- Plants dancing
- Insect on tree
- Trailers for The Silmarillion and The Fall of Gondolin (by Abandoned Films)
- Moody sci-fi
- Migration (made by combining Runway ML Gen3-Alpha and traditional animation)
- After the Winter (music made using Suno v4)
- Horror: Ridge to Southwest
- The Gardener (by Machine Mythos)
- Coca-Cola holiday ad and parody thereof
- A Dream Within A Dream (by PZF, selected for the Czech International AI Film Festival)
- Making Friends (by Everett World; see also Childhood Dream and City Echoes)
- Anime: test shots, Ultimate Ceremony, Echoes of Love
- Echoes of Grace (KakuDrop using Sora)
- Morphing hands, hands and faces (Vibeke Bertelsen)
- Dragon Ball Z live action
- Pitch Black (abstract and dark)
- Animals Running (zoomed-in ultra-wide camera)
- Dreams of Tomorrow (panning shots of high-tech car, Scottish manor)
- Examples from the leaked Sora turbo model.
