GOOD INTERNET

Share this post

A selection of fine AI-cinema experiments

goodinternet.substack.com

A selection of fine AI-cinema experiments

AI does South Park, The Great Catspy, A Scanner Darkly, Ingmar Bergmans Bloodborne, The Car, meta-shortfilms, experiments and commercials for fake lawyers, imaginary retrotech, cheeseburgers and beer.

May 9, 2023
3
4
Share
Share this post

A selection of fine AI-cinema experiments

goodinternet.substack.com

I like to compare the current state of AI-cinema with the state of movies at the end of the 19th century and Eadweard Muybridges Horse In Motion, which was featured prominently as an iconic piece of film history in Jordan Peeles excellent scifi-mystery Nope.

This is where we are with AI-cinema.

AI cinema is similarly at a stage where we got the images running in motion, but don’t know what it really is. Back then, people who watched the Lumières L'Arrivée d'un train en gare de La Ciotat were convinced that a train would jump out of the screen and run them over. Today, we look at a very weird AI-Will Smith gobbling up Pasta and don’t know what to say.

Runway are state-of-the art for AI-video and released their Gen2 text-to-video-model a month ago. While the results are technically impressive, we are with AI-video roughly in the same spot as with the release of Dall-E 1 two and a half years ago. (Also: 2,5 years for generative AI to go from an obscure and weird glitchy computer-vision-art thing and “tech only known to some nerds“, to “we’re all gonna die, fly airstrikes on rogue datacenters“ is quite an accomplishment in it’s own).

One could argue that we’d see the same improvements on an accelerated timeframe and The Russo Brothers, directors of a bunch of Marvel-movies, in a recent interview already claimed that actual AI-cinema is less than two years away. I think that’s delusional.

Full synthetic movies are at least a decade away, if you define synthetic movies as completely machine generated with humans barely touching them, because video, just like synthetic music, adds a lot of complexity compared to pure images synthesis. Movies need to adhere not only to something like a script/prompt, but also to a story arc that is interesting and features some rythmic dramaturgy with quiet parts and climaxes, not to speak of consistency of characters and visuals on a high quality level. For videos longer than a few seconds these are not easy feats, and it will take a good while to get there.

But for short sequences you can throw together in a video app with some AI-voiceover, it’s already good enough to blow the minds of unsuspecting Marvel-directors — and mine.

Besides from everything Balenciaga, the pizza commercial for Pepperoni Hot Spot was one of the first vids from this latest generation of AI-videos to go viral, and since then, tons of clips popped up everywhere, and some are even pretty good in their weird, mutant AI-way.

So, here’s a somewhat non-random selection of good, new RunwayML-clips as a reference point for the state of AI-cinema and video synthesis. A few of these examples were made by Roope Rainisto about whom i’ve written a bunch of times already and who still delivers some of the best AI-art out there. Others come from Paul Trillo, ChristianF and Ben Nash.

Clips i wish i could show here on the ‘stack but can’t because Elon Musk has no balls:

  • Richard Scarry-esque cut-away animations of SpaceX HQ

  • Death Metal Dogs

  • Gordon Ramsays Superhero-Cooking-Show

  • The Dark Knight-trailer recreated frame by frame.

I tried to only feature video synthesis from RunwayML whichs singular clips were not edited with Photoshop or After Effect, and divided this selection roughly into shortfilms, movies, commercials and experiments.

If there’s an awesome clip or experiment i missed, feel free to add your stuff in the comments below. Enjoy!


Previously about AI-Cinema: If Jodorowsky directed TRON / AI Cinema gonna be wild / A selection of fine AI Cinema-stills (1) / A selection of fine AI Cinema-stills (2) / A selection of fine AI Cinema-stills (3)

Movies


Shortfilms


Commercials


Experiments


GOOD INTERNET is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.


GOOD INTERNET ELSEWHERE // Twitter (Newsletter) / Twitter (Links) / Facebook (Newsletter) / Facebook (Links) / Instagram (Pics and Memes) / Reddit (Links) / Telegram (Links)
SUPPORT // Substack / Patreon / Steady / Ko-Fi / Paypal / Spreadshirt
Musicvideos have their own Newsletter now: GOOD MUSIC. All killers and absolutely zero fillers. The latest issues featuring Foo Fighters, HEALTH, Dorian Electra, Metallica and many more. You can also find all the tracks from all Musicvideos in a Spotify-Playlist.
Subscribe to GOOD INTERNET on Substack or on Patreon or on Steady and feel free to leave a buck or two. If you don’t want to subscribe to anything but still want to send a pizza or two, you can paypal me.
Buy books on Amazon with this link and add me some pennies into my pockets like magic.
You can also buy Shirts and Stickers like a real person.
Thanks.

😶

3
4
Share
Share this post

A selection of fine AI-cinema experiments

goodinternet.substack.com
Previous
Next
4 Comments
Maak
May 9Liked by René Walter

I got another one for you:

https://www.youtube.com/watch?v=8rFfTdu4TEU&ab_channel=MaakBeerranger

<3

Expand full comment
Reply
Maak
May 9Liked by René Walter

Sorry wrong one! Heres my Gen2 vid: The Brain Synth feat. the Aphex TwinS https://www.youtube.com/watch?v=zEd2ETQ83E0&ab_channel=MaakBeerranger

Expand full comment
Reply
2 more comments…
Top
New
Community

No posts

Ready for more?

© 2023 René Walter
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing