In my day job I program rigid body behaviour in real time amongst other simulations.
I think rigid body contact is hard to learn as it is inherently discontinuous.. something you discover when trying to code a solver.
As such I always use this prompt as a test:
"A video of a jenga brick tower falling over as a brick is removed. The physics of each brick must be realistic."
It gave me a video of where bricks suddenly disapper or morph into others[1]. The linked video is after 2-3 iterations of me insisting on realistic physics. If you are just glancing at this, you would believe it is realistic.
That said this is still very impressive and one more step towards .. IDK what. But I am a bit reasurred that at least my job won't be fully replaced with AI :)
Such videos are essentially dreams: how it feels that the planks should move, not what equations of rigid body physics would compute. And the feeling is realistic (even if overly dramatic in the end). If "stylistic transfer" works for static pictures spread out in space, why won't it work for the character of motion spread out in time?
At first usage I'm not impressed. I've probably spent a couple grand on Seedance 2 to date, and I can't find anything google omni flash does better than Seedance from running a handful of samples through the system. You can find some of the videos I've made in my HN bio link.
I'm an AI optimist. But AI video is probably the one thing that does depress me. Seeing that we can make anything visually, there's nothing that impresses me visually. I watch a video that two years ago I would've thought was really cool, and now my first thought is, "Yawn, is this AI?".
Video, more than anything else, is the place where I really care if something is AI or not. If I could get a TikTok that had no AI usage -- I'd be in. Which is weird for me, because I'm typically the guy who is all-in on AI.
I tried to watch it, but TikTok kept throwing up a dialog over top asking me to slide a puzzle piece into place. I did three or four before just closing it.
I think the opposite. It allows more people to be creative. Similar to how the DAW allowed more people to become musicians. You can produce a hit song with just a laptop now.
Now you can have people producing videos without needing a crew of people.
For a few weeks, YouTube thought I wanted to see videos of package thieves being surprised by a booby-trapped box that was actually a glitter bomb. Video after video were these AI created shorts of supposed doorbell camera footage showing a thief running away with a box that explodes into a giant pink cloud.
I eventually picked one and opened the comments and the top comment was something like "This is obviously an AI video. Who watches this?" and the reply was along the lines of "me because I like seeing thieves get what's coming to them".
So you, like me, aren't interested in AI videos but I think there's a lot of people who don't care if it's real or not.
Thankfully, YouTube eventually stopped showing those to me. Now it thinks I'm interested in road rage videos. My YouTube feed outside of the three of four channels I've subscribed to is terrible.
I mean if we're just blasting past our climate tipping points anyhow, why not just actively dump entire lakes' worth of water out for people to post slop for clout, right?
May as well power off the whole grid now and have the Amish start teaching us how to survive
So it's really good, and we have reason to believe, never again, anything that happens in a video. Unless there's a super-product somewhere to authenticate footage?
AI is already in a bunch of creative workflows. Just look at modern Photoshop. Selecting and hitting delete has AI infill for the background replacement.
Creates can these video gen AI in various ways. There are some youtube channels of people using these in creative workflows that are really impressive, from mocap replacement, character insertion, background replacement, changing camera angle in post, animating/inserting characters from character boards, animated between stills generated in traditional methods, etc. It's not just "prompt and generate". It can be, because it's easy, but it also doesn't have to be. It's a tool.
i do photo restoration as part of my research (bizarre place to be for a math undergrad), so i do think AI is a lifesaver for very small adjustments that would be tedious or subpar otherwise. i just disagree that its creative output is of value (which isn't the case you made, anyway).
Back in 90s during the first wave of the desktop video revolution when desktop editing became possible and consumer camcorders got pretty good, there was a popular marketing slogan: "Now your imagination is the only limit."
I used to joke that was the moment we discovered "for most people that's a pretty big limit."
In my day job I program rigid body behaviour in real time amongst other simulations. I think rigid body contact is hard to learn as it is inherently discontinuous.. something you discover when trying to code a solver.
As such I always use this prompt as a test: "A video of a jenga brick tower falling over as a brick is removed. The physics of each brick must be realistic."
It gave me a video of where bricks suddenly disapper or morph into others[1]. The linked video is after 2-3 iterations of me insisting on realistic physics. If you are just glancing at this, you would believe it is realistic.
That said this is still very impressive and one more step towards .. IDK what. But I am a bit reasurred that at least my job won't be fully replaced with AI :)
[1] https://streamable.com/2em1r3
Such videos are essentially dreams: how it feels that the planks should move, not what equations of rigid body physics would compute. And the feeling is realistic (even if overly dramatic in the end). If "stylistic transfer" works for static pictures spread out in space, why won't it work for the character of motion spread out in time?
> Prompt: Make it look like the weird shape of my hand hole super zooms and magnifies the ground it's looking at in sharper quality.
There's got to be a reason this is phrased so insanely, right?
Image-search for “hand hole” at your own peril.
At first usage I'm not impressed. I've probably spent a couple grand on Seedance 2 to date, and I can't find anything google omni flash does better than Seedance from running a handful of samples through the system. You can find some of the videos I've made in my HN bio link.
Just curious - are you at all concerned about the legal implications of ai-generating property listing videos?
The legal risk probably lies solely with those who are selling the properties. They are responsible if the video misrepresents anything.
yeah, it's all about keeping everything grounded in reality.
I'm an AI optimist. But AI video is probably the one thing that does depress me. Seeing that we can make anything visually, there's nothing that impresses me visually. I watch a video that two years ago I would've thought was really cool, and now my first thought is, "Yawn, is this AI?".
Video, more than anything else, is the place where I really care if something is AI or not. If I could get a TikTok that had no AI usage -- I'd be in. Which is weird for me, because I'm typically the guy who is all-in on AI.
It ruined the whole category of "cute animals acting goofy" content for sure.
It's not all bad: https://www.tiktok.com/@openchub/video/7641631412407274782
I tried to watch it, but TikTok kept throwing up a dialog over top asking me to slide a puzzle piece into place. I did three or four before just closing it.
I think the opposite. It allows more people to be creative. Similar to how the DAW allowed more people to become musicians. You can produce a hit song with just a laptop now.
Now you can have people producing videos without needing a crew of people.
You never needed a crew of people to make videos. This is just outsourcing people's creativity.
For a few weeks, YouTube thought I wanted to see videos of package thieves being surprised by a booby-trapped box that was actually a glitter bomb. Video after video were these AI created shorts of supposed doorbell camera footage showing a thief running away with a box that explodes into a giant pink cloud.
I eventually picked one and opened the comments and the top comment was something like "This is obviously an AI video. Who watches this?" and the reply was along the lines of "me because I like seeing thieves get what's coming to them".
So you, like me, aren't interested in AI videos but I think there's a lot of people who don't care if it's real or not.
Thankfully, YouTube eventually stopped showing those to me. Now it thinks I'm interested in road rage videos. My YouTube feed outside of the three of four channels I've subscribed to is terrible.
At the bottom there is a "Try in Youtube Shorts" button.
Oh god...
Pure artificial stupidity: https://www.youtube.com/watch?v=aRJH7HKuD2Y
I mean if we're just blasting past our climate tipping points anyhow, why not just actively dump entire lakes' worth of water out for people to post slop for clout, right?
May as well power off the whole grid now and have the Amish start teaching us how to survive
Browser crashes while scrolling because of all the auto playing videos. Please use IntersectionObserver to pause the video when not in display.
Sounds like someone would use LLM to make it and no single human has reviewed
Safari?
It keeps crashing my browser as well. I'm on Microsoft Edge.
Same in Mobile Safari.
blog post: https://blog.google/innovation-and-ai/models-and-research/ge...
model card: https://deepmind.google/models/model-cards/gemini-omni-flash...
> I can create more videos as soon as your limit resets. Check your usage in Settings
I did not create any videos yet.
Google, building great AI that nobody can try out.
But thx for the press release.
Google often does this - they show it off and forget to give it to you.
So it's really good, and we have reason to believe, never again, anything that happens in a video. Unless there's a super-product somewhere to authenticate footage?
I think Hollywood is in for a rough era. The disruption is happening at break neck speeds.
At the moment the duration of each shot is a major limitation. When that limitation gets solved is when we'll see actual disruption.
At one point the only way to know if something is real or by a major US tech company is nudity.
Hollywood is already in a rough era but it’s because they can’t create original human stories any more.
This tech won’t change anything.
Yeah, during most blockbuster movies lately all I can think is: "All pixels, no plot."
Project Hail Mary was largely real sets and a puppet.
you would watch a movie generated with the sterility of an LLM?
Me? No. My kids? I think they already have. I don’t allow YouTube in our house, but they for sure watch slop with friends.
Sure; why not? It has to be better than some of the absolute garbage that's out on the various streaming services today; right?
god help us if we have to choose between the two );
AI is already in a bunch of creative workflows. Just look at modern Photoshop. Selecting and hitting delete has AI infill for the background replacement.
Creates can these video gen AI in various ways. There are some youtube channels of people using these in creative workflows that are really impressive, from mocap replacement, character insertion, background replacement, changing camera angle in post, animating/inserting characters from character boards, animated between stills generated in traditional methods, etc. It's not just "prompt and generate". It can be, because it's easy, but it also doesn't have to be. It's a tool.
i do photo restoration as part of my research (bizarre place to be for a math undergrad), so i do think AI is a lifesaver for very small adjustments that would be tedious or subpar otherwise. i just disagree that its creative output is of value (which isn't the case you made, anyway).
I think Hollywood's obsession with unnecessary sex scenes[0] is the #1 reason I have been watching less and less movies. So yeah, probably.
[0] e.g. Don't Look Up
Who is creative enough to drive this in any meaningful way?
Certainly not me - you have to be a great artist /designer to even imagine what to do with it.
Back in 90s during the first wave of the desktop video revolution when desktop editing became possible and consumer camcorders got pretty good, there was a popular marketing slogan: "Now your imagination is the only limit."
I used to joke that was the moment we discovered "for most people that's a pretty big limit."