Comment on OpenAI introduces Sora, its text-to-video AI model

sleepmode@lemmy.world ⁨9⁩ ⁨months⁩ ago

• Carighan@lemmy.world ⁨9⁩ ⁨months⁩ ago

  The example videos are both impressive (insofar that they exist) and dreadful. Two-legged horses everywhere, lots of random half-human-half-horse hybrids, walls change materials constantly, etc.

  It really feels like all this does is generate 60 DALL-E images per second and little else.

  source

  • archomrade@midwest.social ⁨9⁩ ⁨months⁩ ago

    For the limitations visual AI tends to have, this is still better than what I’ve seen. Objects and subjects seem pretty stable from Frame to Frame, even if those objects are quite nightmarish

    I think “will Smith eating spaghetti” was only like a year ago

    source
  • Natanael@slrpnk.net ⁨9⁩ ⁨months⁩ ago

    This would work very well with a text adventure game, though. A lot of them are already set in fantasy worlds with cosmic horrors everywhere, so this would fit well to animate what’s happening in the game

    source
  • Theharpyeagle@lemmy.world ⁨9⁩ ⁨months⁩ ago

    I mean, it took a couple months for AI to mostly figure out that hand situation. Video is, I’d assume, a different beast, but I can’t imagine it won’t improve almost as fast.

    source
  • fidodo@lemmy.world ⁨9⁩ ⁨months⁩ ago

    It will get better, but in the mean time you just manually tell the AI to try again or adjust your prompt. I don’t get the negativity about it not being perfect right off the bat. When the magic wand tool originally came out, it had tons of jagged edges. That didn’t make it useless, it just meant it did a good chunk of the work for you and you just needed to manually get it the rest of the way there. With stable diffusion if I get a bad hand you just inpaint and regenerate it again until it’s fixed. If you don’t get the composition you want, just generate parts of the scene, combine it in an image editor, then have it use it as a base image to generate on top of.

    They’re showing you the raw output to show off the capabilities of the base model. In practice you would review the output and manually fix anything that’s broken. Sure you’ll get people too lazy to even do that, but non lazy people will be able to do really impressive things with this even in its current state.

    source