It is the first iteration of this technology, things will only improve the more we use it.
That it can do still images is already infinitely more impressive than not being able to do it at all.
Comment on Could we use AI to update 4:3 media to 16:9?
nul@programming.dev 8 months agoThe video seems a bit misleading in this context. It looks fine for what it is, but I don’t think they have accomplished what OP is describing. They’ve cherrypicked some still shots, used AI to add to the top and bottom of a individual frames, and then gave the shot a slight zoom to create the illusion of motion.
I don’t think the person who made the content was trying to be disingenuous, just pointing out that we’re still a long ways from convincingly filling in missing data like this for videos where the AI has to understand things like camera moves and object permanence. Still cool, though.
Honytawk@lemmy.zip 8 months ago
Crul@lemm.ee 8 months ago
Great points. I agree.
A proper working implementation for the general case is still far ahead and it would be much complex than this experiment. Not only it will need the usual frame-to-frame temporal coherence, but it will probably need to take into account info from potentially any frame in the whole video in order to be consistent with different camera angles of the same place.