All the models I’ve used that do TTS/RVC and rotoscoping have definitely not produced professional results.
Comment on 77% Of Employees Report AI Has Increased Workloads And Hampered Productivity, Study Finds
Hackworth@lemmy.world 3 months agoVoiceover recording, noise reduction, rotoscoping, motion tracking, matte painting, transcription - and there’s a clear path forward to automate rough cuts and integrate all that with digital asset management. I used to do all of those things manually/practically.
WalnutLum@lemmy.ml 3 months ago
Hackworth@lemmy.world 3 months ago
PEBKAC, I’m afraid.
WalnutLum@lemmy.ml 3 months ago
Coqui for TTS, RVC UI for matching the TTS to the actor’s intonation, and DWPose -> controlnet applied to SDXL for rotoscoping
Hackworth@lemmy.world 3 months ago
Full open source, nice! I respect the effort that went into that implementation. I pretty much exclusively use 11 Labs for TTS/RVC, turn up the style, turn down the stability, generate a few, and pick the best. I do find that longer generations tend to lose the thread, so it’s better to batch smaller script segments.
Unless I misunderstand ya, your controlnet setup is for what would be rigging and animation rather than roto. I do agree that while I enjoy the outputs of pretty much all the automated animators, they’re not ready for prime time yet. Although I’m about to dive into KREA’s new key framing feature and see if that’s any better for that use case.
aesthelete@lemmy.world 3 months ago
They’re right IMO. Practical effects still look and age better than very obvious digital effects. Oh and digital deaging looks like crap. But with what you’re talking about here, that’s always going to remain an opinion battle anyway, because quantifying “artistry” is in and of itself a fool’s errand.
Hackworth@lemmy.world 3 months ago
Digital video, not digital effects - I mean the guys I went to film school with that refused to touch digital videography.