Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near “human level robustness and accuracy.”
But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.
Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.
More concerning, they said, is a rush by medical centers to utilize Whisper-based tools to transcribe patients’ consultations with doctors, despite OpenAI’ s warnings that the tool should not be used in “high-risk domains.”
ShittyBeatlesFCPres@lemmy.world 3 weeks ago
Why is generative AI even needed for audio transcription? We’ve had decent voice recognition tools for years even on cheap consumer grade stuff.
spankmonkey@lemmy.world 3 weeks ago
We also used to have decent web searches!
InverseParallax@lemmy.world 3 weeks ago
Because with normal algorithms you have someone to blame.
AI is a trick to hide when you steer the results the way you want.
TheBlackLounge@lemm.ee 3 weeks ago
Whisper really is a lot better when it works, and it’s free. The problem is that it refuses to produce gibberish or give up when it doesn’t work. You’ll always need an editor.
Assman@sh.itjust.works 3 weeks ago
The toaster oven I just invented works much better than a traditional one. It reheats French fries perfectly, you can dehydrate in it, makes succulent roasted chicken, and about 2.5% of the time it burns down your house. You’ll always need to keep an eye on it to make sure that doesn’t happen. Remember though, much better than a traditional one.
wdx@feddit.org 3 weeks ago
This definition of “better” feels like claiming that a Beeper that’s constantly hooked to power is the perfect alarm because it warns you every time someone is trying to break in - while entirely ignoring that it is just constantly blaring.
ayyy@sh.itjust.works 3 weeks ago
No, we really haven’t had on-device voice recognition that meets any definition of “decent”. Anything reasonable phones out to “the cloud” for decent voice recognition.
LavenderDay3544@lemmy.world 3 weeks ago
So? I’d rather have my software talk to a server than be downright wrong just so another business can climb onto the AI bandwagon.
JeeBaiChow@lemmy.world 3 weeks ago
Because AI!