World first: brain implant lets man speak with expression ― and sing, Device translates thought to speech in real time.

Comments

• partial_accumen@lemmy.world ⁨1⁩ ⁨week⁩ ago

  Study co-author Maitreyee Wairagkar, a neuroscientist at the University of California, Davis, and her colleagues trained deep-learning algorithms to capture the signals in his brain every 10 milliseconds. Their system decodes, in real time, the sounds the man attempts to produce rather than his intended words or the constituent phonemes — the subunits of speech that form spoken words.

  This is a really cool approach. They’re not having to determine speech meaning, but instead picking up signals after the person’s brain has already done that part and is just trying to vocalize. I’m guessing they can capture nerve impulses that would be moving muscles in the face, mouth, lips, and possibly larynx and then using the AI to quickly determine which sounds that would produce in those few milliseconds those conditions exist. Then the machine to produces the sounds artificially. Because they’re able to do this so fast (in 10 milliseconds) it can get close to human body response and reproduction of the specific sounds.

  source
• shalafi@lemmy.world ⁨1⁩ ⁨week⁩ ago

  This is nothing short of stunning, had no idea anyone was even close to this sort of interface. And it’s only an 8-bit input! Fuck me, I would have made a (totally ignorant) guess of at least a couple of thousand sensors.

  Hoped for a video. :(

  source
• Fizz@lemmy.nz ⁨1⁩ ⁨week⁩ ago

  This is exciting and terrifying. I am NOT looking forward to the future anymore.

  source
• Lost_My_Mind@lemmy.world ⁨1⁩ ⁨week⁩ ago

  Ok…that’s a bit scary for me.

  source