Comment on A woman made her AI voice clone say “arse.” Then she got banned.

anamethatisnt@lemmy.world ⁨1⁩ ⁨week⁩ ago

• zueski@lemm.ee ⁨1⁩ ⁨week⁩ ago

  The harm was already done

  source

  • anamethatisnt@lemmy.world ⁨1⁩ ⁨week⁩ ago

    Does that mean that you consider the temporary loss of her voice the same harm as if she would’ve lost access permanently?
    Do keep in mind I do not believe the banning to be ok either - but I’d rather have a company where the human factor sometimes fails that can properly undo their mistake and apologize than something like Meta where you cannot even get in touch with a human if something gets flagged.
    The extreme of a company that never does a mistake would of course be the best but that’s never going to happen.

    I hope for the self hosted solution that @singletona@lemmy.world mentioned to become reality, both for people like Joyce and because it would be a step towards self hosted voice assistants for those of us that refuse to use cloud based ones.

    When I first asked Sophia Noel, a company representative, about the incident, she directed me to the company’s prohibited use policy.

    There are rules against threatening child safety, engaging in illegal behavior, providing medical advice, impersonating others, interfering with elections, and more.
    But there’s nothing specifically about inappropriate language. I asked Noel about this, and she said that Joyce’s remark was most likely interpreted as a threat.

    […]

    Joyce doesn’t hold a grudge—and her experience is far from universal.
    Jules uses the same technology, but he hasn’t received any warnings about his language—even though a comedy routine he performs using his voice clone contains plenty of curse words, says his wife, Maria.
    He opened a recent set by yelling “Fuck you guys!” at the audience—his way of ensuring they don’t give him any pity laughs, he joked.
    That comedy set is even promoted on the ElevenLabs website.

    Blank says language like that used by Joyce is no longer restricted.
    “There is no specific swear ban that I know of,” says Noel.
    That’s just as well.

    source

    • tabular@lemmy.world ⁨6⁩ ⁨days⁩ ago

      The harm this time is indeed less, but the potential for harm is still the same as Meta. There is always the temptation to use power over your SAS users for your own gain. Maybe one day they’re a bigger company who think ‘you know what, maybe it’s better for the company that our users not swear’. Either way lets hope for libre, self-hosted alternatives.

      source
    • singletona@lemmy.world ⁨1⁩ ⁨week⁩ ago

      That they eventually had humans in the loop is great.

      I just don’t like cloud based solutions when it’s something as simple as being able to speak and not sound like stephen hawkings or microsoft sam. Plus in a cloud based ‘solution’ they can always keep transcripts.

      source