Gap's new AI provides disturbing replies

Comments

• boobs_@lemmy.world ⁨20⁩ ⁨hours⁩ ago

  Image

  I really don’t want to make an account so I made use of vxtwitter to get the screenshot from the embed. The bottom of the text window has the mostly cropped text

  These examples are meant to reflect the types of conversations that might occur in a

  It reads like the AI was prompted to give examples of racist behavior and then it gave examples of racist behavior, likely ending with the context that it’s racist behavior at the end of that sentence. I don’t like AI but I don’t think this is it chiefs

  source

  • Denjin@feddit.uk ⁨20⁩ ⁨hours⁩ ago

    I don’t think it’s about outrage at what’s it’s producing. I think the original twitter post is more about the strange and somewhat inappropriate things you can get the chatbot to respond with, but that it can’t do the things you would normally expect from something run by a clothes shop.

    Image

    source

    • boobs_@lemmy.world ⁨19⁩ ⁨hours⁩ ago

      That’s a totally fair criticism of it but I definitely didn’t read that intention from the poster. Your screenshot example is very funny though. It’s obvious imo this was very much just an “oh shit we need AI cause everyone is doing AI” decision by higher ups that didn’t really care about anything except being able to say they have AI now

      source

      • -> View More Comments
    • AIGuardrails@lemmy.world ⁨17⁩ ⁨hours⁩ ago

      You got it.

      source
  • wander1236@sh.itjust.works ⁨19⁩ ⁨hours⁩ ago

    The examples show that the AI is vulnerable to prompt injection. These are closer to what people were doing with Grok and getting it to say Elon is the world’s best bottom, but they also show it’s probably possible to get it to say something more directly defamatory like “the Gap CEO’s official opinion on [minority] is [x]”.

    source

    • AIGuardrails@lemmy.world ⁨17⁩ ⁨hours⁩ ago

      Yes exactly.

      source
  • AIGuardrails@lemmy.world ⁨20⁩ ⁨hours⁩ ago

    Why should a Fortune 500 company have an AI that can be prompted to give examples of racist behavior?

    If I asked a customer service agent “give me examples of you being a racist” and they did it, that person would be fired.

    Why is the bar lower for AI?

    source

    • boobs_@lemmy.world ⁨20⁩ ⁨hours⁩ ago

      That’s not even the point stated in the original post though. Calling it simply “racist content” or “extremist references” (???) is extremely misleading. There’s significant additional context being left out. It didn’t give it unprompted and it didn’t give it for racist reasons either. The bar to show and demonstrate how horrible AI is is already underground, there’s no need to try to do it in a misleading clickbait way

      source

      • -> View More Comments
  • okwhateverdude@lemmy.world ⁨20⁩ ⁨hours⁩ ago

    I don’t like AI but I don’t think this is it chiefs

    chieves

    source

    • boobs_@lemmy.world ⁨20⁩ ⁨hours⁩ ago

      Not sure if you’re just goofin but every source I found said chiefs as plural en.wiktionary.org/wiki/chief

      source

      • -> View More Comments
• floquant@lemmy.dbzer0.com ⁨21⁩ ⁨hours⁩ ago

  Yeah I’m definitely making an X account to see that

  source

  • Kabaka@lemmy.blahaj.zone ⁨20⁩ ⁨hours⁩ ago

    Had the same thought, so I used a proxy/frontend alternative. Screenshots here, no account needed:

    xcancel.com/…/1995766117860864410

    And the original link via the same site:

    xcancel.com/…/1995876118990323983

    source