OpenAI says its latest models outperform doctors in medical benchmark

Comments

• orclev@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Wake me up when someone besides OpenAI says they’re the best at something. When a company releases a benchmark they designed that their own tool that’s generally regarded as not very good is suddenly the best at, that’s not news, at best that’s PR, at worst propaganda. This reeks of “we investigated ourselves and found we did nothing wrong”.

  source
• etchinghillside@reddthat.com ⁨1⁩ ⁨year⁩ ago

  US Healthcare will now be affordable!

  source
• Bezier@suppo.fi ⁨1⁩ ⁨year⁩ ago

  Tl;dr: OpenAI says OpenAI product performs well in a benchmark created by OpenAI.

  source

  • Opinionhaver@feddit.uk ⁨1⁩ ⁨year⁩ ago

    The bar exam isn’t created by OpenAI, yet the outdated GPT-4 model still ranked in the 90th percentile on it.

    source
• taladar@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

  So they created a test so broken and warped that no actual professional can understand it but their AI performs well on it?

  source
• Buffalox@lemmy.world ⁨1⁩ ⁨year⁩ ago

  I almost feel sad for IBM, this was supposed to be their thing.

  source

  • etchinghillside@reddthat.com ⁨1⁩ ⁨year⁩ ago

    Had forgotten we’ve been promised this before.

    source
• banghida@lemm.ee ⁨1⁩ ⁨year⁩ ago

  Sure thing

  source
• kaeurennetwo@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Wow.

  source

  • TrendigOsthyvel@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Much wow.

    source

    • kaeurennetwo@lemmy.world ⁨1⁩ ⁨year⁩ ago

      Those are analytical AI right? More procedural, and also, the data to train the AI are consented. I tried Ada, it didn’t give me official diagnosis but rather helping me to talk to doctor

      source