Comment on OpenAI confirms that AI writing detectors don’t work

hellothere@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

• stevedidWHAT@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Depends if they’re more researchers or a business imo. Scientists generally speaking are very cautious about making shit claims bc if they get called out that’s their career really.

  source

  • BetaDoggo_@lemmy.world ⁨1⁩ ⁨year⁩ ago

    OpenAI hasn’t been focused on the science since the Microsoft investment. A science focused company doesn’t release a technical report that doesn’t contain any of the specs of the model they’re reporting on.

    source

    • stevedidWHAT@lemmy.world ⁨1⁩ ⁨year⁩ ago

      :(

      source
  • Zeth0s@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Few decades ago probably, nowadays “scientists” make a lot of bs claims to get published. I was in the room when a “scientist” publishing several nature per year asked to her student to write a paper for a research without any result in a way that it look like it had something important for a relatively good IF publication.

    That day I decided I was done with academia. I had seen enough.

    source

    • pc_admin@aussie.zone ⁨1⁩ ⁨year⁩ ago

      Cool story bro

      source

      • stevedidWHAT@lemmy.world ⁨1⁩ ⁨year⁩ ago

        You did not just drop arguably one of the most stale, dead memes of all time to try and look fucking cool

        Thanks for the laugh

        source

        • -> View More Comments
  • hellothere@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

    It’s literally a marketing blog posted by OpenAI on their site, this isn’t a study.

    source
• Kolrami@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Yes, but it’s such a falsifiable claim that anyone is more than welcome to prove them wrong. There’s a lot of slightly different LLMs out there. If you or anyone else can definitively show there’s a machine that can identify AI writing vs human writing, it will either result in better AI writing or it would be an amazing breakthrough in understanding the limits of AI.

  source

  • hellothere@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

    People like to view the problem as a paradox - can an all powerful God create a rock they cannot lift? - but I feel that’s too generous, it’s more marking your own homework.

    If a system can both write text, and detect whether it or another system wrote that text, then “all” it needs to do is change that text to be outside of the bounds of detection. That is to say, it just needs to convince itself.

    I’m not wanting to imply that that is easy, because it isn’t, but it’s a very different thing to convincing someone else, especially a human, that understands the topic.

    There is also a false narrative involved here, that we need an AI to detect AI which again serves as a marketing benefit to OpenAI.

    We don’t, because they aren’t that good, at least, not yet anyway.

    source