Comment on AI-generated code contains more bugs and errors than human output

• user224@lemmy.sdf.org ⁨1⁩ ⁨month⁩ ago

  It works well for recalling something you already know, whether it be computer or human language. What’s a word for… what’s a command/function that does…

  source

  • frongt@lemmy.zip ⁨1⁩ ⁨month⁩ ago

    For words, it’s pretty good. For code, it often invents a reasonable-sounding function or model name that doesn’t exist.

    source

    • Xenny@lemmy.world ⁨1⁩ ⁨month⁩ ago

      It’s not even good for words. AI just writes the same stories over and over and over and over and over and over. I’d argue the best and only real use for an llm is to help be a rough draft editor and correct punctuation and grammar. We’ve gone way way way too far with the scope of what it’s actually capable of

      source

      • Flisty@mstdn.social ⁨1⁩ ⁨month⁩ ago

        @Xenny @frongt it's definitely not good for words with any technical meaning, because it creates references to journal articles and legal precedents that sound plausible but don't exist.
        Ultimately it's a *very* expensive replacement for the lorem ipsum generator keyboard shortcut.

        source
  • ThirdConsul@lemmy.ml ⁨1⁩ ⁨month⁩ ago

    According to OpenAis internal test suite and system card, hallucination rate is about 50% and the newer the model the worse it gets.

    And that fact remains unchanged on other LLM models.

    source
• ptu@sopuli.xyz ⁨1⁩ ⁨month⁩ ago

  I use it for things that are simple and monotonous to write. This way I’m able to deliver results to tasks I couldn’t have been arsed to do. I’m a data analyst and mostly use mysql and power query

  source
• dogdeanafternoon@lemmy.ca ⁨1⁩ ⁨month⁩ ago

  What’s your preferred Hello world language? I’m gunna test this out. The more complex the code you need, the more they suck, but I’ll be amazed if it doesn’t work first try to simply print hello world.

  source

  • xthexder@l.sw0.com ⁨1⁩ ⁨month⁩ ago

    Malbolge is a fun one

    source

    • dogdeanafternoon@lemmy.ca ⁨1⁩ ⁨month⁩ ago

      Cheeky, I love it.

      Got correct code first try. Failed creating working docker first try. Second try worked.

      tmp="$(mktemp)"; cat >"$tmp" <<'MBEOF'
      ('&%:9]!~}|z2Vxwv-,POqponl$Hjig%eB@@>}=<M:9wv6WsU2T|nm-,jcL(I&%$#"
      `CB]V?Tx<uVtT`Rpo3NlF.Jh++FdbCBA@?]!~|4XzyTT43Qsqq(Lnmkj"Fhg${z@>
      MBEOF
      docker run --rm -v "$tmp":/code/hello.mb:ro esolang/malbolge malbolge /code/hello.mb; rm "$tmp"
      

      Output: Hello World!

      source

      • xthexder@l.sw0.com ⁨1⁩ ⁨month⁩ ago

        I’m actually slightly impressed it got both a work program, and a different one than Wikipedia. The Wikipedia one prints “Hello, world.”

        I guess there must be another program floating around the web with “Hello World!”, since there’s no chance the LLM figured it out on its own (it kinda requires specialized algorithms to do anything)

        source

        • -> View More Comments
      • NotMyOldRedditName@lemmy.world ⁨1⁩ ⁨month⁩ ago

        Why the fuck does this language exist lol

        source
• Serinus@lemmy.world ⁨1⁩ ⁨month⁩ ago

  It works well when you use it for small (or repetitive) and explicit tasks. That you can easily check.

  source