Open Menu
AllLocalCommunitiesAbout
lotide
AllLocalCommunitiesAbout
Login

AI-generated code contains more bugs and errors than human output

⁨864⁩ ⁨likes⁩

Submitted ⁨⁨1⁩ ⁨month⁩ ago⁩ by ⁨throws_lemy@reddthat.com⁩ to ⁨technology@lemmy.world⁩

https://www.techradar.com/pro/security/ai-generated-code-contains-more-bugs-and-errors-than-human-output

source

Comments

Sort:hotnewtop
  • HugeNerd@lemmy.ca ⁨1⁩ ⁨month⁩ ago

    Hey don’t worry, just get a faster CPU with even more cores and maybe a terabyte or three of RAM to hold all the new layers of abstraction and cruft to fix all that!

    source
  • chunes@lemmy.world ⁨1⁩ ⁨month⁩ ago

    People expect perfection right out of the gate.

    I mean damn, AI has only been able to write something resembling code for a few years now. The fact that this is even a headline is pretty amazing when you think about it.

    source
    • Rhoeri@lemmy.world ⁨1⁩ ⁨month⁩ ago

      AI apologia is nearly as cringy as MAGA apologia. Stop doing this.

      source
      • chunes@lemmy.world ⁨1⁩ ⁨month⁩ ago

        Haven’t you ever seen Star Trek and been amazed by the holodeck? How do you think they got there?

        source
        • -> View More Comments
      • architect@thelemmy.club ⁨1⁩ ⁨month⁩ ago

        Yes bitching about it is going to make the fucking billionaires quit using it.

        You prefer only they get it? Because that’s what’s going to happen if you somehow got any part of your wish.

        source
        • -> View More Comments
    • 5too@lemmy.world ⁨1⁩ ⁨month⁩ ago

      I don’t mind imperfections while they work out the kinks. I dislike dismantling industries in favor of something that doesn’t work yet.

      source
    • Eranziel@lemmy.world ⁨1⁩ ⁨month⁩ ago

      A lot of LLM hype is wrapped up in how well it can write code. This hype is being used by corporations to justify pouring mind boggling amounts of money into the tech in the hopes that they can lay off all their staff.

      I reserve the right to hate this state of affairs and enjoy seeing every headline that shows just how much of a pipe dream it is.

      source
  • Shanmugha@lemmy.world ⁨1⁩ ⁨month⁩ ago

    No shit, Sherlock ©

    source
  • DudeImMacGyver@kbin.earth ⁨1⁩ ⁨month⁩ ago

    I'll go ahead and file this under "duh".

    source
  • edgemaster72@lemmy.world ⁨1⁩ ⁨month⁩ ago

    Microsoft: Let’s have it rebuild our most well known product from the ground up!

    source
  • PissingIntoTheWind@lemmy.world ⁨1⁩ ⁨month⁩ ago

    But you see. That’s the solution. Now you pay foreigners to clean up the generated code by offshoring the engineers. At 1/100 the cost.

    source
  • Digit@lemmy.wtf ⁨1⁩ ⁨month⁩ ago

    AI-generated code contains more bugs and errors than human output

    Yeah. No shit. I used an LLM’s “help” to make fin.

    It got me reading and debugging more than 10 times the [bad] code, per day, than I had in the entire prior 10 years of using fish. [And reading the documentation way more too, learning a lot.]

    • “However, it’s not necessarily a bad thing, with AI improving efficiency across the initial stages of code generation.”

    • “… more bugs and errors than human output”.

    Oh but it’s so effortless. HA! Debugging takes a lot more effort. And then still have to just re-write it all yourself any way.

    Still, it’s a good learning experience.

    Dear AI,

    Thanks for being so shit.

    Taught me a lot.

    source
  • BilSabab@lemmy.world ⁨1⁩ ⁨month⁩ ago

    what’s funny is that this was predicted to be that way even before AI-generated code became an option. Hell, I remember doing an assessment back in early 2023 and literally every domain expert i talked with said this thing - it has its use, but purely supplemental and you won’t use it on some fundamental because the clean-up will take more time than was preserved. Counterproductive is the word.

    source
  • jaykrown@lemmy.world ⁨1⁩ ⁨month⁩ ago

    AI doesn’t generate its own code, humans using AI generate code. If a person uses AI to generate code and doesn’t know good practices then of course the code is going to be worse.

    source
  • napkin2020@sh.itjust.works ⁨1⁩ ⁨month⁩ ago

    Shocker.

    source
  • themurphy@lemmy.ml ⁨1⁩ ⁨month⁩ ago

    Well, yeah. It also took 100x the time to write it.

    Vibe coding is only really useful for a coder. Because you understand and correct it.

    source
  • DylanMc6@lemmy.ml ⁨1⁩ ⁨month⁩ ago

    what would socialists/communists do?

    source
  • shalafi@lemmy.world ⁨1⁩ ⁨month⁩ ago

    AI code is great for getting over a hump, something you’re stuck on. Used ChatGPT (not the best for coding, I know) to help on a PowerShell script. There was exactly two references on the internet for what I wanted to do (Google Calendar/Sheets integration). Spent hours on the problem.

    ChatGPT gave me two things: One solution I didn’t know was a thing, another was a twist I hadn’t thought of. For giggles, I plugged the whole script in. Guess what? Failed instantly. Because of course it did.

    No. LLMs don’t write working code. Yes. They can help you, assuming you know what you’re doing in the first place. But here’s the crux of using AI:

    It does not, and cannot, give a shit about edge cases, user error and security.

    I wrote a simple PS script to swap my TV screens around for work, play and movies. Rolled it out in 30 minutes. Took me 2 more hours to stupid proof it, test it, wrap it an exe, make an icon, deploy it, all that. AI can’t do any of that.

    source
  • Harvey656@lemmy.world ⁨1⁩ ⁨month⁩ ago

    Not if Yandev has anything to say about it.

    source
  • Etterra@discuss.online ⁨1⁩ ⁨month⁩ ago

    I couldn’t program a single line of code if my life depended on it, and I could have told you that.

    source
  • DylanMc6@lemmy.ml ⁨1⁩ ⁨month⁩ ago

    what would marx do?

    source
    • IAmNorRealTakeYourMeds@lemmy.world ⁨1⁩ ⁨month⁩ ago

      Do not ask a corpse for advice, the question is what are we going to do?

      Boycott is a good first step, although I am not sure if it is better to boycott them or use their free tier to have the most deranged BS conversation that will consume their resources, eat at their scare cash reserves and when they use it in training, it will poison their data.

      source
  • Rhoeri@lemmy.world ⁨1⁩ ⁨month⁩ ago

    But as long as the kids get to keep calling themselves “artists” and “musicians”, its all good.

    source
  • RagingRobot@lemmy.world ⁨1⁩ ⁨month⁩ ago

    Depends on who the human is haha

    source
    • Bgugi@lemmy.world ⁨1⁩ ⁨month⁩ ago

      Yeah, you’ve clearly never seen my code!

      source
  • goatinspace@feddit.org ⁨1⁩ ⁨month⁩ ago

    Image

    source