So… they failed 13.34% of their own unit tests?
The study said 86.66% of the generated software systems were “executed flawlessly.”
But…
Nevertheless, the study isn’t perfect: Researchers identified limitations, such as errors and biases in the language models, that could cause issues in the creation of software. Still, the researchers said the findings “may potentially help junior programmers or engineers in the real world” down the line.
scarabic@lemmy.world 1 year ago
hayes_@sh.itjust.works 1 year ago
That’s a B+! Fire all our engineers immediately.
- some tech CEO, somewhere
LazaroFilm@lemmy.world 1 year ago
Better than CyberPunk at release.
radix@lemmy.world 1 year ago
🎵🎵 99 little bugs in the code, 99 bugs in the code, Fix one bug, compile it again, 101 little bugs in the code. 101 little bugs in the code, 101 bugs in the code, Fix one bug, compile it again, 103 little bugs in the code. 🎵🎵
m_r_butts@kbin.social 1 year ago
Ah, there's the dream they're chasing. Chatbots write the code for free, and junior devs play janitor to the robots and fix it up. No more expensive senior devs! The savings can be used as an executive bonus.
KoboldCoterie@pawb.social 1 year ago
And when the reviews are terrible and end users start reporting unreal quantities of bugs, they’ll fire the junior devs. They should have fixed those!