At work today we had a little presentation about Claude Cowork. And I learned someone used it to write a C (maybe C++?) compiler on Rust in two weeks at a cost of $20k and it passed 99% of whatever hell test suite they use for evaluating compilers. And I had a few thoughts.
- 20k in two weeks is a heavy burn. Imagine of what it wrote was… garbage.
- “Write a compiler” is a complete project plan in three words. Find a business project that is that simple and I’ll show you software that is cheaper to buy than build. We are currently working on an authentication broker service at work and we’ve been doing architecture and trying to get everyone to agree on a design for 2 months. There are thousands of words devoted to just the high level stuff, plus complex flow diagrams.
- The C compiler might be somewhat unique in the sense that there are literally thousands of test cases available - download a foss project and try to compile it. If it fails, figure out the bug and fix it. Repeat. The ERP that your boss wants you to stand up in a month has zero test coverage Andy is going to be chock full of bugs — if for no other reason than you haven’t thought through every single edge case and neither has the AI because lots of times those are business questions.
- There is not a single person who knows the code base well enough to troubleshoot any weird bugs and transient errors.
I think this is a cool thing in the abstract. But in reality, they cherry picked the best possible use case in the world and anyone expecting their custom project is going go anything like this will be lighting huge piles of money on fire.
jjjalljs@ttrpg.network 3 weeks ago
Yep.
Management is often out of touch and full of shit
kescusay@lemmy.world 3 weeks ago
You wanna know who really bags on LLMs? Actual AI developers. I work with some, and you’ve never heard someone shit all over this garbage like someone who works with neural networks for a living.
exu@feditown.com 3 weeks ago
There’s this great rage blog post from 1.5 years ago by a data scientist
I Will Fucking Piledrive You If You Mention AI Again
altasshet@lemmy.ca 3 weeks ago
That’s me, but for QA…
hushable@lemmy.world 3 weeks ago
our company renamed out ML team into AI team, just to please investors, they been around for over a decade and never touched an LLM
Peekashoe@lemmy.wtf 3 weeks ago
Management: “No, that doesn’t work, because employees spend so much time doing the actual work that they lack the vision to know what’s good for them. Luckily for them I am not distracted by actual work so I have the vision to save them by making them use AI.”
sepi@piefed.social 3 weeks ago
Something an idiot would say. Jack Dorsey is precisely this type of idiot. He’s not the only idiot, though
paequ2@lemmy.today 3 weeks ago
Eggs-mothafucking-zackly!!!
There are no daily pressure campaigns to convince you to use a laptop or a smartphone. The value of those are self-evident.
AI on the other hand… -_-
Tollana1234567@lemmy.today 2 weeks ago
“often” they are almost always full of it.