Comment

Comment on New ntfy.sh v2.18.0 was written by AI

“but reviewed and heavily tested over 2-3 weeks by me. I created comparison documents, went through all queries multiple times and reviewed the logic over and over again. I also did load tests and manual regression tests, which took lots of evenings.”

This is the way.

source

Sort:hotnew top

Jhex@lemmy.world ⁨1⁩ ⁨hour⁩ ago
that’s nowhere near enough testing for such a large change… special one written by the slop machine

source
douglasg14b@lemmy.world ⁨1⁩ ⁨hour⁩ ago
Pretty much.

I’ve started using AI on a project last week and the first thing I do is write tests. Lots of tests.

With enough guardrails, you could actually get pretty decent quality output out of it and with enough regression tests, you can ensure that nothing’s actually breaking.

Similarly, reviewing its changes and actually reading the code that’s being generated to ensure correctness is necessary. However, I am finding ways to automate that and reduce the incident rate of problems to even lower than my co-workers.

source
- dogs0n@sh.itjust.works ⁨1⁩ ⁨hour⁩ ago
  At that point, I think: Why not just write the code yourself?
  
  Writing the code is more fun that reviewing code, not to mention less error prone.
  
  source
  - rumba@lemmy.zip ⁨1⁩ ⁨hour⁩ ago
    A many-month-long refactor on code you’ve already written is less than fun. While I don’t love seeing a project I’m using being 80% replaced by Claude code, I’ve had Claude code look at some of my old projects and find underlying issues I was able to verify, and then suggested a more best-practice approach that I wasn’t even aware of. The real question is, was the claude output better than the original code? If it is and it has unit tests and many eyes on it, it’s quite possible that it’s better off now.
    
    I’ll sit on my current versions for a few months and let everyone else test it out :)
    
    source
    dogs0n@sh.itjust.works ⁨49⁩ ⁨minutes⁩ ago
    I agree with you, though even when I have just made a change myself, I am looking through the git diff like a crazy person.
    
    So, still I think refactoring my own code is much more fun than telling AI to do it for me and then proceeding to review and test it for weeks (allegedly, lol).
    
    You seem to be using it responsibly by asking it how things could be better.
    
    I’d never copy and paste output from an AI or give it free roam to make a PR, etc myself.
    
    I’ll probably be sitting out on this update for a while too until I gage the general reactions of people heh :)
    
    source