Comment

Comment on Show top LLMs buggy code and they'll finish off the mistakes rather than fix them.

LovableSidekick@lemmy.world ⁨4⁩ ⁨weeks⁩ ago

As a software developer I’ve never used AI to write code, but several of my friends use it daily and they say it really helps them in their jobs. To explain this to non-programmers, they don’t tell it “Write some code” and then watch TV while it does their job. Coding involves a lot of very routine busy work that’s little more than typing. AI can generate approximately what they want, which they then edit, and according to them this helps them work a lot faster.

AI isn’t binary good/bad. Neither is a hammer - which can’t build a building by itself and is really shitty as a drill. AI is a tool with good uses.

source

Sort:hotnew top

bpev@lemmy.world ⁨4⁩ ⁨weeks⁩ ago
100%. As a solo dev who used to work corporate, I compare it to having a jr engineer who completes every task instantly. If you give it something well-documented and not too complex, it’ll be perfect. If you give it something more complex or newer tech, it could work, but may have some mistakes or unadvised shortcuts.

I’ve also found it pretty good for when a dependency I’m evaluating has shit documentation. Not always correct, but sometimes it’ll spit out some apis I didn’t notice.

source
- Reliant1087@lemmy.world ⁨4⁩ ⁨weeks⁩ ago
  I’ve found it okay to get a general feel for stuff but I’ve been given insidiously bad code. Functions and data structures that look similar enough to real stuff but are deeply wrong or non+existent.
  
  source
  - bpev@lemmy.world ⁨3⁩ ⁨weeks⁩ ago
    Mmm it sounds like you’re using it in a very different way to me; by the time I’m using an LLM, I generally have way more than a general feel for what I’m looking for. People rag on ai for being a “fancy autocomplete”, but that’s literally what I like to use it for. I’ll feed it a detailed spec for what I need, give it a skeleton function with type definitions, and tell the ai to fill it in. It generally fills in basic functions pretty well with that level of definition (ymmv depending on the scope of the function).
    
    This lets me focus more on the code design/structure and validation, while the ai handles a decent amount of grunt work. And if it does a bad job, I would have written the spec and skeleton anyways, so it’s more like bonus if it works.
    
    source
    Reliant1087@lemmy.world ⁨1⁩ ⁨week⁩ ago
    Thank you! I’ll try this out. I’ve been mostly using it while playing around with new things rather than to expand scaffolding on existing stuff.
    
    However what I find frustrating is that it so confidently gives you garbage sometimes. I was trying to configure some stuff in docker that needed a very extensive yaml config. It confidently gave me flags and keys to accomplish what I wanted that looked logical and fit in with rest of the style but simply did not exist.
    
    source
Lemminary@lemmy.world ⁨4⁩ ⁨weeks⁩ ago

Coding involves a lot of very routine busy work that’s little more than typing.

That’s right. You watch it type it out and right where it gets to the important part you realize that’s not what you meant at all, so you hit the stop button. Then you modify the prompt and repeat that one more time. That’s when you realize there are so many things it’s not even considering which gives you the satisfaction that your job is still secure. Then you write a more focused prompt for one aspect of them problem and take whatever good enough bullshit it spewed as a starting point for you to do the manual work. Rinse and repeat.

source
- Excrubulent@slrpnk.net ⁨4⁩ ⁨weeks⁩ ago
  That sounds exhausting to me.
  
  Like seriously what busywork is so routine and so basic that you need an AI to do it but couldn’t make a template for it? And how is it less work to read what it gave yout to check for errors? That’s always the harder part of coding in my experience.
  
  I would love to know the specifics of where this supposedly saves time.
  
  I suspect the energy you’re putting into learning this tool could go into becoming a better typist, and you wouldn’t need to cook the planet to do it.
  
  source
sugar_in_your_tea@sh.itjust.works ⁨4⁩ ⁨weeks⁩ ago
Exactly. I have a coworker use it effectively.

Personally, I’ve been around the block so it’s usually faster for me to just do the busy work myself. I have lots of tricks for manipulating text quickly (I’m quite proficient with vim), so it’s not a big deal to automate turning JSON into a serializer class or copy and modify a function a bunch of times to build out a bunch of controllers or something. What takes others on my team 30 min I can sometimes get done in 5 through the power of regex or macros.

But at the end of the day, it doesn’t really matter what tools you use because you’re not being paid for your typing speed or ability to do mundane work quickly, you’re being paid to design and support complex software.

source
IphtashuFitz@lemmy.world ⁨4⁩ ⁨weeks⁩ ago
We have a handful of Python tools that we require to adhere to PEP8 formatting, and have Jenkins pipeline jobs to validate it and block merge requests if any of the code isn’t properly formatted. I haven’t personally tried it yet, but I wonder if these AI’s might be good for fixing up this sort of formatting lint.

source
- witten@lemmy.world ⁨4⁩ ⁨weeks⁩ ago
  Why bother with AI for that? black.readthedocs.io/en/stable/index.html
  
  source