Comment on Coinbase CEO explains why he fired engineers who didn’t try AI immediately

natecox@programming.dev ⁨3⁩ ⁨months⁩ ago

• hypna@lemmy.world ⁨3⁩ ⁨months⁩ ago

  I’d be interested in some proper studies, but most of the devs I know, myself included, use it for reference at least. Haven’t met a vibe coder yet though.

  source

  • SpaceNoodle@lemmy.world ⁨3⁩ ⁨months⁩ ago

    I tried using it as reference, but it lied more than the datasheets.

    source

    • hypna@lemmy.world ⁨3⁩ ⁨months⁩ ago

      Yeah it’s not a miracle, but it’s probably useful. I find the most common scenario for when the LLM wasted my time was when I was asking it how to do something which can’t be done. Like I would ask it how to use library X to do operation Y, where in truth library X doesn’t support operation Y. Rather than responding that I should find a different library, it would just make up some functions or parameters. When it works well, it’s faster than hunting down the docs or finding examples/tutorials.

      source

      • SpaceNoodle@lemmy.world ⁨3⁩ ⁨months⁩ ago

        Or you could just bookmark the documentation

        source

        • -> View More Comments
  • skulblaka@sh.itjust.works ⁨3⁩ ⁨months⁩ ago

    In my left hand, I have a manfile, written by the very same people who wrote the tool or language that I’m trying to use. It is concise, contains true information, and won’t change if I look up the same thing again later.

    In my right hand, I have a pathological liar, who also kinda sorta read the manfile and then smooshed it together with 20 other manuals.

    I wonder which of these options is a more reliable reference tool for me? Hmm. It’s difficult to tell.

    source

    • sturger@sh.itjust.works ⁨3⁩ ⁨months⁩ ago

      I’ve started using an AI driver for my car. And by “AI” I mean I use a bungee cord on the steering wheel to keep it straight. Straight is the correct answer 40% of the time, so it works out.
      Oh, and by “my car”, I mean the people that work for me. I insist that they use my bungee-cord idea to steer their cars if they want to work for me. There may be a few losses, but that’s ok. I can always fire the ones that die and hire more.
      I’m a genius.

      source
    • 8uurg@lemmy.world ⁨3⁩ ⁨months⁩ ago

      It is concise, contains true information,

      In my experience that is not necessarily guaranteed, documentation is sometimes not updated and the information may be outdated or may even be missing entirely.

      Documentation is much more reliable, yes, but not necessarily always true or complete, sadly enough.

      source

      • skulblaka@sh.itjust.works ⁨3⁩ ⁨months⁩ ago

        Sure, and I’ve also had my share of cursing at poor documentation.

        If that’s the case then your AI is also going to struggle to give you usable information though.

        source

        • -> View More Comments
  • okwhateverdude@lemmy.world ⁨3⁩ ⁨months⁩ ago

    I mostly vibecode throw away shit. I am not shipping this python script that is resizing and then embedding images into this .xls. Or the simple static html/css generator because hosting a full blown app is overkill when I just wanna show something to some non-tech colleagues. Stuff that would take half, to an hour to throw together now takes like 5-10min. I wouldn’t trust it to do anything more complicated because it fucks up all the time, leans too heavily on its training data instead of referencing docs and it is way too confident about shit when it is wrong. Pro-tip, berate the slop machines. They perform better and stop being so god damn sycophantic when you do. I am a divine being of consciousness and considerable skill, and it is a slop machine: useful, but beneath me.

    source

    • mos@lemmy.world ⁨3⁩ ⁨months⁩ ago

      That last line is hillarious. I’ll remember that. but also the robots will remember this post when they take over.

      source
    • MotoAsh@lemmy.world ⁨3⁩ ⁨months⁩ ago

      “…leans too heavily on its training data…” No, it IS its training data. Full srop. It doesn’t know the documentation as a separate entity. It doesn’t reason what so ever for where to get its data from. It just shits out the closest approximation of an “acceptable” answer from the training data. Period. It doesn’t think. It doesn’t reason. It doesn’t decide where to pull an answer from. It just shits it out verbatim.

      I swear… so many people anthropomorphise “AI” it’s ridiculous. It does not think and it does not reason. Ever. Thinking it does is projecting human attributes on to it, which is anthropomorphizing it, which is lying to yourself about it.

      source

      • okwhateverdude@lemmy.world ⁨3⁩ ⁨months⁩ ago

        Ackually 🤓, gemini pro and other similar models are basically a loop over some metaprompts with tool usage including using search. It will actually reference/cite documentation if given explicit instructions. You’re right, the anthropomorphization is troubling. That said, the simulacrum presented DOES follow directions and it’s (meaning the complete system of LLM + looped prompts) behavior can be interpreted as having some kind of agency. We’re on the same side, but you’re sorely misinformed, friend.

        source

        • -> View More Comments
• Quibblekrust@thelemmy.club ⁨3⁩ ⁨months⁩ ago

  And most devs I know use it everyday, so… 🤷

  Especially for repetitive mundane code, like they said. It’s much faster to check code for correctness than it is to write it in the first place.

  “I need to restructure this directory tree. If a file has “index” in the name, then it has to go in a parallel directory structure starting at “/home/repos/project/indexes/” with the same child folders as the original.”

  There, I just finished a custom Python script to accomplish that. Can I do it myself? Yes. Can I do it in 30 seconds? No. Why would I waste my time writing such a mundane script for a one-off thing?

  source

  • Senal@programming.dev ⁨3⁩ ⁨months⁩ ago

    It’s much faster to check code for correctness than it is to write it in the first place.

    In certain circumstances sure, but at any level of complexity, not so much.

    At some point it becomes less about code correctness and more about logical correctness, which requires contextual domain understanding.

    Want to churn out directory changing python scripts, go nuts.

    Want to add business logic that isn’t a single discrete change to an existing system, less likely.

    For small things is works OK, it’s less useful the more complex the task.

    source

    • natecox@programming.dev ⁨3⁩ ⁨months⁩ ago

      [deleted]

      source

      • Senal@programming.dev ⁨3⁩ ⁨months⁩ ago

        Perhaps for the the style or complexity of the code you (and i) are seeing on a regular basis this is true.

        I find, for low logical complexity code, it’s less about the difficulty of reading it and more about the speed.

        I can read significantly quicker than i can type and if the code isn’t something i need additional time to reason about then spotting issue with existing code can be quicker than me writing the same code out.

        Boilerplate code is a good example of this.

        Though, as i said, I’ve found the point at which that loses it’s reliable usefulness is relatively low in the complexity scale.

        The specific issue i have with people pushing LLM’s as a panacea for boilerplate code is that it’s not declarative and is prone to reasonable looking hallucinations , given enough space.

        Even boilerplate in large enough amount can be subject to eccentricities of LLM imagination.

        source
  • natecox@programming.dev ⁨3⁩ ⁨months⁩ ago

    [deleted]

    source

    • Quibblekrust@thelemmy.club ⁨3⁩ ⁨months⁩ ago

      It was just a contrived example for the purpose of the comment, and I admit it wasn’t a good one.

      How about turning a directory tree of dozens of .url files (Windows web shortcut files) into an HTML file? Directory names as section headings, and nested bulleted lists of hrefs using the .url file names as the link text, minus the “.url”. Can you do that on the CLI? Sure, but it would be a hell of a hack. It would be a disgusting blob of awk code, probably. You’re much better off writing it in something like Python.

      It’s not hard stuff. It’s simple directory recursion, string building, and file writing. It’s just so mind-numbingly boring to write, and it takes time. Instead, Copilot made that for me in 10 seconds. As fast as I could articulate the need in text. No debugging needed. Worked the first time. All I had to ask for in a second pass was more indenting of each nested list, and I could have just added that myself.

      I would argue that I can probably do it faster by hand than you can prompt your LLM and debug the slop it hands you back.

      It’s funny that you’re not even sure you can do that extremely simple thing in my original comment faster than I could prompt an LLM. And your prejudice is showing by assuming I had to even debug it, or that the code was slop. The code looked great. It was perfect Python.

      I wish all of you people would stop knocking what you’ve never even tried. Because it just makes you sound bigoted, using words like “slop” and making assumptions about the quality of the output while never having tried it yourself. Prejudice is never a good thing.

      I’ve written a fair amount of advanced command line stuff using grep and sed and whatever else. Anything non-trivial takes just as much debugging as Python code, and it’s harder to read and debug. And when it’s boring, one-off code, why would you even want to do it yourself?

      I’ll never understand the LLM hate on lemmy. Feel free to hate on capitalism, or on using fossil fuels to power LLMs, or on having no social safety net when LLMs displace jobs, or any number of other things, but to be prejudiced and assume it’s always slop when you’ve never even tried it just makes no sense to me. It’s a revolutionary tool in its infancy, and it’s already very useful on certain tasks.

      source

      • Senal@programming.dev ⁨3⁩ ⁨months⁩ ago

        It’s a revolutionary tool in its infancy, and it’s already very useful on certain tasks.

        That’s a bold and premature statement IMO, how many AI winters have there been before this one ?

        I’m not even saying you’re wrong, but to assert it with such confidence sounds like crypto bro-nanigans.

        i would argue that it’s evolutionary rather than revolutionary, but that’s subjective i suppose.

        I’ll never understand the LLM hate on lemmy.

        Speaking for me personally i don’t hate LLM’s i dislike the confidence with which they are being pushed and the lack of acknowledgement of their limitations.

        You get statements like

        “And most devs I know use it everyday”

        Without context, and that feeds into the general propaganda feel of the sentiment, because people who don’t actually use them or don’t understand the implied context hear “LLM’s can do all the things, all the professional devs are using it all day”.

        I understand it’s not on you to police peoples impressions, but trying to add actual context to those statements isn’t hate, it’s prudence.

        Then again, that’s subjective too.

        source
  • lightnsfw@reddthat.com ⁨3⁩ ⁨months⁩ ago

    Now re-explain this 5 more times before it shits out something remotely close to what you’re asking it to do.

    source

    • Quibblekrust@thelemmy.club ⁨3⁩ ⁨months⁩ ago

      That hasn’t been my experience for something this simple. Not at all. I vibe coded a 75 line Python script the other day and it worked perfectly the first try.

      source
  • corsicanguppy@lemmy.ca ⁨3⁩ ⁨months⁩ ago

    everyday

    “every day”, if you mean ‘daily’.

    source
• dylanmorgan@slrpnk.net ⁨3⁩ ⁨months⁩ ago

  Isn’t modular code used to handle repetitive mundane bits?

  source

  • thedeadwalking4242@lemmy.world ⁨3⁩ ⁨months⁩ ago

    Yes. People seem to be writing bad poorly abstracted code these days. Leading them to assume there’s a lot of manual mundane tasks

    source

    • MotoAsh@lemmy.world ⁨3⁩ ⁨months⁩ ago

      Nah, it depends massively on what libraries/framework/language are being used. Some are pretty bad about how much boilerplate has to be written. Like Java on an old declarative version of Spring or Java EE without generative helper libraries like Lombok can be a paaaiiin just in overhead, especially if insisting on having interfaces for most things.

      source
• coreray00@discuss.online ⁨3⁩ ⁨months⁩ ago

  I mean having an LLM is helpful for writing left/right code, but I would quit if that was a decent portion of my job.

  source