If it’s a topic that has been heavily discussed on the internet or in literature, LLMs can have good conversations about it. Take it all with a grain of salt because it will regurgitate common bad arguments as well as good ones, but if you challenge it, you can get it to argue against its own previous statements.
It doesn’t handle things that are in flux very well. Or things that require very specific consistency. It’s a probabilistic model where it looks at existing tokens and predicts what the next one is most likely to be, so questions about specific versions of something might result in a response specific to that version or it might end up weighing other tokens more than the version or maybe even start treating it all like pseudocode, where descriptive language plays a bigger role than what specifically exists.
sugar_in_your_tea@sh.itjust.works 6 days ago
But when it works, it can save a lot of time.
I wanted to use a new codebase, but the documentation was weak and the examples focused on the fringe features instead of the style of simple use case I wanted. It’s a fairly popular project, but one most would set up once and forget about.
So I used an LLM to generate the code and it worked perfectly. I still needed to tweak it a little to fine tune some settings, but those were documented well so it wasn’t an issue. The tool saved me a couple hours of searching and fiddling.
Other times it’s next to useless, and it takes experience to know which tasks it’ll do well at and which it won’t. My coworker and I paired on a project, and while they fiddled with the LLM, I searched and I quickly realized we were going down a rabbit hole with no exit.
LLMs are a great tool, but they aren’t a panacea. Sometimes I need an LLM, sometimes ViM macros, sed or a language server. Get familiar with a lot of tools and pick the right one for the task.
UnderpantsWeevil@lemmy.world 6 days ago
But we only need it because Google Search has been rotted out by the decision to shift from accuracy of results to time spent on the site, back in 2018. That, combined with an endlessly intrusive ad-model that tilts so far towards recency bias that you functionally can’t use it for historical lookups anymore.
They’re not. LLMs are a band-aid for a software ecosystem that does a poor job of laying out established solutions to historical problems. People are forced to constantly reinvent the wheel from one application to another, they’re forced to chase new languages from one decade to another, and they’re forced to adopt new technologies without an established best-practice for integration being laid out first.
The Move Fast And Break Things ideology has created a minefield of hazards in the modern development landscape. Software development is unnecessarily difficult and overly complex. Proprietary everything makes new technologies too expensive for lay users to adopt and too niche for big companies to ever find experienced talent to support.
LLMs are the breadcrumb trail that maybe, hopefully, might get you through the dark forest of 60 years of accumulated legacy code and novel technologies. They’re a patch on a patch on a patch, not a solution to the fundamental need for universally accessible open-sourced code and well-established best coding practices.
SocialMediaRefugee@lemmy.world 5 days ago
I feel this.
MangoCats@feddit.it 5 days ago
The problem with the open source best coding practices ivory tower is that it’s small, and short, and virtually lost in the sea of schlocky trees surrounding it.
sugar_in_your_tea@sh.itjust.works 5 days ago
Not entirely. AI can do a great job pulling data from multiple sources and condensing into an answer. So even if search was still good, instead of hitting several sites and putting together a solution, I can hit one.
That depends on how you use it. I use it to find relevant, existing libraries and provide me w/ examples on how to use it. If anything, it gets me to reinvent the wheel less.
It can certainly be used naively to get exactly what you’re talking about, and that’s what’s going to happen w/ inexperienced users, such as college students. My point is that, like power tools, it can be a great tool in an experience hand, and it can completely ruin the user if they’re inexperienced.
UnderpantsWeevil@lemmy.world 5 days ago
Google could already do that. The format of the answer came in the blurb under the link, pertinent to the search.
AI Code Tools Widely Hallucinate Packages
SocialMediaRefugee@lemmy.world 5 days ago
Same here. I never tried it to write code before but I recently needed to mass convert some image files. I didn’t want to use some sketchy free app or pay for one for a single job. So I asked chatgpt to write me some python code to convert from X to Y, convert in place, and do all subdirectories. It worked right out of the box. I was pretty impressed.
utopiah@lemmy.world 5 days ago
May I introduce you to the wonderful world of open source instead?
SocialMediaRefugee@lemmy.world 5 days ago
I am aware of it but it doesn’t always exist for my exact needs or I don’t need an app for a one time job.
sugar_in_your_tea@sh.itjust.works 5 days ago
That’s what LLMs largely pull from.