Thats simply not true. LLMs with RAG can easily catch up with new library changes.
Comment on Why LLMs can't really build software
dantheclamman@lemmy.world 5 days ago
LLMs are useful to provide generic examples of how a function works. This is something that would previously take an hour of searching the docs and online forums, but the LLM can do for very quickly, and I appreciate. But I have a library I want to use that was just updated with entirely new syntax. The LLMs are pretty much useless for it. Back to the docs I go! Maybe my terrible code will help to train the model. And in my field (marine biogeochemistry), the LLM generally cannot understand the nuances of what I’m trying to do. Vibe coding is impossible. And I doubt the training set will ever be large or relevant enough for the vibe coding to be feasible.
drmoose@lemmy.world 4 days ago
jj4211@lemmy.world 4 days ago
Subjectively speaking, I don’t see it so that good a job of being current or priortizing current over older.
While RAG is the way to give LLM a shot at staying current, I just didn’t see it doing that good a job with library documentation. Maybe it can do all right with tweaks like additional properties or arguments, but more structural changes to libraries I just don’t see being handled.
dantheclamman@lemmy.world 4 days ago
Exactly. It’s an very niche library (tmap for R) and just was completely overhauled. Gemini, chatGPT and Copilot all seem pretty confused and mix up the old and new syntax
drmoose@lemmy.world 4 days ago
Thats a lot on implementation of the LLM engine . For python or js you can feed the API schema of the entire virtual environment.
Occhioverde@feddit.it 4 days ago
Yes and no.
In many cases (like for the Gradle DSL, that can be both the old Groovy-based one or the new Kotlin-based one) it is sufficient to specify which version you’re using and, as long as this doesn’t get too far in its context window forcing you to repeat it, you are good to go.
But for niche libraries that have recently undergone significant refactors with the majority of the tutorials and examples still built with past versions, they have a huge bias towards the old syntax, making it really difficult - if not impossible - to make them use the new functions (at least for ChatGPT and GitHub Copilot with the “Web search” functionality on).
Evotech@lemmy.world 4 days ago
You can’t know without checking though, it may be wrong
corsicanguppy@lemmy.ca 5 days ago
The term for that is actually ‘slopping’. Kthx ;-)