All LLMs are using a tool for the wrong task then, in your opinion? So in the composite object of “LLM” what is the tool and what is the task?
All LLMs are using a tool for the wrong task then, in your opinion? So in the composite object of “LLM” what is the tool and what is the task?
CileTheSane@lemmy.ca 1 day ago
The tool is “Language Learning Model” and the task is “Learn language and mimic human speech.”
The task is not “Provide accurate information” or “write code” or “provide legal advice” or “Diagnose these symptoms” or “provide customer service” or “manage a database”.
Not_mikey@lemmy.dbzer0.com 17 hours ago
And a human’s task, along with any other lifeform, is to survive and reproduce. In pursuit of that goal we have learned many different complex strategies and methods to achieve it, same with an llm.
Peoples tasks are also not to provide accurate information, write code, provide legal advice etc. If a person can earn a living, attract a mate and raise children by lying, writing bad code, giving shitty legal advice etc. they will. It takes external discipline to make sure agents don’t follow those behaviors. For humans that discipline is provided by education, socialization, legal systems etc. For LLMs that discipline is provided by fine tuning, ie. The lying models get down rated while the more truthful models get boosted.
CileTheSane@lemmy.ca 16 hours ago
They all “lie” because they don’t actually know a damn thing. Everything an LLM outputs is just a guess of what a human might do.
Not_mikey@lemmy.dbzer0.com 3 hours ago
An LLM has a great deal of declarative knowledge. Eg. It knows that the first president of the US is George Washington. Like humans it has built up this knowledge through reinforcement, the more a fact is reinforced by external sources, the more you/ it knows it. Like with humans when it reaches the edge of its knowledge base it will guess. If I ask someone who the 4th president of the US was they may guess Monroe, that person isn’t lying, it’s just an area that hasn’t been reinforced (studied) as much so they are making their best guess, LLMs do the same. That doesn’t mean that person cannot and will not ever know the 4th president, it just means they need more reinforcement / training / studying.
Humans as well as LLMs have a declarative knowledge area with a lot of grey area between knowing and not knowing. It’d be like a spectrum starting on one end with stuff that has been reinforced many times by people with high authority, what is your name would probably be the furthest on one side, to another end with stuff you’ve never heard or heard from untrustworthy sources. LLMs may not have the other dimension of trustworthiness that people do but the humans training it will usually compensate that with more repetition from trustworthy sources, eg. They’ll put 10 copies of the new York times and only one of younewsnow.com or whatever in the training data.
vacuumflower@lemmy.sdf.org 18 hours ago
It’s “Large Language Model”, and the point is in “Large” and that on really large datasets and well-selected attention dimensions set it’s good at extrapolating language describing real world, thus extrapolating how real world events will be described. So the task is more of an oracle.
I agree that providing anything accurate is not the task. It’s the opposite of the task, actually, all the usefulness of LLMs is in areas where you don’t have a good enough model of the world, but need to make some assumptions.
Except for “diagnose these symptoms”, with proper framework around it (only using it for flagging things, not for actually making decisions, things that have been discussed thousands of times) that’s a valid task for them.
CileTheSane@lemmy.ca 16 hours ago
This sounds like someone who knows nothing about construction saying “building a house” is a valid task because they don’t understand why using a hammer to drive in a screw would be incorrect or why it’s even a problem. “The results are good enough right?”
vacuumflower@lemmy.sdf.org 15 hours ago
You are writing pretentious nonsense, go someplace else.