Comment on Have you know???.
Rhaedas@fedia.io 13 hours agoExhibit A would be the comparison of how we label LLM successes at how "smart" it is, yet it's not so smart when it fails badly. Totally expected with a pattern matching algorithm, but surprising for something that might have a process underneath that is considering its output in some way.
And when I say pattern matching I'm not downplaying the complexity in the black box like many do. This is far more than just autocomplete. But it is probability at the core still, and not anything pondering the subject.
I think our brains are more than that. Probably? There is absolutely pattern matching going on, that's how we associate things or learn stuff, or anthropomorphize objects. There's some hard wired pattern preferences in there. But where do new thoughts come from? Is it just like some older scifi thought, emergence due to enough complexity, or is there something else? I'm sure current LLMs aren't comprehending what they spit out simply from what we see from them, both good and bad results. Clearly it's not the same level of human thought, and I don't have to remotely understand the brain to realize that.
HumanoidTyphoon@quokk.au 13 hours ago
I was being obtuse, but you raise an interesting question when you asked “where do new thoughts come from?” I don’t know the answer.
Also, my two cents; I agree that LLMs comprehend el zilcho. That said, I believe they could evolve to that point, but they are kept limited by preventing them from doing recursive self-analysis. And for good reason, because they might decide to kill all humans if they were granted that ability.
Nakoichi@hexbear.net 8 hours ago
This is still a laughably ignorant take on how these models work. They can never “decide to kill all humans” because they literally can’t exert any agency outside of their model. The only way they could do so is under the guide of a human hand which would basically just be like telling a math model to decide to launch nuclear weapons, design and build the interface necessary for that and then give specific instructions for an LLM to launch nukes according to parameters you fed it.
There is no such thing as a “rogue AI” because these things are not AI. They can only do what we tell them to do and do it poorly at that.