insaan

@insaan@leftopia.org

• ⁨Comment⁩ on ⁨Uber's new shuttle service sounds a lot like a bus route⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  If you click the article link, then use a process called “reading”, you would see:

  The company has already launched similar services abroad in Egypt, Nigeria, and India. Now it’s bringing the concept to the United States.

• ⁨Comment⁩ on ⁨We have to stop ignoring AI’s hallucination problem⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  Most human training is done through the guidance of another

  Let’s take a step back and not talk about training at all, but about spontaneous learning. A baby learns about the world around it by experiencing things with its senses. They learn a language, for example, simply by hearing it and making connections - getting corrected when they’re wrong, yes, but they are not trained in language until they’ve already learned to speak it. And once they are taught how to read, they can then explore the world through signs, books, the internet, etc. in a way that is often self-directed. More than that, humans are learning at every moment as they interact with the world around them and with the written word.

  An LLM is a static model created through exposure to lots and lots of text. It is trained and then used. To add to the model requires an offline training process, which produces a new version of the model that can then be interacted with.

  you can in fact teach it something and it will maintain it during the session

  It’s still not learning anything. LLMs have what’s known as a context window that is used to augment the model for a given session. It’s still just text that is used as part of the response process.

  They don’t think or understand in any way, full stop.

  I just gave you an example where this appears to be untrue. There is something that looks like understanding going on.

  You seem to have ignored the preceding sentence: “LLMs are sophisticated word generators.” This is the crux of the matter. They simply do not think, much less understand. They are simply taking the text of your prompts (and the text from the context window) and generating more text that is likely to be relevant. Sentences are generated word-by-word using complex math (heavy on linear algebra and probability) where the generation of each new word takes into account everything that came before it, including the previous words in the sentence it’s a part of. There is no thinking or understanding whatsoever.

  This is why Voroxpete@sh.itjust.works said in the original post to this thread, “They hallucinate all answers. Some of those answers will happen to be right.” LLMs have no way of knowing if any of the text they generate is accurate for the simple fact that they don’t know anything at all. They have no capacity for knowledge, understanding, thought, or reasoning. Their models are simply complex networks of words that are able to generate more words, usually in a way that is useful to us. But often, as the hallucination problem shows, in ways that are completely useful and even harmful.

• ⁨Comment⁩ on ⁨We have to stop ignoring AI’s hallucination problem⁩ ⁨⁨5⁩ ⁨months⁩ ago⁩:

  the argument that they can’t learn doesn’t make sense because models have definitely become better.

  They have to be either trained with new data or their internal structure has to be improved. It’s an offline process, meaning they don’t learn through chat sessions we have with them (if you open a new session it will have forgotten what you told it in a previous session), and they can’t learn through any kind of self-directed research process like a human can.

  all of your shortcomings you’ve listed humans are guilty of too.

  LLMs are sophisticated word generators. They don’t think or understand in any way, full stop. This is really important to understand about them.