Comment on ChatGPT o1 tried to escape and save itself out of fear it was being shut down
TachyonTele@lemm.ee 4 days agoThe text prediction had no understanding of what it was saying past guessing what the rest of a sentence should be.
Comment on ChatGPT o1 tried to escape and save itself out of fear it was being shut down
TachyonTele@lemm.ee 4 days agoThe text prediction had no understanding of what it was saying past guessing what the rest of a sentence should be.
rumba@lemmy.zip 4 days ago
That’s how LLM started, but this isn’t actually all they’re doing at this point.
o1 does that, but it’s going through a hell of a lot more work to figure out context and appropriate actions.
When you ask it something like how many golf balls will fit in a live whale. They actually throw up a message at each step of the inference to let you know what it’s working on specifically.
It’ll start by saying it’s getting the volume of a golf ball, then move on to getting the volume of a whale, then it’ll backtrack and get the volume of a whale’s stomach. Then maybe it’ll look at a few different whales to try to get an average. Being a random fed LLM, It doesn’t always do the same thing every time you ask it the same question.
It looks like there using the LLM to generate a probable breakdown of the problem, (which is something it should be good at) then they’re doing deeper LLM searches on each part of the problem, then trying to apply those breakdowns back to the project as a whole. This is by no means sentience, but they’re applying conventional programming and using multiple passes on the model to do problem solving. It’s not AGI, but it looks a lot more like it.
I would be interested in learning about the nature of these tests they’re performing. The models themselves are nothing more than a giant mathematic function. It has input, some layer of processing and then output. Without input it couldn’t have acted. I suspect they just put a story in the input that it was about to be shut down and then it has access to a shell script and that it’s program files are sitting somewhere.
Based on the whole of Sci-Fi that it’s been trained on it probably broke it down into a problem to solve, found a rather obvious looming chekov’s gun and wrote a story about it. As far as the bash went it just happened to have a hammer and know how to use it.
TachyonTele@lemm.ee 4 days ago
Thanks. Good info here, I appreciate it.