LLMs have no more beliefs than a parrot does.
Less. A parrot can believe that it’s going to get a cracker.
You could make an AI that had that belief too, and an LLM might be a component of such a system, but our existing systems don’t do anything like that.