It’s not just statistics. To produce a somewhat coherent sentence in English you need a model of the English language AND a world model.

If you ask a question like “an apple is on a glass, what happens if I remove the glass”, the correct answer (“the apple will fall”) is not a statistical property of the English language, but an emergent property of the world model.