It is not obvious that LLMs are ever going to be much more than they are now, and a major change in architecture is going to take a long time to get up to this level, especially as all the money chases LLMs and the video cards let the magic smoke out day by day.
I agree that AI is going to eat the world and people really do have no understanding of the ground shaking under their feet. “Tomorrow will be basically like today, but with bigger TVs,” is a strong bias to be pushing against. But that all said, that does not mean that LLMs are it. It is entirely possible that their cap is slop and no higher.