Llms hit memory exhaustion between prompts, each “slide” is an individual generation which is why it feels so discontinuous. This will be really exciting after a couple breakthroughs though, especially when it can reference old generations.