I wonder if AI applications other than just “be a generalist chat bot” would run into the same thing. I’m thinking about pharma, weather prediction, etc. They would still have to “understand” their english-language prompts, but the LLMs can do that just fine today, and could feed systems designed to iteratively solve for problems in those areas. A model feeding into itself or other models doesn’t have to be a bad thing.