That basically just sounds like Mixture of Experts
Coordinated SLM governors that can redirect queries to the appropriate SLM seems like a good solution.
sleep_deprived@lemmy.dbzer0.com 3 weeks ago
kautau@lemmy.world 3 weeks ago
Basically, but with MCP and SLMs interacting rather than a singular model, with the coordinator model only doing to work to figure out who to field the question to, and then continuously provide context to other SLMs in the case of more complex queries
JoeKrogan@lemmy.world 3 weeks ago
Powered by GNU Hurd