That basically just sounds like Mixture of Experts
Coordinated SLM governors that can redirect queries to the appropriate SLM seems like a good solution.
sleep_deprived@lemmy.dbzer0.com 2 months ago
kautau@lemmy.world 2 months ago
Basically, but with MCP and SLMs interacting rather than a singular model, with the coordinator model only doing to work to figure out who to field the question to, and then continuously provide context to other SLMs in the case of more complex queries
JoeKrogan@lemmy.world 2 months ago
Powered by GNU Hurd