If I had to come up with a steelman argument for small “AI focused” systems like this, I’d say that the more development in this space, makes the cost of entry cheaper, and actually eventually starves out the big tech garbage like OpenAI/Google/Microsoft.

If everyone who wants to use AI can locally process queries to a locally hosted open-source model with “good enough” results, that cuts out the big tech douchebags, or at least gives an option to not participate in their data collection panopticon ecosystem.