My main workstation runs Linux and I use Llama.cpp. I used it with mistral’s latest largest model but I have used others in the past.

I appreciate your thoughts here. Lemmy I think, in general, has an indistinguishing anti LLM bias.