Comment on [AIT] what is your selfhosted local LLM stack?
redballooon@lemmy.world 2 weeks ago
Pi Coding Agent on the laptop, openwebui as a self hosted service.
I don’t host LLMs myself. My best hardware has 16GB of RAM, I could run a 4B model or so, but what’s the point? So I buy compute with ZDR turned on.