Comment on [AIT] what is your selfhosted local LLM stack?

redballooon@lemmy.world ⁨2⁩ ⁨weeks⁩ ago

Pi Coding Agent on the laptop, openwebui as a self hosted service.

I don’t host LLMs myself. My best hardware has 16GB of RAM, I could run a 4B model or so, but what’s the point? So I buy compute with ZDR turned on.

original
Sort:hotnewtop