Comment on Is possible to run a LLM on a mini-pc like the GMKtec K8 and K9?

MasterNerd@lemm.ee ⁨4⁩ ⁨months⁩ ago

Look into ollama. It shouldn’t be an issue if you stick to 7b parameter models

source
Sort:hotnewtop