Comment on Any external NPU that can be hooked to a proxmox miniPC?
echo@lemmy.ml 2 days agoQwen3.8 is out now and blows Qwen3.6 out of the water in pretty much every metric
Comment on Any external NPU that can be hooked to a proxmox miniPC?
echo@lemmy.ml 2 days agoQwen3.8 is out now and blows Qwen3.6 out of the water in pretty much every metric
yellowbadbeast@lemmy.blahaj.zone 2 days ago
AFAIK there isn’t a sparse 35B variant of 3.8, and I would not recommend running a dense 27B model on dual-channel DDR4 unless you are exceptionally patient.