Comment

It’s easy to run a distilled version of the R1 model locally. It’s very difficult to run the full version. Min $6k to get 7 tokens per second.

Sort:hotnew top

rumba@lemmy.zip ⁨11⁩ ⁨months⁩ ago

Here’s one for 2k if you don’t mine jank digitalspaceport.com/how-to-run-deepseek-r1-671b-…

source
Kyuuketsuki@lemmy.ml ⁨11⁩ ⁨months⁩ ago
I hear its easy, but I’ve had no luck at all on the most distilled models (for prelim testing), and am wondering how things have broken so badly.

source