Comment on The new 3B "fully open source" model from AMD

<- View Parent
Danitos@reddthat.com ⁨5⁩ ⁨weeks⁩ ago

No direct answer here, but my tests with models from HuggingFace measured about 1.25GB of VRAM per 1B parameters.

Your GPU should be fine if you want to play around.

source
Sort:hotnewtop