LMstudio usually lists the memory recommendations for the model.
Comment on The new 3B "fully open source" model from AMD
BitsAndBites@lemmy.world 4 weeks ago
Nice. Where do I find the memory requirements? I have an older 6GB GPU so I’ve been able to play around with some models in the past.
ikidd@lemmy.world 4 weeks ago
foremanguy92_@lemmy.ml 3 weeks ago
Following this page it should be enough based on the requirements of qwen2.5-3B qwen-ai.com/requirements/
Danitos@reddthat.com 4 weeks ago
No direct answer here, but my tests with models from HuggingFace measured about 1.25GB of VRAM per 1B parameters.
Your GPU should be fine if you want to play around.