LMstudio usually lists the memory recommendations for the model.
Comment on The new 3B "fully open source" model from AMD
BitsAndBites@lemmy.world 1 month ago
Nice. Where do I find the memory requirements? I have an older 6GB GPU so I’ve been able to play around with some models in the past.
ikidd@lemmy.world 1 month ago
foremanguy92_@lemmy.ml 1 month ago
Following this page it should be enough based on the requirements of qwen2.5-3B qwen-ai.com/requirements/
Danitos@reddthat.com 1 month ago
No direct answer here, but my tests with models from HuggingFace measured about 1.25GB of VRAM per 1B parameters.
Your GPU should be fine if you want to play around.