Comment on PewDiePie releases Codex/ClaudeCode/Cursor killer, Odysseous (FOSS)
new_world_odor@lemmy.world 2 weeks agoI have a rx5600xt (6gb), 32gb ram, ryzen 3600. System hasn’t been updated since i built it during covid. QwenV3-vl35B is the heftiest thing I can run, it gets around 2 tokens/sec, in LM studio. It’s easier than most people seem to think.
onlinepersona@programming.dev 2 weeks ago
How do you now run out of RAM? Does it offload to system RAM?
new_world_odor@lemmy.world 2 weeks ago
Yes, offloads into system. Oh and i forgot to mention that’s with the context set around 25k. That can vary greatly per model though, it’s taken some experimentation to figure that out.
onlinepersona@programming.dev 2 weeks ago
Thank you. That’s good to know.