It’s limited, and can’t “reason” almost at all, but it does give well-structured answers. You can extract references from it, up to a point.
Comment on u WoT m8
WamGams@lemmy.ca 6 days agodoesn’t AI need like 96 gigs of ram to be comparable in quality (or lack there of, depending on how you view it) yo the commercial options?
WorldsDumbestMan@lemmy.today 6 days ago
Xylight@feddit.online 6 days ago
Qwen3 30b a3b, for example, is brilliant for its size and i can run it on my 8 GB VRAM + 32 GB RAM system at like 20 tokens per second. For lower powered systems, Qwen3 4b + a search tool is also insanely great for its size and can fit in less than 3 GB of RAM or VRAM at Q5 quantization