Comment on Elon Musk’s Grok Goes Haywire, Boasts About Billionaire’s Pee-Drinking Skills and ‘Blowjob Prowess’
brucethemoose@lemmy.world 59 minutes agoYou should be running hybrid inference of GLM Air with a setup like that.
I dunno what kind of speeds you absolutely need, but I bet you could get at least 12 tokens/s.