Comment on Experiences with using openclaw as a sex/roleplaying chatbot without GPU? I h
iceberg314@slrpnk.net 2 weeks ago
That’s too bad you can’t discuss the tianamen square massacre with your sex/roleplay chat bot.
Lol what’s your tokens per second not the server with no GPU running those sizes of models?
matti@seksi.jatai.de 2 weeks ago
I’m getting like 10-20tps with some other similar-sized models, but didn’t benchmark qwen yet. Note that they are mixture-of-experts, so they are evaluating only a few billion parameters each time.