Comment on Is anyone self-hosting their own AI?

<- View Parent
twilightwolf90@lemmy.world ⁨13⁩ ⁨hours⁩ ago

How well does it handle concurrency? I could see this as a vast improvement on llamacpp, but I was already speccing out vLLM.

original
Sort:hotnewtop