Comment on Where to start with setting up my own server?
Not llamacpp?
OVMS + a model that was built for it is far more responsive than llamacpp.
undrwater@lemmy.world 2 days ago
OVMS + a model that was built for it is far more responsive than llamacpp.