Comment on How to selfhost a llm?
jvrava9@lemmy.dbzer0.com 6 months ago
Maybe Serge would fit your use case.
Surge is probably the easiest way to get a basic setup. If you just want to download a model and chat, I recommend it.
das@lemellem.dasonic.xyz 6 months ago
Surge is probably the easiest way to get a basic setup. If you just want to download a model and chat, I recommend it.