Comment on Self-Hosted AI is pretty darn cool
chagall@lemmy.world 5 weeks agoI use my phone all the time, but I just use a wireguard VPN to tunnel into my home container of Open WebUI. Then I can interact with my desktop machine using a NVIDIA gpu. I’m currently testing mistral-nemo. It’s pretty great but it gets a bit verbose sometimes.
kureta@lemmy.ml 5 weeks ago
I am also using open webui. Most LLMs are too verbose for me, so I created a model in open-webui with system prompt “Do not repeat the questions. Avoid giving lists as answers. Do not summarize the answer at the end. If asked a follow-up question, respond with only new information, do not repeat previously stated information.” and named it No Nonsense.
kate@lemmy.uhhoh.com 5 weeks ago
for some reason chatgpt responds well to “no yapping”
chagall@lemmy.world 5 weeks ago
That’s really smart. I just found out about fabric yesterday and it is helping me with things like what you stated. Prompt engineering is a huge thing.