Comment on Is there any counter AI bots in the fediverse
hendrik@palaver.p3x.de 4 days agoWhat kind of models are you planning to use? Some of the LLMs you run yourself? Or the usual ChatGPT/Grok/Claude?
Comment on Is there any counter AI bots in the fediverse
hendrik@palaver.p3x.de 4 days agoWhat kind of models are you planning to use? Some of the LLMs you run yourself? Or the usual ChatGPT/Grok/Claude?
PixelPilgrim@lemmings.world 4 days ago
So far I’ve experimented with ollama3.2 (I don’t have enough ram for 3.3). Deepseek r1 7b( discovered that it’s verbose and asks a lot of questions) and I’ll try phi4 later. I could use the chat-gpt models since I have tokens. Ironically I’m thinking about making a genetic algorithm of prompt templates and a confidence check. It’s oddly meta
hendrik@palaver.p3x.de 4 days ago
I often recommend Mistral-Nemo-Instruct I think that one strikes a good balance. But be careful with it, it's not censored. So given the right prompt, it might yell at people, talk about reproductive organs etc. All in all it's a job that takes some effort. You need a good model, come up with a good prompt. Maybe also give it a persona. And the entire framework to feed in the content, make decisions what to respond to. And if you want to do it right, and additional framework for safety and monitoring. I think that's the usual things for an AI bot.