Comment on Selfhosted & AI
scrubbles@poptalk.scrubbles.tech 2 days ago
I like the AI tag idea. I’m someone who has what I’d call a noderate approach to AI, not an AI bro but any means but I’m also okay with some things built with AI if they’re done with care. If others don’t want to see it, fine, then that’s what a tag could be useful with. However the fuck AI/slop comments on something that admits to being AI is annoying to me. (We know it’s AI, they literally said it is).
If it becomes too much content, then yes would be okay with bi-forcating the community, buy only after it becomes a problem.
brucethemoose@lemmy.world 2 days ago
I’m not consistent about it yet, but because of exactly this, I’m trying to differentiate the two when I talk.
Responsible automation? I use ML or machine learning.
The grift consuming the world? A Tech Bro? “AI”
I think one of the saddest things is the conflation between the two, like you can’t even talk about one without invoking the other.
scrubbles@poptalk.scrubbles.tech 1 day ago
Yeah it’s heresy on Lemmy, but I do find it genuinely useful. My only regret is that I have to use Claude/Anthropic more than I’d like, which is why I have a vested interest in selfhosting myself. I’d rather figure out how to run the larger models myself and cut them off completely, but you even begin to mention that here and you’ll get downvoted to hell.
brucethemoose@lemmy.world 1 day ago
You don’t even need Claude anymore. GLM 5.2 API is good enough for 95% of the same things and vastly cheaper.
MiMo 2.5 Pro and Kimi are also very good. And then there’s Cerebras API if you just want simple things done quick.
scrubbles@poptalk.scrubbles.tech 1 day ago
That’s where I am okay with hardware, but can’t seem to fit the models on my 3090. I have dreams of something like an A100 someday, but not until there’s a ton of used ones that hit the market. What do you use for your hardware?