It’s great for solo roleplaying.
I mean. Not great. But it’s something you can interact with in a way that’s not possible without other people. So that’s something.
Comment on PewDiePie releases Codex/ClaudeCode/Cursor killer, Odysseous (FOSS)
appauled@sh.itjust.works 2 weeks agoI kinda loved his “you should self host to decentralize from big tech” and “run graphene and Linux to avoid data collection” content, but idk what the local ai stuff is any good for
It’s great for solo roleplaying.
I mean. Not great. But it’s something you can interact with in a way that’s not possible without other people. So that’s something.
It’s good for the same things machine learning has always been good for. Language synthesis and analysis. Selfhosting something like Paperless for document management. It actually has a very rudimentary learning engine for document classification for a long time but feeding document content to a local AI model for organization tagging is very useful.
As much as the remote AI stuff is good for, really. Local models have been catching up to commercial big-iron fare at an astounding pace. Last year I would’ve said they’re a year behind. But in April, Qwen released a 27B model that outperforms their 397B model… from February.
I’ve seen a variety of Youtube makers build a thing and then hand-wave some code with a nervous laugh. Even if it’s a coin toss whether the chatbot-that-codes actually works - you don’t lose much by trying. Epecially if the alternative was reluctant procrastination.
dropped_the_chief@lemmy.world 2 weeks ago
If you use AI for a lot of small things, then you can offload the tasks to a locally run server.
Or if you see it as a feature you plan on using for a long time and don’t want to have to keep paying big tech for the privilege of using AI, and hell, you already have a nice graphics card, it’s perfect.
plant@lemmy.dbzer0.com 2 weeks ago
Even Jensen calls it LLM