Submitted 7 months ago by MigratingtoLemmy@lemmy.world to selfhosted@lemmy.world
Hi everyone, was just going over the ZimaCube page on ZimaBoard’s website: www.zimaboard.com/zimacube/
They mention a “private GPT” for one’s files: I’m interested in how they implemented it, if the process is open source, and if self-hosting something like this is possible.
Thanks!
Probably running a local model, like for example Mistral. Sounds like small local model + RAG
“GPT” describes a machine learning technique - tools like ChatGPT use this technique along with massive training sets to produce their results, but there isn’t anything stopping you doing it on a small scale so you can slap “GPT” or “AI” on your product and jump on the band wagon without actually adding anything of value
There are tons of options for running LLMs locally nowadays, though none come close to GPT4 or Claude 2 etc. One place to start is /c/localllama@sh.itjust.works
Thank you, subscribed!
Moonrise2473@feddit.it 7 months ago
100% it’s just an half assed hack around an open source library
For Kickstarter it doesn’t need to actually work, it just needs to have the option in the menu