Comment on Introducing the Nextcloud AI Assistant - local, privacy-respecting, and fully open source đ
Dave@lemmy.nz â¨11⊠â¨months⊠agoThe blog post states:
We build the AI Assistant using a flexible, solution-independent approach which gives you a choice between multiple large language models (LLM) and services. It can be fully hosted within your instance, processing all requests in-house, or powered by an external service.
So it sounds like you pick what works for you. Iâd guess on a raspberry pi, on board processing would be both slow and poor quality, but Iâll probably give it a go anyway.
pixxelkick@lemmy.world â¨11⊠â¨months⊠ago
Yeah sorry I was specifically referring to the on prem LLM if that wasnt clear, and how much juice running that thing takes.
Dave@lemmy.nz â¨11⊠â¨months⊠ago
Some of the other Nextcloud stuff (like that chat stuff) isnât suitable on Raspberry Pi, I expect this will be the same. Itâs released though, right? Might have to have a play.
EatYouWell@lemmy.world â¨11⊠â¨months⊠ago
Youâd be surprised at how little computing power it can take, depending on the LLM.