Youâd be surprised at how little computing power it can take, depending on the LLM.
Comment on Introducing the Nextcloud AI Assistant - local, privacy-respecting, and fully open source đ
pixxelkick@lemmy.world â¨11⊠â¨months⊠agoYeah sorry I was specifically referring to the on prem LLM if that wasnt clear, and how much juice running that thing takes.
EatYouWell@lemmy.world â¨11⊠â¨months⊠ago
Dave@lemmy.nz â¨11⊠â¨months⊠ago
Some of the other Nextcloud stuff (like that chat stuff) isnât suitable on Raspberry Pi, I expect this will be the same. Itâs released though, right? Might have to have a play.