Comment on [AIT] paperless-ngx 3.0.0
Voroxpete@sh.itjust.works 1 day agoIt reads as especially hysterical in this context, because Paperless is an automatic document categorization system, and I’m really sure what they think the automatic part of that is if it’s not “AI” of some broad description. Paperless, Papermerge et al are basically wrappers for machine learning tools and have been for as long as they’ve existed. LLMs are a natural and obvious fit for the kind of work these applications exist to do.
This just feels like someone reading “Improved AI pathfinding” in the patch notes for a video game and screaming “OH MY GOD IS NOWHERE SAFE?!”
_Nemo_@lemmy.ml 1 day ago
True, although we must concede there is a difference between the simple machine learning already present in paperless and LLMs where, depending on quantization, CPU-based inference doesn’t get you very far.
Voroxpete@sh.itjust.works 14 hours ago
Absolutely there’s a difference. LLMs, when it comes to this specific task, are better. That’s why they’re being used here. It’s a job they are uniquely well suited to. They do indeed come with high hardware requirements, which is why you’re not forced to use them, and why they provide the option to offload the work to a cloud service.
Personally I would absolutely not want to ever feed my documents into an off-device model, but the point of self-hosted software is that it does what you tell it to and they absolutely should include letting you make bad decisions.
_Nemo_@lemmy.ml 13 hours ago
FTFY (although I share your judgment). No disagreement about the rest.