Comment on What exactly is a self-hosted small LLM actually good for (<= 3B)

• CrayonDevourer@lemmy.world ⁨2⁩ ⁨months⁩ ago

  Yes. The small LLM isn’t retrieving data, it’s just understanding context of text enough to know what “Facts” need to be written to a file.

  source

  • catty@lemmy.world ⁨2⁩ ⁨months⁩ ago

    Some questions and because you don’t actually understand, also, the answers.

    • what does the LLM understand the context of, (other user’s data owned by Twitch)
    • How is the LLM fed that data? (You store it and feed it to the LLM)
    • Do you use Twitch’s data and its users data through an AI without their consent? (Most likely, yes)
    • Do you have consent from the users to store ‘facts’ about them (You’re pissy, so obviously not)
    • Are you then storing that processed data? (Yes, you are, written to a file)
    • Is the purpose this data processing commercial (Yes, it is, designed to increase viewer count for the user of this system - and before you retort “OMG it helps twitch too”… Uhm no, Twitch has the viewers if not watching him, watching someone else)

    I mean yeah, it’s a use case, but own up to the fact that you’re wrong. Or be pissy. I don’t care.

    source

    • CrayonDevourer@lemmy.world ⁨2⁩ ⁨months⁩ ago

      So this wasn’t a post actually asking what a small LLM was good for, it was just an opportunity you could use to dump on LLM usage I take it.

      source

      • catty@lemmy.world ⁨2⁩ ⁨months⁩ ago

        You’re conflating me asking how to use these tools with you who’s misusing them. I see you still don’t accept what you’re doing is wrong. But go you.

        source