Comment

Rampsquatch@sh.itjust.works ⁨6⁩ ⁨hours⁩ ago

I can run a small LLM locally which I can talk to using voice to turn certain lights on and off, set reminders for me, play music etc.

Neat trick, but it’s not worth the headache of set up when you can do all that by getting off your chair and pushing buttons. Hell, you don’t even have to get off your chair! A cellphone can do all that already, and you don’t even need voice commands to do it.

Are you able to give any actual examples of a good use of an LLM?

source

Sort:hotnew top

Ek-Hou-Van-Braai@piefed.social ⁨5⁩ ⁨hours⁩ ago
Like it or not, that is an actual example.

I can lay in my bed and turn off the lights without touching my phone, or turn on certain muisic without touching my phone.

I could ask if I remembered to lock the front door etc.

But okay, I'll play your game, let's pretend that doesn't count.

I can use my local AI to draft documents or emails speeding up the process a lot.

Or I can used it to translate.

source
- Rampsquatch@sh.itjust.works ⁨5⁩ ⁨hours⁩ ago
  If you want to live your life like that, go for that’s your choice. But I don’t think those applications are worth the cost of running an LLM. To be honest I find it frivolous.
  
  I’m not against LLMs as a concept, but the way they get shoved into everything without thought and without an “AI” free option is absurd. There are good reasons why people have a knee-jerk anti-AI reaction, even if they can’t articulate it themselves.
  
  source
  - Ek-Hou-Van-Braai@piefed.social ⁨5⁩ ⁨hours⁩ ago
    It's not expensive for me to run a local LLM, I just use the hardware I'm already using for gaming.
    Electricity is cheap and most people with a gaming PC probably use more electricity than they would running their own Ai and asking it some questions.
    
    I'm also against shoving AI in evening, and not making it Opt-In. I'm also worried about privacy and concentration of power etc.
    
    But just outright saying LLMs are bad is rediculous.
    
    And saying there is no good reason to use them is rediculous. Can we stop doing that.
    
    source
    Rampsquatch@sh.itjust.works ⁨4⁩ ⁨hours⁩ ago
    
    It’s not expensive for me to run a local LLM, I just use the hardware I’m already using for gaming. Electricity is cheap and most people with a gaming PC probably use more electricity gaming than they would running their own LLM and asking it some questions.
    
    I don’t personally know the monetary cost of running one of these things locally, and I should be more informed before I make sweeping statements.
    
    I’m also against shoving AI in evening, and not making it Opt-In. I’m also worried about privacy and concentration of power etc.
    
    Then we are on the same page
    
    But just outright saying LLMs are bad is rediculous.
    
    I didn’t say that, in fact I said that I didn’t have a problem with them as a concept, go back to the previous point for a reason why someone might have instant dislike of “AI”
    
    And saying there is no good reason to use them is rediculous. Can we stop doing that.
    
    I also didn’t say that. I just said your examples weren’t good uses of it. I happen to think that there are very good applications for this technology, but none of those are publicly available GenAI slop and soulless automation systems/assistants that are really just corporate spyware to collect advertising data.
    
    If you want a “smart home” with voice commands because it make you feel like Tony Stark talking to Jarvis go right ahead, but don’t pretend that your locally run LLM is what people are talking about when they level criticism against “AI” (or even if they just say ‘AI bad’)
    
    source