Treat LLMs like a super knowledgeable, enthusiastic, arrogant, unimaginative intern.
Comment on AI chatbots unable to accurately summarise news, BBC finds
Phoenicianpirate@lemm.ee 2 months ago
I learned that AI chat bots aren’t necessarily trustworthy in everything. In fact, if you aren’t taking their shit with a grain of salt, you’re doing something very wrong.
Knock_Knock_Lemmy_In@lemmy.world 2 months ago
milicent_bystandr@lemm.ee 2 months ago
Super knowledgeable but with patchy knowledge, so they’ll confidently say something that practically everyone else in the company knows is flat out wrong.
Phoenicianpirate@lemm.ee 2 months ago
I noticed that. When I ask it about things that I am knowledgeable about or simply wish to troubleshoot I often find myself having to correct it. This does make me hestitant to follow the instructions given on something I DON’T know much about.
Knock_Knock_Lemmy_In@lemmy.world 2 months ago
Oh yes. The LLM will lie to you, confidently.
Phoenicianpirate@lemm.ee 2 months ago
Exactly. I think this is a good barometer of gauging whether or not you can trust it. Ask it about things you know you’re good at or knowledgeable about. If it is giving good information, the type you would give out, then it is probably OK. If it is bullshitting you or making you go ‘uhh, no, actually…’ then you need to do more old-school research.
Redex68@lemmy.world 2 months ago
This is my personal take. As long as you’re careful and thoughtful whenever using them, they can be extremely useful.
Llewellyn@lemm.ee 2 months ago
Extremely?
echodot@feddit.uk 2 months ago
Could you tell me what you use it for because I legitimately don’t understand what I’m supposed to find helpful about the thing.
We all got sent an email at work a couple of weeks back telling everyone that they want ideas for a meeting next month about how we can incorporate AI into the business. I’m heading IT, so I’m supposed to be able to come up with some kind of answer and yet I have nothing. Even putting the side the fact that it probably doesn’t work as advertised, I still can’t really think of a use for it.
The main problem is it won’t be able to operate our ancient and convoluted ticketing system, so it can’t actually help.
Everyone I’ve ever spoken to has said that they use it for DMing or story prompts. All very nice but not really useful.
Knock_Knock_Lemmy_In@lemmy.world 2 months ago
Great for turning complex into simple.
Bad for turning simple into complex.
echodot@feddit.uk 2 months ago
I think my largest gripe with it is it can’t actually do anything. It can just tell you about stuff.
I can ask it how to change the desktop background on my computer and it will 100% be able to tell me, but if you then prompt it to change the background itself it won’t be able to. It has zero ability to interact with the computer, this is even the case with AI run locally.
It can’t move the mouse around it can’t send keyboard commands.
quokka1@mastodon.au 2 months ago
@echodot @Redex68 off top of my head, script generation. making content more readable. dictating a brain dump while walking and having it spit out a cohesive summary.
it's all about the prompt you put in. shit in/shit out. And making sure you check/understand what it spits out. and that sometimes it's garbage.
Phoenicianpirate@lemm.ee 2 months ago
I am a creative writer (as in, I write stories and stuff) or at least I used to be. Sometimes when talking to chatGPT about ideas for writing it can be interesting, but other times it is kinda annoying since I am more into fine tuning instead of having it innudate me with ideas that I don’t find particularly interesting.