Treat LLMs like a super knowledgeable, enthusiastic, arrogant, unimaginative intern.
Comment on AI chatbots unable to accurately summarise news, BBC finds
Phoenicianpirate@lemm.ee 1 week ago
I learned that AI chat bots aren’t necessarily trustworthy in everything. In fact, if you aren’t taking their shit with a grain of salt, you’re doing something very wrong.
Knock_Knock_Lemmy_In@lemmy.world 1 week ago
milicent_bystandr@lemm.ee 1 week ago
Super knowledgeable but with patchy knowledge, so they’ll confidently say something that practically everyone else in the company knows is flat out wrong.
Phoenicianpirate@lemm.ee 1 week ago
I noticed that. When I ask it about things that I am knowledgeable about or simply wish to troubleshoot I often find myself having to correct it. This does make me hestitant to follow the instructions given on something I DON’T know much about.
Knock_Knock_Lemmy_In@lemmy.world 1 week ago
Oh yes. The LLM will lie to you, confidently.
Phoenicianpirate@lemm.ee 1 week ago
Exactly. I think this is a good barometer of gauging whether or not you can trust it. Ask it about things you know you’re good at or knowledgeable about. If it is giving good information, the type you would give out, then it is probably OK. If it is bullshitting you or making you go ‘uhh, no, actually…’ then you need to do more old-school research.
Redex68@lemmy.world 1 week ago
This is my personal take. As long as you’re careful and thoughtful whenever using them, they can be extremely useful.
Llewellyn@lemm.ee 1 week ago
Extremely?
echodot@feddit.uk 1 week ago
Could you tell me what you use it for because I legitimately don’t understand what I’m supposed to find helpful about the thing.
We all got sent an email at work a couple of weeks back telling everyone that they want ideas for a meeting next month about how we can incorporate AI into the business. I’m heading IT, so I’m supposed to be able to come up with some kind of answer and yet I have nothing. Even putting the side the fact that it probably doesn’t work as advertised, I still can’t really think of a use for it.
The main problem is it won’t be able to operate our ancient and convoluted ticketing system, so it can’t actually help.
Everyone I’ve ever spoken to has said that they use it for DMing or story prompts. All very nice but not really useful.
quokka1@mastodon.au 4 days ago
@echodot @Redex68 off top of my head, script generation. making content more readable. dictating a brain dump while walking and having it spit out a cohesive summary.
it's all about the prompt you put in. shit in/shit out. And making sure you check/understand what it spits out. and that sometimes it's garbage.
Knock_Knock_Lemmy_In@lemmy.world 1 week ago
Great for turning complex into simple.
Bad for turning simple into complex.
echodot@feddit.uk 1 week ago
I think my largest gripe with it is it can’t actually do anything. It can just tell you about stuff.
I can ask it how to change the desktop background on my computer and it will 100% be able to tell me, but if you then prompt it to change the background itself it won’t be able to. It has zero ability to interact with the computer, this is even the case with AI run locally.
It can’t move the mouse around it can’t send keyboard commands.
Phoenicianpirate@lemm.ee 1 week ago
I am a creative writer (as in, I write stories and stuff) or at least I used to be. Sometimes when talking to chatGPT about ideas for writing it can be interesting, but other times it is kinda annoying since I am more into fine tuning instead of having it innudate me with ideas that I don’t find particularly interesting.