It’s very funny that you can get ChaptGPT to spell out the word (making each letter an individual token) and still be wrong.
Of course it makes complete sense when you know how LLMs work, but this demo does a very concise job of short-circuiting the cognitive bias that talking machine == thinking machine.
PixelatedSaturn@lemmy.world 1 day ago
I find it bizarre that people find these obvious cases to prove the tech is worthless. Like saying cars are worthless because they can’t go under water.
skisnow@lemmy.ca 1 day ago
Not bizarre at all.
The point isn’t “they can’t do word games therefore they’re useless”, it’s “if this thing is so easily tripped up on the most trivial shit that a 6-year-old can figure out, don’t be going round claiming it has PhD level expertise”.
PixelatedSaturn@lemmy.world 1 day ago
I don’t want to defend ai again, but it’s a technology, it can do some things and can’t do others. By now this should be obvious to everyone. Except to the people that believe everything commercials tell them.
kouichi@ani.social 1 day ago
How many people do you think know that AIs are “trained on tokens”, and understand what that means? It’s clearly not obvious to those who don’t, which are roughly everyone.
sqgl@sh.itjust.works 1 day ago
332 instances of lawyers in Australia using AI evidence which “hallucinated”.
And this week one was finally punished.
1rre@discuss.tchncs.de 1 day ago
A six year old can read and write Arabic, Chinese, Ge’ez, etc. and yet most people with PhD level experience probably can’t, and it’s probably useless to them. LLMs can do this also. You can count the number of letters in a word, but so can a program written in a few hundred bytes of assembly. It’s completely pointless to make LLMs to do that, as it’d just make them way less efficient than they need to be while adding nothing useful.
skisnow@lemmy.ca 23 hours ago
LOL, it seems like every time I get into a discussion with an AI evangelical, they invariably end up asking me to accept some really poor analogy that, much like an LLM’s output, looks superficially clever at first glance but doesn’t stand up to the slightest bit of scrutiny.
echodot@feddit.uk 23 hours ago
So if the AI can’t do it then that’s just proof that the AI is too smart to be able to do it? That’s your arguement is it. Nah, it’s just crap
You think just because you attached it to an analogy that makes it make sense. That’s not how it works, look I can do it.
My car is way too technologically sophisticated to be able to fly, therefore AI doesn’t need to be able to work out how many l Rs are in “strawberry”.
See how that made literally no sense whatsoever.
knatschus@discuss.tchncs.de 1 day ago
Then why is Google using it for question like that?
Surely it should be advanced enough to realise it’s weakness with this kind of questions and just don’t give an answer.
PixelatedSaturn@lemmy.world 1 day ago
They are using it for every question. It’s pointless. The only reason they are doing it is to blow up their numbers.
TheGrandNagus@lemmy.world 1 day ago
Ding ding ding.
It’s so they can have impressive metrics for shareholders.
“Our AI had n interactions this quarter! Look at that engagement!”, with no thought put into what user problems it solves.
It’s the same as web results in the Windows start menu. “Hey shareholders, Bing received n interactions through the start menu, isn’t that great? Look at that engagement!”, completely obfuscating that most of the people who clicked are probably confused elderly users who clicked on a web result without realising.
Line on chart must go up!
echodot@feddit.uk 1 day ago
Well it also can’t code very well either
PixelatedSaturn@lemmy.world 1 day ago
echodot@feddit.uk 1 day ago
I feel like that was supposed to be an insult but because it made literally no sense whatsoever, I really can’t tell.
figjam@midwest.social 1 day ago
Understanding the bounds of tech makes it easier for people to gage its utility. The only people who desire ignorance are those that profit from it.
PixelatedSaturn@lemmy.world 1 day ago
Sure. But you can literally test almost all frontier models for free. It’s not like there is some conspiracy or secret. Even my 73 year old mother uses it and knows it’s general limits.
FishFace@lemmy.world 1 day ago
Saying “it’s worth trillions of dollars huh” isn’t really promoting that attitude.
EnsignWashout@startrek.website 19 hours ago
This reaction is because conmen are claiming that current generations of LLM technology is going to remove our need for experts and scientists.
We’re not demanding submersible cars, we’re just laughing about the people paying top dollar for the lastest electric car while plannig an ocean cruise.
I’m confident that there’s going to be a great deal of broken… everything…built with AI “assistance” during the next decade.
PixelatedSaturn@lemmy.world 17 hours ago
That’s not what you are doing at all. You are not laughing. Anti ai people are outraged, full of hatred and ready to pounce on anyone who isn’t as anti as they are. It’s a super emotional issue, especially on fediverse.
You may be confident, because you probably don’t know how software is built. Nobody is going to just abandon all the experience they have, vibe code something and release whatever. Thats not how it works.
EnsignWashout@startrek.website 15 hours ago
Oh shit. Nevermind then.