they’re pretty good, and the faults they have are improving steadily. I dont think we’re hitting a ceiling yet, and I shudder to think where they’ll be in 5 years.
Comment on The air begins to leak out of the overinflated AI bubble
rottingleaf@lemmy.world 1 week agoyou can put out an idea in plain language, and get back code that just “does” it
No you can’t. Simplifying it grossly:
They can’t do the most low-level, dumbest detail, splitting hairs, “there’s no spoon”, “this is just correct no matter how much you blabber in the opposite direction, this is just wrong no matter how much you blabber to support it” kind of solutions.
And that happens to be main requirement that makes a task worth software developer’s time.
We need software developers to write computer programs, because “a general idea” even in a formalized language is not sufficient, you need to address details of actual reality. That is the bottleneck.
That technology widens the passage in the places which were not the bottleneck in the first place.
tetris11@lemmy.ml 1 week ago
Grandwolf319@sh.itjust.works 1 week ago
this is just wrong no matter how much you blabber to support it" kind of solutions.
When you put it like that, I might be a perfect fit in today’s world with the loudest voice wins landscape.
rottingleaf@lemmy.world 1 week ago
I regularly think and post conspiracy theory thoughts about why the “AI” is such a hype. And in line with them a certain kind of people seem to think that reality doesn’t matter, because those who control the present control the past and the future. That is, they think that controlling the discourse can replace controlling the reality. The issue with that is that whether a bomb is set, whether a boat is sea-worthy, whether a bridge will fall is not defined by discourse.
TropicalDingdong@lemmy.world 1 week ago
I think you live in a nonsense world. I literally use it everyday and yes, sometimes it’s shit and it’s bad at anything that even requires a modicum of creativity. But 90% of shit doesn’t require a modicum of creativity. And my point isn’t about where we’re at, it’s about how far the same tech progressed on another domain adjacent task in three years.
Lemmy has a “dismiss AI” fetish and does so at its own peril.
barsoap@lemm.ee 1 week ago
First off, are you extrapolating the middle part of the sigmoid thinking it’s an exponential. Secondly, link.springer.com/…/s11633-017-1093-8.pdf
rottingleaf@lemmy.world 1 week ago
I’ve written something vague in another place in this thread which seemed a good enough argument. But I didn’t expect that someone is going to link a literal scientific publication in the same very direction. Thank you, sometimes arguing in the Web is not a waste of time.
TropicalDingdong@lemmy.world 1 week ago
Dismiss at your own peril is my mantra on this. I work primarily in machine vision and the things that people were writing on as impossible or “unique to humans” in the 90s and 2000s ended up falling rapidly, and that generation of opinion pieces are now safely stored in the round bin.
The same was true of agents for games like go and chess and dota. And now the same has been demonstrated to be coming true for languages.
And maybe that paper built in the right caveats about “human intelligence”. But that isn’t to say human intelligence can’t be surpassed by something distinctly inhuman.
The real issue is that previously there wasn’t a use case with enough viability to warrant the explosion of interest we’ve seen like with transformers.
But transformers are like, legit wild. It’s bigger than UNETs. It’s way bigger than ltsm.
So dismiss at your own peril.
barsoap@lemm.ee 1 week ago
Tell me you haven’t read the paper without telling me you haven’t read the paper. The paper is about T2 vs. T3 systems, humans are just an example.
rottingleaf@lemmy.world 1 week ago
Are you a software developer? Or a hardware developer?
TropicalDingdong@lemmy.world 1 week ago
Machine learning scientist.
hark@lemmy.world 1 week ago
That explains your optimism. Code generation is at a stage where it slaps together Stack Overflow answers and code ripped off from GitHub for you. While that is quite effective to get at least a crappy programmer to cobble together something that barely works, it is a far cry from having just anyone put out an idea in plain language and getting back code that just does it. A programmer is still needed in the loop.
I’m sure I don’t have to explain to you that AI development over the decades has often reached plateaus where the approach needed to be significantly changed in order for progress to be made, but it could certainly be the case where LLMs (at least as they are developed now) aren’t enough to accomplish what you describe.
rottingleaf@lemmy.world 1 week ago
So close, but not there.
OK, you’ll know that I’m right when you somewhat expand your expertise to neighboring areas. Should happen naturally.
Jesus_666@lemmy.world 1 week ago
And I wouldn’t know where to start using it. My problems are often of the “integrate two badly documented company-internal APIs” variety. LLMs can’t do shit about that; they weren’t trained for it.
They’re nice for basic rote work but that’s often not what you deal with in a mature codebase.
TropicalDingdong@lemmy.world 1 week ago
Again, dismiss at your own peril.
Because “Integrate two badly documented APIs” is precisely the kind of tasks that even the current batch of LLMs actually crush.
And I’m not worried about being replaced by the current crop. I’m worried about future frameworks on technology like greyskull running 30, or 300, or 3000 uniquely trained LLMs and other transformers at once.
EatATaco@lemm.ee 1 week ago
I’m with you. I’m a Senior software engineer and copilot/chatgpt have all but completely replaced me googling stuff, and replaced 90% of the time I’ve spent writing the code for simple tasks I want to automate. I’m regularly shocked at how often copilot will accurately auto complete whole methods for me. I’ve even had it generate a whole child class near perfectly, although this is likely primarily due to being very consistent with my naming.
At the very least it’s an extremely valuable tool that every programmer should get comfortable with. And the tech is just in it’s baby form. I’m glad I’m learning how to use it now instead of poo pooing it.