Over half of all tech industry workers view AI as overrated::undefined
Over half of tech industry workers have seen the “great demo -> overhyped bullshit” cycle before.
Submitted 11 months ago by L4s@lemmy.world [bot] to technology@lemmy.world
https://www.techspot.com/news/100905-over-half-all-tech-industry-workers-view-ai.html
Over half of all tech industry workers view AI as overrated::undefined
Over half of tech industry workers have seen the “great demo -> overhyped bullshit” cycle before.
You just have to leverage the agile AI blockchain cloud.
Once we’re able to synergize the increased throughput of our knowledge capacity we’re likely to exceed shareholder expectation and increase returns company wide so employee defecation won’t be throttled by our ability to process sanity.
Don’t forget to make it connected to every device, ever
Every billboard in SF is just these words shuffled
No SQL, block chain, crypto, metaverse, just to name a few recent examples.
AI is overhyped, but it is, so far, more useful than any of those other examples, though.
These are useful technologies if used when called for. They aren’t all in one solutions like the smart phone killing off cameras, pdas, media players… I think if people looked at them as tools which fix specific problems, we’d all be happier.
Every year sometimes.
Largely because we understand that what they’re calling “AI” isn’t AI.
This is a growing pet peeve of mine. If and when actual AI becomes a thing, it’ll be a major turning point for humanity comparable to things like harnessing fire or electricity.
…and most people will be confused as fuck. “We’ve had this for years, what’s the big deal?” -_-
I also believe that will happen! We will not be prepared since many don’t understand the differences between what current models do and what an actual general AI could potentially do.
It also saddens me that many don’t know or ignore how fundamental abstract reasoning is to our understanding of how human intelligence works. And that LLMs simply aren’t intelligent in that sense (or at all, if you take a tight definition of intelligence).
AI doesn’t necessarily mean human-level intelligence, if that’s what you mean. The AI field has wrestled with this for decades. There can be “strong AI”, which is aiming for that human-level intelligence, but that’s probably a far off goal. The “weak AI” is about pushing the boundaries of what computers can do, and that stuff has been massively useful even before we talk about the more modern stuff.
Sounds like people here are expecting to see GPAI and singularity stuff, but all they see is a pitiful LLM or other even more narrow AI applications. Remember, even character recognition used to be called AI until it became so common that it wasn’t exciting any more. What AI developers call AI today, is just basic automation and few decades later.
It absolutely is AI. A lot of stuff is AI.
It’s just not that useful.
The decision tree my company uses to deny customer claims is not AI despite the business constantly referring to it as such.
There’s definitely a ton of “AI” in the business world that is not better than an If/Else statement.
It’s useful at sucking down all the compute we complained crypto used
You really should listen rather than talk. This is not AI, it’s just a word prediction model.
There are significant differences between statistical models and AI.
I work for an analytics department at a fortune 100 company. We have a very clear delineation between what constitutes a model and what constitutes an AI.
Optimizing compilers came directly out of AI research. The entirety of modern computing is built on it.
Yup. LLM RAG is just search 2.0 with a GPU.
For certain use cases it’s incredible, but those use cases shouldn’t be your first idea for a pipeline
Given that AI isn’t purported to be AGI, how do you define AI such that multimodal transformers capable of developing abstract world models as linear representations and trained on unthinkable amounts of human content mirroring a wide array of capabilities which lead to the ability to do things thought to be impossible as recently as three years ago (such as explain jokes not in the training set or solve riddles not in the training set) isn’t “artificial intelligence”?
THANK YOU! I’ve been saying this a long time, but have just kind of accepted that the definition of AI is no longer what it was.
I think it will be the next big thing in tech (or “disruptor” if you must buzzword). But I agree it’s being way over-hyped for where it is right now.
Clueless executives barely know what it is, they just know they want it get ahead of it in order to remain competitive. Marketing types reporting to those executives oversell it (because that’s their job).
One of my friends is an overpaid consultant for a huge corporation, and he says they are trying to force-retro-fit AI to things that barely make any sense…just so that they can say that it’s “powered by AI”.
On the other hand, AI is much better at some tasks than humans. That AI skill set is going to grow over time. And the accumulation of those skills will accelerate. I think we’ve all been distracted, entertained, and a little bit frightened by chat-focused and image-focused AIs. However, AI as a concept is broader and deeper than just chat and images. It’s going to do remarkable stuff in medicine, engineering, and design.
Personally, I think medicine will be the most impacted by AI. Medicine has already been increasingly implementing AI in many areas, and as the tech continues to mature, I am optimistic it will have tremendous effect. Already there are many studies confirming AI’s ability to outperform leading experts in early cancer and disease diagnoses. Just think what kind of impact that could have in developing countries once the tech is affordably scalable. Then you factor in how it can greatly speed up treatment research and it’s pretty exciting.
That being said, it’s always wise to remain cautiously skeptical.
The bad part is health insurance companies are also using AI.
I’s ability to outperform leading experts in early cancer and disease diagnoses
It does, but it also has a black box problem.
A machine learning algorithm tells you that your patient has a 95% chance of developing skin cancer on his back within the next 2 years. Ok, cool, now what? What, specifically, is telling the algorithm that? What is actionable today? Do we start oncological treatment? According to what, attacking what? Do we just ask the patient to aggressively avoid the sun and use liberal amounts of sun screen? Do we start a monthly screening, bi-monthly, yearly, for how long do we keep it up? Should we only focus on the part that shows high risk or everywhere? Should we use the ML every single time? What is the most efficient and effective use of the tech? We know it’s accurate, but is it reliable?
There are a lot of moving parts to a general medical practice. And AI has to find a proper role that requires not just an abstract statistic from an ad-hoc study, but a systematic approach to healthcare. Right now, it doesn’t have that because the AI model can’t tell their handlers what it is seeing, what it means, and how it fits in the holistic view of human health. We can’t just blindly trust it when there’s human lives in the line.
As you can see, this seems to be relegating AI to a research role for the time being, and not on a diagnosing capacity yet.
Like you say, “AI” isn’t just LLMs and making images. We have previously seen, for example, expert systems, speech recognition, natural language processing, computer vision, machine learning, now LLM and generative art.
The earlier technologies have gone through their own hype cycles and come out the other end to be used in certain useful ways. AI has no doubt already done remarkable things in various industries. I can only imagine that will be true for LLMs some day.
I don’t think we are very close to AGI yet. Current AI like LLMs and machine vision require a lot of manual training and tuning. As far as I know, few AI technologies can learn entirely on their own and those that do are limited in scope. I’m not even sure AGI is really necessary to solve most problems. We may do AI “ala carte” for many years and one day someone will stitch a bunch of things together, et voila.
Thanks.
I’m glad you mentioned speech. Tortoise-TTS is an excellent text to speech AI tool that anyone can run on a GPU at home. I’ve been looking for a TTS tool that can generate a more natural -sounding voice for several years. Tortoise is somewhat labor intensive to use for now, but to my ear it sounds much better than the more expensive cloud-based solutions. It can clone voices convincingly, too. (Which is potentially problematic).
Honestly I believe AGI is currently a compute resource problem less than a software problem. A paper came out awhile ago showing that individual neurons in the human brain displayed behavior like decently sized deep learning models. If this is true the number of nodes required for artificial neural nets to even come close to human like intelligence maybe astronomically higher then predicted.
It is overrated. At least when they look at AI as some sort of brain crutch that redeems them from learning stuff.
My boss now believes he can “program too” because he let’s ChatGPT write scripts for him that more often than not are poor bs.
He also enters chunks of our code into ChatGPT when we issue bugs or aren’t finished with everything in 5 minutes as some kind of “Gotcha moment”, ignoring that the solutions he than provides don’t work.
Too many people see LLMs as authorities they just aren’t…
It bugs me how easily people (a) trust the accuracy of the output of ChatGPT, (b) feel like it’s somehow safe to use output in commercial applications or to place output under their own license, as if the open issues of copyright aren’t a ten-ton liability hanging over their head, and © feed sensitive data into ChatGPT, as if OpenAI isn’t going to log that interaction and train future models on it.
I have played around a bit, but I simply am not carefree/careless or am too uptight (pick your interpretation) to use it for anything serious.
Too many people see LLMs as authorities they just aren’t…
This is more a ‘human’ problem than an ‘AI’ problem.
In general it’s weird as heck that the industry is full force going into chatbots as a search replacement.
Like, that was a neat demo for a low hanging fruit usecase, but it’s pretty damn far from the ideal production application of it given that the tech isn’t actually memorizing facts and when it gets things right it’s a “wow, this is impressive because it really shouldn’t be doing a good job at this.”
Meanwhile nearly no one is publicly discussing their use as classifiers, which is where the current state of the tech is a slam dunk.
Overall, the past few years have opened my eyes to just how broken human thinking is, not as much the limitations of neural networks.
It is overrated. It has a few uses, but it’s not a generalized AI. It’s like calling a basic calculator a computer. Sure it is an electronic computing device and makes a big difference in calculating speed for doing finances or retail cashiers or whatever. But it’s not a generalized computing system that can basically compute anything that it’s given instructions for which is what we think of when we hear something is a “computer”. It can only do basic math. It could never be used to display a photo , much less make a complex video game.
Similarly the current thing that’s called “AI”, can learn in a very narrow subject that it is designed for. It can’t learn just anything. It can’t make inferences beyond the training material or understand. It can’t create anything totally new, it just remixes things. It could never actually create a new genre of games with some kind of new interface that has never been thought of, or discover the exact mechanisms of how gravity works, since those things aren’t in its training material since they don’t yet exist.
Some calculators can run DooM, though
Lol, those are different. I meant like a little solar powered addition, subtraction, multiplication, division and that’s it kind of calculator.
Many areas of machine learning, particularly LLMs are making impressive progress but the usual ycombinator techbro types are over hyping things again. Same as every other bubble including the original Internet one and the crypto scams and half the bullshit companies they run that add fuck all value to the world.
The cult of bullshit around AI is a means to fleece investors. Seen the same bullshit too many times. Machine learning is going to have a huge impact on the world, same as the Internet did, but it isn’t going to happen overnight. The only certain thing that will happen in the short term is that wealth will be transferred from our pockets to theirs. Fuck them all.
ML has already had a huge impact on the world (for better or worse), to the extent that Yann LeCun proposes that the tech giants would crumble if it disappeared overnight. For several years it’s been the core of speech-to-text, language translation, optical character recognition, web search, content recommendation, social media hate speech detection, to name a few.
ML based handwriting recognition has been powering postal routing for a couple of decades. ML completely dominates some areas and will only increase in impact as it becomes more widely applicable. Getting any technology from a lab demo to a safe and reliable real world product is difficult and only more so when there are regulatory obstacles and people being dragged around by vehicles.
For the purposes of raising money from investors it is convenient to understate problems and generate a cult of magical thinking about technology. The hype cycle and the manipulation of the narrative has been fairly obvious with this one.
Reality: most tech workers view it as fairly rated or slightly overrated according to the real data: www.techspot.com/…/2023-11-20-image-3.png
Which is fair. AI at work is great but it only does fairly simple things. Nothing i can’t do myself but saves my sanity and time.
It’s all i want from it and it delivers.
Helps me write hacky scripts to solve one off problems. Honestly, it saves me a few work days.
But it’s far from replacing anybody.
Slightly overrated is where I would put it, absolutely. It’s overhyped, but god if the recent advancements aren’t impressive.
I have a doctorate in computer engineering, and yeah it’s overhyped to the moon.
I’m oversimplifying it and some one will ackchyually me but once you understand the core mechanics the magic is somewhat diminished. It’s linear algebra and matrices all the way down.
We got really good at parallelizing matrix operations and storing large matrices and the end result is essentially “AI”.
Big emphasis on the ‘A’
I remember when it first came out I asked it to help me write a MapperConfig custom strategy and the answer it gave me was so fantastically wrong - even with prompting - that I lost an afternoon. Honestly the only useful thing I’ve found for it is getting it to find potential syntax errors in terraform code that the plan might miss. It doesn’t even complement my programming skills like a traditional search engine can do; instead it assumes a solution that is usually wrong and you are left to try to build your house on the boilercode sand it spits out at you.
Have you used copilot? I find it to be fantastically useful.
It’s a general problem with ChatGPT(free), the more obscure the topic, the more useless the answers will be. It works pretty good for Wikipedia-style general knowledge, but everything that goes even a little deeper is a mess. This is true even when it comes to things that shouldn’t be that obscure, e.g. pop-culture things like movies. It can give you a summary of StarWars, but anything even a little more outside the mainstream it makes up on the spot.
How much better is ChatGPT-Pro when it comes to this? Can it answer /r/tipofmytongue/ style question?
I’ve found the free one can sometimes answer tip of my tongue questions but yeah anything even remotely obscure it will just lie and say that doesn’t exist, especially if you stray a little too close to the puritanical guard rails. One time I was going down a rabbit hole researching human sex organ variations and it flat out told me the people in South America who grow a penis at 12 don’t exist until I found the name guevedoces on my own, and wouldn’t you know it then it knew what I was talking about.
I also have tried to use it to help with programming problems, and it is confidently incorrect a high percentage (50%) of the time. It will fabricate package names, functions, and more. When you ask it to correct itself, it will give another confidently incorrect answer. Do this a few more times and you could end up with it suggesting the first incorrect answer it gave you and then you realize it is literally leading you in circles.
It’s definitely a nice option to check something quickly, and it has given me some good information, but you really can’t blindly trust its output.
id say its like the dotcom bubble.
yeah its incredible new & emerging tech,
but that doesnt mean it isnt overhyped.
I mean the dotcom bubble was overhyped, it was a bubble
That’s what they said.
The internet was revolutionary, but dotcom was overhyped at the time.
It also produced useful things. Both statements are true, and are true of the deep learning models around now.
What’s the dotcom bubble?
a bubble is kind of a goldrush situation,
where busineses and investors on mass jump into a new / hyped market or asset type without a propper plan & buisness model.
for example the first recorded one: the tulip mania
the dot-com bubble was a massive bubble in the 90s centered arrount the emerging concept of “internet buissneses”
That’s because it is overrated and the people in the tech industry are actually qualified to make that determination. It’s a glorified assistant, nothing more. we’ve had these for years, they’re just getting a little bit better. it’s not gonna replace a network stack admin or a programmer anytime soon.
I work in AI, and I think AI is overrated.
People who use ChatGPT to program for them deserve their programs to fail
Yeah , they should copy paste answers from stack overflow like real developers.
Sounds like you don’t know how to use AI to work faster and are just jealous.
There is a lot of marketing about how it’s going to disrupt every possible industry, but I don’t think that’s reasonable. Generative AI has uses, but I’m not totally convinced it’s going to be this insane omni-tool just yet.
whenever we have new technology, there will always be folks flinging shit on the walls to see what sticks. AI is no exception and you’re most likely correct that not every problem needs an AI-powered solution.
Sure, it is already changing some fields, and more and more fields are beginning to feel the impact in the coming decades. However, we’re still pretty far from a true GPAI, so letting the AI do all the work isn’t going to happen any time soon.
Garbage in, garbage out still applies here. If we don’t collect data in the appropriate way, you can’t expect to teach a model with that. Once we start collecting data with ML in mind, that’s when things start changing quickly. Currently, we have lots and lots of garbage data about everything, and that’s why we aren’t using AI to more.
Because it is?
I work in tech. AI is overrated.
In my experience, well over half of tech industry workers don’t even understand it.
I was just trying to explain to someone on Hacker News that no, the “programmers” of LLMs do not in fact know what the LLM is doing because it’s not being programmed directly at all (which even after several rounds of several people explaining still doesn’t seem to have sunk in).
Even people that do understand the tech more generally pretty well are still remarkably misinformed about it in various popular BS ways, such as that it’s just statistics and a Markov chain, completely unaware of the multiple studies over the past 12 months showing that even smaller toy models are capable of developing abstract world models as long as they can be structured as linear representations.
It’s to the point that unless it’s in a thread explicitly on actual research papers where explaining nuances seem fitting I don’t even bother trying to educate the average tech commentators regurgitating misinformation anymore. They typically only want to confirm their biases anyways, and have such a poor understanding of specifics it’s like explaining nuanced aspects of the immune system to anti-vaxxers.
Meh. Roughly 90% of what I know about baking is from chatgpt. There just wasn’t a comparable resource. “Oh God the dough is too dry”, “can I sub in this fat for this fat and if so how?”, “if I change the bath do I have to change the score method?”.
It is like I have a professional baker I can just talk to whenever. I am sure as I get better at baking I will exceed it’s ability to help but I can’t deny that what I have accomplished now I could not have in the same timeframe without it.
Of course, because hype didn’t come from tech people, but content writers, designers, PR people, etc. who all thought they didn’t need tech people anymore. The moment ChatGPT started being popular I started getting debugging requests from few designers. They went there and asked it to write a plugin or a script they needed. Only problem was it didn’t really work like it should. Debugging that code was a nightmare.
I’ve seen few clever uses. Couple of our clients made a “chat bot” whose reference was their poorly written documentation. So you’d ask a bot something technical related to that documentation and it would decipher the mess. I still claim making a better documentation was a smarter move, but what do I know.
I’ll join in on the cacophony in this thread and say it truly is way overrated right now. Is it cool and useful? Sure. Is it going to replace all of our jobs and do all of our thinking for us from now on? Not even close.
I, as a casual user, have already noticed some significant problems with the way that it operates such that I wouldn’t blindly trust any output that I get without some serious scrutiny. AI is mainly being pushed by upper management-types who don’t understand what it is or how it works, but they hear that it can generate stuff in a fraction of the time a person can and they start to see dollar signs.
It’s a fun toy, but it isn’t going to change the world overnight.
On one hard there’s the emergence of the best chat bot we’ve ever created. Neat, I guess.
On the other hand, there’s VC capital scurrying around for the next big thing to invest in, lazy journalism looking for a source of new content to write about, talentless middle management looking for something to latch on to so they can justify their existence through cost cutting, and FOMO from people who don’t understand that it’s just a fancy chat bot.
Yeah… About that… How’s block chain going these days? Solved all the problems in the world yet?
The other half have actually used it
Overrated? Compared to what AGI that does not exist yet? Overhyped though? Absolutely.
We went from very little AI content making its way to your eyeballs and ears, to it occurring daily if not during your very session here today. So many thumbnails and writeups have used AI that to say it is overrated it a bit absurd unless you were expecting it to be be AGI, then yes the AI today is overrated, but it does not matter as you are consuming it still.
I use github copilot. It really is just fancy autocomplete. It’s often useful and is indeed impressive. But it’s not revolutionary.
I’ve also played with ChatGPT and tried to use it to help me code but never successfully. The reality is I only try it if google has failed me, and then it usually makes up something that sounds right but is in fact completely wrong. Probably because it’s been trained on the same insufficient data I’ve been looking at.
It’s me. I’m over half of all tech industry workers.
As with all tech; it depends. It’s another tool in my toolbox and a useful one at that. Will it replace me in my job? Not anytime soon. However, it will make me more proficient at my job and my 30+ years of experience will keep its bad ideas out of production. If my bosses decide tomorrow that I can be replaced with AI in the current state, they deserve what they have coming. That said, they are willing to pay for additional tooling provided me with multiple AI engines and I can’t be more thrilled. I’d rather give AI a simple task to do the busy work than work with overseas developers that get it wrong time and time again and take a week to iterate while asking how for loops work in Python.
That is a terrible graph. There’s no y axis, there’s no indication of what the scale is, and I don’t know how many people they asked or who these people were or what tech company they worked in.
it’s very good sometimes and very stupid other times, and you have to know enough about the subject to distinguish it
someguy3@lemmy.world 11 months ago
Best assessment I’ve heard: Current AI is an aggressive autocomplete.
blackwateropeth@lemmy.world 11 months ago
I’ve found that relying on it is a mistake anyhow, the amount of incorrect information I’ve seen from chatgpt has been crazy. It’s not a bad thing to get started with it but it’s like reading a grade school kids homework, you need to proofread the heck out of it.
TrickDacy@lemmy.world 11 months ago
What always strikes me as weird is how trusting people are of inherently unreliable sources. Like why the fuck does a robot get trust automatically? It’s a fuckin miracle it works in the first place. You double check that robot’s work for years and it’s right every time? Yeah okay maybe then start to trust it. Until then, what reason is there not to be skeptical of everything it says?
People who Google something and then accept whatever Google pulls out of webpages and puts at the top as fact… confuse me. Like all machines, there are failures. Why would we trust that the opposite is true?
jballs@sh.itjust.works 11 months ago
I feel like the AI in self-driving cars is the same way. They’re like driving with a 15 year old that just got their learners permit.
Turns out that getting a computer to do 80% of a good job isn’t so great. It’s that extra 20% that makes all the difference.
hushable@lemmy.world 11 months ago
I just reviewed a PR today and the code was… bad, like unusually bad for mycoworkers and left some comments.
Then my coworker said he used chatgpt without really thinking on what he was copypasting.
punkwalrus@lemmy.world 11 months ago
I have found that it’s like having a junior programmer assistant. It’s great for “write me python code for opening an in file from a command line argument, reading the contents into a key/value dict array, then closing the file.” It’s terrible for “write me a python code for pulling data into a redis database.”
I find it’s wrong 50% of the time for certain command line switches, Linux file structure, and aws cli.
I find it’s terrible for advanced stuff like, “using aws cli and jq, take all volumes in a vpc, and display the volume id, volume size in gb, instance id it’s attached to, private IP address of the instance, whether is a gp3 or gp2, and the vpc id in a comma separated format, sorted by volume size.”
Even worse at, “take all my gp2 volumes and make them gp3.”
Anomalous_Llama@lemmy.world 11 months ago
I recently used it to update my resume with great success. But I also didn’t just blindly trust it.
Gave it my resume and then asked it to edit my resume to more closely align with a guide I found on Harvards website. Gave it the guide as well and it spit out a version of mine that much more closely resembled the provided guide.
Spent roughly 5 minutes editing the new version to correct for any problems it had and boom. Half an hour of worked parsed down to sub 10
I then had it use my new resume (I gave it a copy of the edited version) and asked it to write me a cover letter for a job (I provided the job description)
Boom. Cover letter. I spent about 10 minutes editing that piece. And then that new resume and cover letter lead to an interview and subsequent job offer.
AI is a tool not an all in one solution.
WhiskyTangoFoxtrot@lemmy.world 11 months ago
www.cs.cornell.edu/info/people/…/history.html
pineapplelover@lemm.ee 11 months ago
And that’s entirely correct
Willy@sh.itjust.works 11 months ago
No. It’s not and hasn’t been for at least a year. Maybe the ai your dealing with is, but it’s shown understanding of concepts in ways that make no sense for how it was created. Gotta go.
kromem@lemmy.world 11 months ago
Too bad it’s bullshit.
If you are actually interested in the topic, here’s a few good reads:
Do Large Language Models learn world models or just surface statistics? (Jan 2023)
Actually, Othello-GPT Has A Linear Emergent World Representation (Mar 2023)
Eight Things to Know about Large Language Models (April 2023)
Language Models Represent Space and Time (Oct 2023)
The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets (Oct 2023)
As you can see, the past year has shed a lot of light on the topic.
One of my favorite facts is that it takes on average 17 years before discoveries in research find their way to the average practitioner in the medical field. While tech as a discipline may be more quick to update itself, it’s still not sub-12 months, and as a result a lot of people are continuing to confidently parrot things that have recently been shown in research circles to be BS.