Comment on Google has sent internet into ‘spiral of decline’, claims DeepMind co-founder
squaresinger@feddit.de 11 months agoYeah, because people selling AI products have a great track record on predicting how their products will develop in the future. Because of that, Teslas don’t have steering wheels any more, because Full Self Driving drives people incident-free from New York to California since 2017.
The thing with AI development is, that it rapidly gets to 50% of the desired solution, but then gets stuck there, not being able to get consistently good enough that you can actually rely on it.
Zeth0s@lemmy.world 11 months ago
I don’t really understand what it means. If the product is unreliable people won’t use it, and everything will stay as it is now. It’s not a big issue. But It is already pretty reliable for many use cases.
Realistically the real future problem will be monetization, not features
Phanatik@kbin.social 11 months ago
Well, here's the thing. How often are you willing to dismiss the misses because of the hits? Your measure of unreliability is now subject to bias because you're no longer assessing the bot's answers objectively.
Zeth0s@lemmy.world 11 months ago
I don’t expect to be 100% correct. I have realistic expectations built on experience. Any source isn’t 100% reliable. A friend is 50% reliable, an expert maybe 95. A random web page probably 40… I don’t know.
I built up my strategy to address uncertainty by applying critical thinking. It is not much different than in the past. By experience, chatgpt 4 is currently more reliable than a random web page that comes in the first page of a Google search. Unless I exactly search for a trustworthy source, such as nhs or guardian.
The main problem is the drop in quality of search engines. I usually start with chatgpt 4 without plugins to focus my research. Once I understand what I should look for, I use search engines for focused search on official websites or documentation pages.
squaresinger@feddit.de 11 months ago
The issue with reliability is a completely different one between web search and AI.
If you search something on Google, there are quite a few ways you can judge the quality of the answer with “metadata” around it. If you find a scientific paper, it’s probably more reliable than a post on a parents forum. If the source is a quality newspaper or Wikipedia, that’s also more on the reliable side, but some conspiracy theorist website is not. And if the source is some kind of forum or Q&A site, wrong answers often have comments under them that correct the error.
Also, you can follow multiple links and take a wider sample on the topic that way.
With AI that’s not possible. Whether it is wrong or correct, the AI will give you an answer in the exact same format, with the same self-confident tone. You basically need to know the correct answer to know whether the answer is correct.
Sure, you can re-roll and ask it again, but that doesn’t make the result more likely to be correct.
For example, I asked ChatGPT which Harry Potter chapter is the longest. It happily gave me a chapter, but it wasn’t the longest. So I asked again and again and again, and each time it gave me a new wrong answer, every time with made-up word counts.