Comment on AI agents wrong ~70% of time: Carnegie Mellon study
spankmonkey@lemmy.world 1 week ago
- narrowing down keywords for an unfamiliar topic
- getting a quick intro to an unfamiliar topic
- looking up facts you’re having trouble remembering (i.e. you’ll know it when you see it)
I used to be able to use Google and other search engines to do these things before they went to shit in the pursuit of AI integration.
sugar_in_your_tea@sh.itjust.works 1 week ago
Google search was pretty bad at each of those, even when it was good. Finding new keywords to use is especially difficult the more niche your area of search is, and I’ve spent hours trying different combinations until I found a handful of specific keywords that worked.
Likewise, search is bad for getting a broad summary, unless someone has bothered to write it on a blog. But most information goes way too deep and you still need multiple sources to get there.
Fact lookup is one the better uses for search, but again, I usually need to remember which source had what I wanted, whereas the LLM can usually pull it out for me.
I use traditional search most of the time (usually DuckDuckGo), and LLMs if I think it’ll be more effective. We have some local models at work that I use, and they’re pretty helpful most of the time.
jjjalljs@ttrpg.network 1 week ago
It is absolutely stupid, stupid to the tune of “you shouldn’t be a decision maker”, to think an LLM is a better use for “getting a quick intro to an unfamiliar topic” than reading an actual intro on an unfamiliar topic. For most topics, wikipedia is right there, complete with sources. For obscure things, an LLM is just going to lie to you.
As for “looking up facts when you have trouble remembering it”, using the lie machine is a terrible idea. It’s going to say something plausible, and you tautologically are not in a position to verify it. And, as above, you’d be better off finding a reputable source. If I type in “how do i strip whitespace in python?” an LLM could very well say “it’s your_string.strip()”. That’s wrong. Just send me to the fucking official docs.
There are probably edge or special cases, but for general search on the web? LLMs are worse than search.
sugar_in_your_tea@sh.itjust.works 1 week ago
The LLM helps me know what to look for in order to find that unfamiliar topic.
For example, I was tasked to support a file format that’s common in a very niche field and never used elsewhere, and unfortunately shares an extension with a very common file format, so searching for useful data was nearly impossible. So I asked the LLM for details about the format and applications of it, provided what I knew, and it spat out a bunch of keywords that I then used to look up more accurate information about that file format. I only trusted the LLM output to the extent of finding related, industry-specific terms to search up better information.
Likewise, when looking for libraries for a coding project, none really stood out, so I asked the LLM to compare the popular libraries for solving a given problem. The LLM spat out a bunch of details that were easy to verify (and some were inaccurate), which helped me narrow what I looked for in that library, and the end result was that my search was done in like 30 min (about 5 min dealing w/ LLM, and 25 min checking the projects and reading a couple blog posts comparing some of the libraries the LLM referred to).
I think this use case is a fantastic use of LLMs, since they’re really good at generating text related to a query.
I absolutely am though. If I am merely having trouble recalling a specific fact, asking the LLM to generate it is pretty reasonable. There are a ton of cases where I’ll know the right answer when I see it, like it’s on the tip of my tongue but I’m having trouble materializing it. The LLM might spit out two wrong answers along w/ the right one, but it’s easy to recognize which is the right one.
I’m not going to ask it facts that I know I don’t know (e.g. some historical figure’s birth or death date), that’s just asking for trouble. But I’ll ask it facts that I know that I know, I’m just having trouble recalling.
The right use of LLMs, IMO, is to generate text related to a topic to help facilitate research. It’s not great at doing the research though, but it is good at helping to formulate better search terms or generate some text to start from for whatever task.
I agree, it’s not great for general search. It’s great for turning a nebulous question into better search terms.
wise_pancake@lemmy.ca 1 week ago
One word of caution with AI searxh is that it’s weirdly vulnerable to SEO.
If you search for “best X for Y” and a company has an article on their blog about how their product solves a problem the AI can definitely summarize that into a “users don’t like that foolib because of …”. At least that’s been my experience looking for software vendors.
wise_pancake@lemmy.ca 1 week ago
It’s a bit frustrating that finding these tools useful is so often met with it can’t be useful for that, when it definitely is.
More than any other tool in history LLMs have a huge dose of luck involved and a learning curve on how to ask the right things the right way. And those method change and sister between models too.
spankmonkey@lemmy.world 1 week ago
No search engine or AI will be great with vague descriptions of niche subjects because by definition niche subjects are too uncommon to have a common pattern of ‘close enough’.
sugar_in_your_tea@sh.itjust.works 1 week ago
Which is why I use LLMs to generate keywords for niche subjects. LLMs are pretty good at throwing out a lot of related terminology, which I can use to find the actually relevant, niche information.
I wouldn’t use one to learn about a niche subject, but I would use one to help me get familiar w/ the domain to find better resources to learn about it.