Comment on Preserving The Web Is Not The Problem. Losing It Is.
daychilde@lemmy.world 3 days agoSo kinda like an ethical LLM^[But I get your distinctions and I’m on board with that. It’d be nice!]. I’d be on board with that.
I know it’s unpopular to say, but I’ve found the latest version of Gemini to be pretty useful. But you have to know what they’re good for and not. General knowledge? Generally pretty decent. But you have to ask for sources and check those sources, and don’t tell it what you think, ask it what it knows and to admit when it doesn’t know things. I wouldn’t put my life on the line, but for looking up random stuff, it’s pretty decent.
I know LLMs will get worse and shittier, which I think is a bummer, because they could be so damned useful.
vacuumflower@lemmy.sdf.org 2 days ago
It would be similar to an ethical LLM, but the question is not in ethics, it’s in having more structure. Sort of granularity. That could allow to scrape knowledge and reproduce it in some way better than just an LLM output. Such a thing could be both a model and an associative dictionary, a bit like automated Wikipedia.
I found it to be just Google made more convenient, which is good, but not there yet.
Why would they? Humans keep producing new data. Old datasets will get less useful. They do all the time. And the old approach to training. But fundamentally they shouldn’t get worse.
daychilde@lemmy.world 2 days ago
I’m on board with wanting this :)
Not from the side of them gaining more knowledge but from the side of companies creating them monetizing and otherwise enshittifying them.
If we had a competitive open-source LLM…
So you’re not wrong, I agree; but I was speaking of a different angle. heh
vacuumflower@lemmy.sdf.org 2 days ago
Ah, in that dimension what I see seems similar to oil processing, again. They are generally all similar. Better datasets - better output. A natural curve of expenses and results.
A competitive open-source LLM makes sense ; but the real asset is data. So said LLM will be hosted (or provided with computing power) commercially to work on said processed data, usually. There are no anarchist free gas stations, and just like that it will be a building block of businesses.
daychilde@lemmy.world 2 days ago
I suppose the real issue is paying for the servers. There’s already pushback against the datacenters needed to power LLMs as it is. I suppose the capital to build would have to come from somewhere.
It’s a pity we don’t have a good government for a project like that. That would truly be a public service.
Did some calculations recently. If we took the cropland on which we grow corn strictly for ethanol production and put solar on it, something like 5% IIRC could power enough EVs to replace ALL vehicles in the US. Which means we could use a little more land for solar to power datacenters designed to be as environmentally friendly as possible. A government-run LLM run for the public.
It’s a pipe dream because in our current reality, it could never happen. But like universal health care and a living minimum wage, it should exist.
I know, I’m straying from the topic again. ADHD gonna ADHD. heh
I suppose as long as we were able to regulate AI companies to make sure they were forced to be upfront, honest, useful… it would be a sufficient compromise. But I’m sure we can’t even have that little.