Comment on AI's Future Hangs in the Balance With California Law
5C5C5C@programming.dev 4 months agoLiterally nothing you’ve said gives any indication that you actually know the current state of foundation model research. I won’t claim it’s my research specialty, but I work directly with people whose full time job is research and tuning on foundation models, and everything I’m saying is being relayed from conversations that I have with them.
“Cannot ever possibly be used like that”… Like what specifically? To drive a car? That’s being done. To give financial advice? That’s being done. To console people who are suicidal or at risk of harming themselves? That’s being done. To make kill / no kill decisions in an active warzone? It’s being considered (if not already being done in secret).
This technology is being used in extremely consequential positions despite having very weak guarantees around safety. This should give any reasonable person pause. I’m not taking any firm stance on whether this specific regulation is the right approach, but if you think there should be no accountability for the outcomes of how this technology gets used then I guess you’re someone who thinks seatbelts should be optional in cars and it’s okay for airplanes to fall out of the sky due to neglect.
Sgagvefey@lemmynsfw.com 4 months ago
For anything where you would ever expect a predictable, useful outcome to an arbitrary input. There is no possible path to LLMs ever doing anything close to that.
LLMs aren’t driving cars. LLMs aren’t doing financial modeling. Those are entirely different tools with heavily hand crafted models to specific applications.
Anyone using an LLM to provide therapy should get multiple life sentences in prison regardless of outcomes. There is no possible way to LLMs ever being actually useful for therapy. It’s just a random text generator that’s tuned well enough to sound good. It has no substance and the underlying tech cannot possibly develop substance.
5C5C5C@programming.dev 4 months ago
I can’t tell if you’re suggesting that foundation models (which is the underpinning technology of LLMs) aren’t being used for the things that I said they’re being used for, but I can assure you they are, either in commercial R&D or in live commercial pictures l products.
The fact that they shouldn’t be used for these things is something we can certainly agree on, but the fact remains that they are.
Sources:
Wayve is using foundation models for driving, and I am under the impression that their neutral net extends all the way from sensor input to motor control: wayve.ai/thinking/introducing-gaia1/
Research recommending the use of LLMs for giving financial advice: papers.ssrn.com/sol3/papers.cfm?abstract_id=48500…
LLMs for therapy: blog.langchain.dev/mental-health-therapy-as-an-ll…
So this all kinds of goes back to my point that some form of accountability is needed for how these tools get used. I haven’t examined the specific legislation proposal to give any firm opinion on it, but I think it’s a good thing that the conversation is happening in a serious way.