Comment on Linus Torvalds to critics of AI coding in Linux: "Fork it. Or just walk away."
AwesomeLowlander@sh.itjust.works 4 days agoTraining a neural network algorithm is not equivalent to human learning
That’s a stretch, since we don’t know exactly how human learning works. Yes we have more than just that one mechanism at work obviously, but that’s not to say we’re not using the same or similar method as part of our learning process.
original training data can be reproduced completely from models
So can a few savants, more if you take into account those with special training, etc. The ability to do so is obviously latent to our brain.
When they reproduce code which they have previously stored, even only in part, that is a derivative work.
I don’t know about you, but I for one have not produced anything ‘original’ my entire coding career by that metric. I feel confident in saying the vast majority of programmers have not either.
Don’t mistake me, I’m well aware LLMs are not intelligent. But I disagree with the idea that their method of learning and their actions is inherently different from what the average person does.
NaibofTabr@infosec.pub 3 days ago
It is not a stretch. We may not know exactly how human learning works, but we do know exactly how machine learning works, and we know that it is not like how human learning works. It is absolutely possible to differentiate things even without complete knowledge.
This is a bad argument. The output of a generative model is a copy-and-paste function from a library of ingested code samples with a fairly competent keyword search attached to it. Code writing bots are just script kiddie crutches.
If all you did was copy and paste from GNU GPL code, then your output would also be bound by the same license.
Then you don’t understand even the basics of the mathematics that makes them actually work. It’s a purely algorithmic process. It’s an outgrowth of multidimensional analysis and optimization, that’s all.
AwesomeLowlander@sh.itjust.works 3 days ago
You seem to have entirely ignored the gist of my first point. We may be using a more well rounded method which utilises the same technique LLMs use as a part of our overall learning ability.
We’re back to the same argument that’s been around since the start of the current AI boom, about whether or not people produce art and everything else the same way. At this point it’s very obviously a philosophical argument in general, and from your other comments in this post you’ve offered nothing but semantics as to how they’re different. We’re going to have to agree to disagree there.
I understand how LLMs work. We DON’T understand how humans work, and unless you’ve got a human theory of mind in your back pocket, insisting that they’re inherently different instead of possibly being part of our mental toolkit is premature.