Except we already have fields (like pharma manufacturing) that have to deal with hundreds or thousands of inputs and variables, are automated, and we still manage to fully understand the stack as well as fully check everything.
Hint: when someone tells you they “can’t” check out understand what their software is doing, it’s a scam.
Normally they should be told to go back and figure it out before being allowed to ship any product. If you tried this in any other industry it would be laughable. Even in software it’s outrageous, imagine getting accounting software or even a simple file backup tool that doesn’t work some of the time and nobody can tell you how it works. Yet these companies get a pass putting cars like this on the road.
FlyingSquid@lemmy.world 10 months ago
And that means AI code shouldn’t be error-checked?
jeena@jemmy.jeena.net 10 months ago
That means that it right now can not be error checked and it will be even more difficult in the future.
jeena@jemmy.jeena.net 10 months ago
Or let me rephrase it with the context of the original assumption that if people don’t check the code which AI wrote the company will lose customers because the quality is bad.
Right now there are tons of models out there which no human can understand why they decide this or that, still they bring so much more value that they get shipped even though they make some mistakes. If a company would try to only ship code checked by humans they would not be able to ship the products and would lose their customers to a company which does not check it but does ship.
FlyingSquid@lemmy.world 10 months ago
So you’re saying no code would be worth error checking by a human at all? There is no level of simpler code that an AI could get wrong and would need someone to fix it?
jeena@jemmy.jeena.net 10 months ago
My assumption is that it would even be the other way around, AI checking all human code, especially writing all the tests. So I guess AI would also write tests for it’s own code too.
When it comes to humans, I think they would probably be changing the prompt they give to AI instead of changing the code at the end. You can already see how it’s done with generation of pictures, while theoretically you could take a not so perfect AI picture and use Photoshop to fix it, but most of the time people change the prompt instead and regenerate the picture.