I interviewed a candidate for a senior role, and they asked if they could use AI tools. I told them to use whatever they normally would, I only care that they get a working answer and that they can explain the code to me.
The problem was fairly basic, something like randomly generate two points and find the distance between them, and we had given them the details (e.g. distance is a straight line). They used AI, which went well until it generated the Manhattan distance instead of the Pythagorean theorem. They didn’t correct it, so we pointed it out and gave them the equation (totally fine, most people forget it under pressure). Anyway, they refactored the code and used AI again to make the same mistake, didn’t catch it, and we ended up pointing it out again.
Anyway, at the end of the challenge, we asked them how confident they felt about the code and what they’d need to do to feel more confident (nudge toward unit testing). They said their code was 100% correct and they’d be ready to ship it.
They didn’t pass the interview.
And that’s generally my opinion about AI in general, it’s probably making you stupider.
0x0@programming.dev 5 months ago
I use them like wikipedia: it’s a good starting point and that’s it (and this comparison is a disservice to wikipedia).
SandbagTiara2816@lemmy.dbzer0.com 5 months ago
Yep! It’s a good way to get over the fear of a blank page, but I don’t trust it for more than outlines or summaries
deweydecibel@lemmy.world 5 months ago
I wouldn’t even trust it for summaries beyond extremely basic stuff.
ripcord@lemmy.world 5 months ago
Man, I need to build some new shit.
I can’t remember the last time I looked at a blank page.
mPony@lemmy.world 4 months ago
Blank pages are for the young
grrgyle@slrpnk.net 5 months ago
I agree with your parenthetical, but Wikipedia actually agrees on your main point: Wikipedia itself is not a source of truth.