At one point I tried to use a local model to generate something for me. It was full of errors, but after some searching online to look for a library or existing examples I found a github repo that was almost an exact copy of what it generated. The comments were the same, and the code was mostly the same, except this version wasn’t fucked up.

It turns out text prediction isn’t that great at understanding the logic of code. It’s only good at copying existing code, but it doesn’t understand why it works, so the predictive model fucks things up when it takes the less likely result. Maybe if you turn the temperature to only give the highest prediction it wouldn’t be horrible, but you might as well just search online and copy the code that it’s going to generate anyway.