If the bearing were loose on the shaft, this would be a different conversation entirely.

If adjustment/refinement of the fit in the housing were out of the question, it shouldn’t be made out of plastic, but even in the world of metal-cutting machine tools, adjustment is often neccessary, and if a shim, spacer or set-screw does the job, its what is done.

Meanwhile, my own suggestion was, first, the upgrade kit.