Not what OP is using obviously, but AMD X3D CPUs and Mac systems can be quite competitive for AI if you’re lacking VRAM. Not all CPUs struggle with inference, and some GPUs aren’t so hot at it either. GPUs are generally better, especially the really high-end ones, but throwing in low- and mid-range cards and high-end CPUs stuff starts to look somewhat muddier.