Have you looked into specialized AI chips/accelerators at all if you really want to mess with it?

Way lower end than what you’re working with, but they have AI accelerator kits for something as small as a Raspberry Pi.