I bought rtx 2060 12 Gigz vram edition for about 150 bucks and it runs pretty well. 4B models run well, I even ran 12B models and while its not the fastest experience, its still decent enough. Sad truth is that nvidia gpus are miles better than any other cards for ai even running linux.