Yeah, personally I just looked for second hand high vram gpus and waited. I got 2 titan Xp (12gb vram) for only $180 each.
Comment on The hidden cost of self-hosting
diegantobass@lemmy.world 1 week agoYou’re right, but I’d need a graphic card < money.tar.gzip
MTK@lemmy.world 1 week ago
Jason2357@lemmy.ca 1 week ago
I used phi3:mini-4k for tagging all my bookmarks and don’t think it was any worse than a big model for that kind of job. It will run on a 10 year old cpu and a few gb of ram.