Comment on Chatgpt shared link searchable
tal@lemmy.today 3 weeks agoIt’s also going to cost more, because you almost certainly are only going to be using your hardware a tiny fraction of the time.
Comment on Chatgpt shared link searchable
tal@lemmy.today 3 weeks agoIt’s also going to cost more, because you almost certainly are only going to be using your hardware a tiny fraction of the time.
BreadstickNinja@lemmy.world 3 weeks ago
Possibly, yes. There are models that will run on consumer-grade GPUs that you might already have or might have purchased anyway, where you might say there’s no incremental cost. But the issue is that the performance will be limited. The models are forgetful and prone to getting stuck in loops of repeated phrases.
So if instead you custom-build a workstation with two 5090s or a Pro 6000 or something that pushes you up to the 100 GB VRAM tier, then absolutely, just as you said you’ll be spending thousands of dollars that probably won’t pay back relative to renting cloud GPU time.