Comment on GPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technica
krooklochurm@lemmy.ca 1 day ago
So… the models are all trained up and now they need to run them is what I’m reading.
You need lots of vram to train a model.
An llm once trained can be run in much less vram and a lot of ram