Comment on GPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technica

krooklochurm@lemmy.ca ⁨1⁩ ⁨day⁩ ago

So… the models are all trained up and now they need to run them is what I’m reading.

You need lots of vram to train a model.

An llm once trained can be run in much less vram and a lot of ram

source
Sort:hotnewtop