Comment on GPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technica
tal@lemmy.today 3 hours agoYou can have applications where wall clock tine time is not all that critical but large model size is valuable, or where a model is very sparse, so does little computation relative to the size of the model, but for the major applications, I think that that’s correct.
NotMyOldRedditName@lemmy.world 3 hours ago
Ya, that’s fair. If I was doing something I didn’t care about time on, it did work.