Comment on Selfhost an LLM
ProperlyProperTea@lemmy.ml 1 week agoIndeed, other than being able to get the model running, having decent hardware is the next most important part.
3060 12gb is probably cheapest card to get, 3090 or other 24gb card if you can get it