Comment on Consumer GPUs to run LLMs

InvertedParallax@lemm.ee ⁨5⁩ ⁨days⁩ ago

3090 has 24gb and rolls the 38b models beautifully.

source
Sort:hotnewtop