Comment on [deleted]

<- View Parent
cron@feddit.org ⁨2⁩ ⁨months⁩ ago

I’e seen that some want it to host their own LLM. It’s far cheaper to buy DDR5 memory than somehow getting 100+ GB of VRAM. Whether or not this is a good idea is another question

source
Sort:hotnewtop