Comment on The first GPT-4-class AI model anyone can download has arrived: Llama 405B

• errer@lemmy.world ⁨1⁩ ⁨month⁩ ago

  Yeah uh let me just put in my 512GB ram stick…

  source

  • Deceptichum@quokk.au ⁨1⁩ ⁨month⁩ ago

    Samsung do make them.

    Goodluck finding 512gb of VRAM.

    source
  • bruhduh@lemmy.world ⁨1⁩ ⁨month⁩ ago

    www.ebay.com/p/116332559 lga2011 motherboards quite cheap, insert 2 xeon 2696v4 44 threads each totalling at 88 threads and 8 ddr4 32gb sticks, it comes quite cheap actually, you can also install Nvidia p40 with 24gb each, you can max out this build for ai for under 2000$

    source
• chiisana@lemmy.chiisana.net ⁨1⁩ ⁨month⁩ ago

  Finally! My dumb dumb 1TB ram server (4x E5-4640 + 32x32GB DDR3 ECC) can shine.

  source