[deleted]

Comments

• CameronDev@programming.dev ⁨4⁩ ⁨days⁩ ago

  256gb of ram seems well beyond standard self-hosting, what are you planning on running?!

  source

  • Rogue@feddit.uk ⁨4⁩ ⁨days⁩ ago

    OP wants to store all of their porn collection in RAM

    source
• just_another_person@lemmy.world ⁨4⁩ ⁨days⁩ ago

  The real question is: why do you need this much memory?

  If it’s not actually going to be used, you’re spending more money acquiring it now than you would later.

  source

  • cron@feddit.org ⁨4⁩ ⁨days⁩ ago

    I’e seen that some want it to host their own LLM. It’s far cheaper to buy DDR5 memory than somehow getting 100+ GB of VRAM. Whether or not this is a good idea is another question

    source
  • Valmond@lemmy.world ⁨4⁩ ⁨days⁩ ago

    And 4 sticks ate 4 times more prone to break down.

    source

    • herrvogel@lemmy.world ⁨4⁩ ⁨days⁩ ago

      Twice, because usually it’s two sticks.

      In any case, RAM failure is rare enough that quadrupling its chances is not gonna make any meaningful difference. Even if it does, RAM is the easiest thing to replace in a PC. Don’t even need to go offline while waiting for a new stick. Someone who’s got the cash to build that thing in the first place won’t be too upset by the cost of another 32gb stick either, I don’t think.

      source

      • -> View More Comments
• Xanza@lemm.ee ⁨4⁩ ⁨days⁩ ago

  Because there’s no advantage to having this much RAM in an economy build. If you’re looking to max out your mainboard RAM then you’re looking for a thread ripper anyways, not some economy i9…

  source
• catloaf@lemm.ee ⁨4⁩ ⁨days⁩ ago

  If you’re really going to need that much RAM, start looking at servers with multiple sockets. They support absurd amounts of RAM in a single chassis. I think the biggest regularly-available servers have four sockets, but all but the most basic have two.

  source
• OpticalMoose@discuss.tchncs.de ⁨4⁩ ⁨days⁩ ago

  I agree with CameronDev, not so much on the capacity, but the bandwidth. At 100+ Gb, the Ryzen/Core platforms are really holding you back with their weak I/O.

  If you need that much memory, you might be better off picking up a used Xeon/Epyc from Ebay. Their CPU speeds are lower, but the quad channel RAM could make up for it, depending on what you’re trying to do.

  source

  • hendrik@palaver.p3x.de ⁨4⁩ ⁨days⁩ ago

    I'd say this is the correct answer. If you're actually using that much RAM, you probably want it connected to the processor with a wide (fast) bus. I rarely see people do it with desktop or gaming processors. It might be useful for some edge-cases, but usually you want an Epyc processor or something like that, or it's way too much RAM.

    source

    • Solaer@lemmy.world ⁨4⁩ ⁨days⁩ ago

      My edge case is: I wanna spin up an ai-lxc in proxmox. ollama and open webui. using RAM instead of vram. but it should low on power consumption on idle. thats why I want an intel i-9 oder core ultra 9 with maxed out RAM. it idles on low power, but can run bigger ai-models using RAM instead of VRAM. it would be not so fast like with GPUs, but thats OK.

      source

      • -> View More Comments
• Oisteink@feddit.nl ⁨4⁩ ⁨days⁩ ago

  If i was considering one server with 256gb ram i would go for server hardware and not try to use consumer stuff.

  source
• Solaer@lemmy.world ⁨4⁩ ⁨days⁩ ago

  For clarification: it’s for a proxmox instance. I wanna use the ram for open webzine/ollama.

  source

  • CameronDev@programming.dev ⁨4⁩ ⁨days⁩ ago

    What is openwebzine? Can’t find any info on it.

    source

    • Solaer@lemmy.world ⁨4⁩ ⁨days⁩ ago

      sorry, fat fingers on tablet: I mean “open webui”.

      source
• tofuwabohu@slrpnk.net ⁨4⁩ ⁨days⁩ ago

  Intel CPU RAM limits often are wrong for some reason. If a Mainboard coming with that CPU supports more, it’ll probably work. I usually try to search forums to see if someone uses the same configuration and how much RAM they got to work.

  source
• BCsven@lemmy.ca ⁨4⁩ ⁨days⁩ ago

  I personally believe you are overbuilding. For example my OpenMediaVault Samba Server and DLNA server runs on a SingleBoard that has 256 megabytes of RAM. Yes MB. And it still has RAM free without swap.

  Image

  source

  • Solaer@lemmy.world ⁨4⁩ ⁨days⁩ ago

    Oh, I’m not using it for OMV and Samba. I’m using it for ollama/open webui with RAM instead of VRAM.

    source
• Oisteink@feddit.nl ⁨4⁩ ⁨days⁩ ago

  But aside from buying a real truck instead of a typhoon, intels memory support might not be hard limit. It probaly is but it might not be.

  More likely the mb’s memory controller can handle 256gb so if a new processor comes along with support for 256gb it will work.

  source
• Treczoks@lemmy.world ⁨4⁩ ⁨days⁩ ago

  What the heck are you self-hosting that anything beyond 64G is even taken into account?

  source
• MNByChoice@midwest.social ⁨4⁩ ⁨days⁩ ago

  Look up what system vendors will sell for that CPU. If they sell 256 GiB, then you are likely good.

  I don’t find I ever upgrade after the first couple months. I would max it out or get multi CPU boards wherI cannot afford to max it out.

  source