Guess what, GPU prices are about to go back up because they rely on RAM.
GPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technica
Submitted 2 months ago by otters_raft@lemmy.ca [bot] to selfhosted@lemmy.world
Comments
roofuskit@lemmy.world 2 months ago
sem@piefed.blahaj.zone 2 months ago
GPU is a processor, right? It is the gfx card that will increase in price
tal@lemmy.today 2 months ago
GPU prices are coming to earth
Nvidia reportedly no longer supplying VRAM to its GPU board partners in response to memory crunch — rumor claims vendors will only get the die, forced to source memory on their own
If that’s true, I doubt that they’re going to be coming to earth for long.
fleton@lemmy.world 2 months ago
Have to refill before being sent to titan.
jeena@piefed.jeena.net 2 months ago
This is very unfortunate, about a year ago I built my PC and only put in 32 GB of Ram, It was double I had on my laptop so I thought it should be enough for the beginning and I could buy more later.
Already after 2 months I realizes I can do so much more because of the fast CPU in parallel but suddenly the amount of RAM became the bottleneck. When I looked at the RAM prices it didn’t seem quite worth it and I waited. But that backfired because since then the prices never went down, only up.
NotSteve_@piefed.ca 2 months ago
What are you running that needs more than 32Gb? I’m only just barely being bottlenecked by my 24Gb when running games at 4k
comrade_twisty@feddit.org 2 months ago
Chrome probably
hoshikarakitaridia@lemmy.world 2 months ago
AI or servers probably. I have 40gb and that’s what I would need more ram for.
I’m still salty because I had the idea of going cpu & ram sticks for AI inference literally days before the big AI companies. And my stupid ass didn’t buy them in time before the prices skyrocketed. Fuck me I guess.
jeena@piefed.jeena.net 2 months ago
Two browsers full of tabs but that is not a problem, but once I start compiling AOSP (which I sometimes want to do for work at home instead in the cloud because it’s easier and faster to debugg) then it eats up all the RAM imediatelly and I have to give it 40 more GB or swap and then this swapping is the bottleneck. Once that is running the computer can’t really do anything else, even the browser struggles.
jeena@piefed.jeena.net 2 months ago
I just had a look, 2nd of April I payed 67,000 KRW for one 16 GB stick, now the same one (XPG DDR5 PC5-48000 CL30 LANCER BLADE White), they only sell them in pairs, a pair costs 470,000 KRW in the same shop, so 235,000 KRW per 16 GB stick. That is a price increase of 250%, god damn.
tal@lemmy.today 2 months ago
Last I looked, a few days ago on Google Shopping, you could still find some retailers that had stock of DDR5 (I was looking at 2x16GB, and you may want more than that)and hadn’t jacked their prices up, but if you’re going to buy, I would not wait longer, because if they haven’t been cleaned out by now, I expect that they will be soon.
Burghler@sh.itjust.works 2 months ago
Not for long, GPU partners will have to source their own VRAM for manufacturing Nvidia now.
panda_abyss@lemmy.ca 2 months ago
I hope this is the beginning of the end for the cuda monopoly. I just want good gpgpu support for numerical code.
myfunnyaccountname@lemmy.zip 2 months ago
Where are gpu prices coming down? 5070ti is what 800? 3090 24gb is 800-900 still. They not coming down anytime soon.
cyberpunk007@lemmy.ca 2 months ago
Yup. Bs headline.
fhein@lemmy.world 2 months ago
… I was thinking about buying a 96GB DDR5 kit from the local computer store a few weeks ago, but wasn’t sure it was actually worth €700. Checked again now and the exact same product costs €1500. I guess that settles it, 32GB will have to be enough for the next couple of years then.
Holytimes@sh.itjust.works 2 months ago
Iv come to learn over the years. If you want to buy computer parts just do it.
Your actively stupid if you don’t cause some bigger idiot with more money then brains will make a new grift that causes everything to be unaffordable.
Fuck waiting for deals, fuck thinking twice. Just fucking buy it and ignore reality around you cause you will be pissed either way.
Either a deal comes and you fucked yourself, or everything goes to the moon and now you have nothing AND your fucked.
lemming741@lemmy.world 2 months ago
Part of it the thrill of the hunt. I’ve caught some great deals over the years stalking marketplace.
Got .iso storage after chia crashed
Got a 3090 after Bitcoin asics took over
Got a 5900x when the X3D parts came outBut I’ve never seen decent RAM for sale, only single sticks or slow kits.
fhein@lemmy.world 2 months ago
I just wanted to test if it was viable to run larger MoE LLMs on CPU, e.g. Qwen3-next-80B-A3B… Even if I got acceptable generation speeds I’d probably get bored with it after a few hours, as with other local models. Had I got it for €700 it was pretty low value for money anyway, since my current RAM is enough for everything else I use the computer for. On the positive side, I can put that money towards a Steam Frame instead.
krooklochurm@lemmy.ca 2 months ago
So… the models are all trained up and now they need to run them is what I’m reading.
You need lots of vram to train a model.
An llm once trained can be run in much less vram and a lot of ram
orochi02@feddit.org 2 months ago
Serious question: when will ram prices go down?
01189998819991197253@infosec.pub 2 months ago
When AI dies.
AliasVortex@lemmy.world 2 months ago
Gamers Nexus did a piece on this, but short of a crash or bubble pop, it’s not expected to recover any time soon.
COASTER1921@lemmy.ml 2 months ago
I think a bubble pop may be closer than people think. Several F500 company CEOs are at least calling it a bubble now, but admittedly still 100% on board the AI hype train.
lightnsfw@reddthat.com 2 months ago
prices go down?
That’s not very capitalism.
cyberpunk007@lemmy.ca 2 months ago
Never. Same with GPUs. AI destroyed jobs, the gaming market, and customer service
Allero@lemmy.today 2 months ago
We’re unlikely to see the grand price fall in the coming year. Can get a bit cheaper, though.
Naz@sh.itjust.works 2 months ago
2027
zebidiah@lemmy.ca 2 months ago
2027
W3dd1e@lemmy.zip 2 months ago
Buying used RAM on marketplace and hoping it isn’t broken. Hoping it was just stolen from a Best Buy. Fingers crossed y’all!
cooligula@sh.itjust.works 2 months ago
I just recently bought a Samsung 16GB 5600MT/s stick for 45€ and received a 32GB stick instead! Sorry, but I wanted to brag x)
W3dd1e@lemmy.zip 2 months ago
You made out like a bandit!
MantisToboggon@lemmy.world 2 months ago
Jam it right in my ass!
justdaveisfine@piefed.social 2 months ago
You mean ‘ram’ it?
MantisToboggon@lemmy.world 2 months ago
Oh I like you you can come over and fuck my wife.
givesomefucks@lemmy.world 2 months ago
Prebuilts have become about the only way to get a deal for a while now.
possiblylinux127@lemmy.zip 2 months ago
For now…
utjebe@reddthat.com 2 months ago
Well that settles my idea of entertaining AM5.
Two2Tango@lemmy.ca 2 months ago
I just bought an Arc A310 for >$200. I couldn’t find a set of 16x2 DDR4 in stock for less than that on Black Friday… Wild times for the RAM market.
Kolanaki@pawb.social 2 months ago
Just buy an extra GPU and figure out how to turn it’s VRAM into regular RAM. 😌
colourlesspony@pawb.social 2 months ago
I know you can create a gpu ram disk so you could use it as swap lol.
litchralee@sh.itjust.works 2 months ago
Ok, I have to know: how is this done, and what do people use it for?
afk_strats@lemmy.world 2 months ago
wiki.archlinux.org/title/Swap_on_video_RAM
klangcola@reddthat.com 2 months ago
The article introduction is gold: