This makes it official, I'm skipping DDR5. I have ryzen 5700 and 32 GiB of DDR4, it'll hold me over for a few more years. When I finally upgrade, it's going to be at least 128 GiB.
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
I'm probably skipping DDR5 as well at this rate. My Ryzen 2700 could use an upgrade, but I think I can survive with it until memory prices regain a little sanity. And I expect DDR6 will hit before that happens.
"...and you definitely won't be able to afford it"
One good thing about the AI boom is that it's flooding capital into ram development and ram production. Once the bubble pops all these ram companies will have a glut of cheap high performance memory to sell to anyone who can buy it in cash. The question is if the bubble popping triggers a full blown recession will anyone have any cash to buy.
There is always people with money to buy
Only $1,000,000 per gigabyte, think of the performance!
when will they go back to optimizing software to run in the available ram, rather than continuing to increase ram size?
When the devs run out of available RAM.
Or if you're 100 Rabbits and you live on a boat powered by solar so you're actively limited by available electricity so you write tools based on your home-made tiny VM.
If you're able to optimize AI tools to run larger models in less RAM, you'll have a lucrative future ahead of you.
i would not use ai for anything. too many errors and falsehoods come from them. and theyre now out there hacking other systems because nobody reins them in
It's KINDA being done in the ways we run MoE models. Strata makes more efficient use of limited VRAM if you have a decent amount of RAM, but you don't even need to keep the entire model in RAM with it, it can keep the least frequently used experts on disk instead (said disk being an NVMe SSD hopefully, otherwise if you hit those experts, good luck)
Who are "they"?
who builds software?
Governments, corporations, military, startups, communities, hobbyists...
I hope that one day I can afford a ticket to an exhibition where we all gather around a security-glass display case with a stick of one of those in it and bask in its presence.
Electron apps will still be slow.
I hear superyachts are pretty nice too.
8GB is only 2,762.89 before taxes. Act now, limited quantities.
I'll buy 1TB, then have AI build a house for me to live in. It's fool ...proof.
Since limited waver space (because HBM takes so much of it at the same capacity) is one of the main driving factors for the Ram-apocalyse, this might actually help. And the performance looks actually great (the comparison to the DDR4 i am running shows some parameters being 10x better, this is actually a meaningful upgrade), meaning that some applications that currently use HBM might be able to just use DDR6 instead, causing a greater allocation of wavers towards that.
Generative ML inference isn’t so dramatically bandwidth limited anymore, either, so the “demand” for HBM isn’t as clear.
Eh the really big models want a lot of bandwidth still, otherwise you just don't make use of all the compute power you have.
Wafer
Thanks, will change it in the future! (not gonna ninja edit that lol)
I generally edit my comments like this:
Since limited ~~waver~~ wafer space
So that is fixed for the next reader but the comment chain still makes sense.
DDR6 has no official launch date. Many believe 2029 is a realistic target for commercialization. However, in the current state of things, it would be a miracle if DDR6 had no setbacks.
One can only hope the bubble pops before 2029.