this post was submitted on 27 Feb 2026
71 points (94.9% liked)

Technology

81933 readers
2931 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
71
submitted 2 hours ago* (last edited 2 hours ago) by Beep@lemmus.org to c/technology@lemmy.world
 

The narrative in AI infrastructure over the last two years has been dominated by the enormous and growing demand for compute capacity and its economic consequences, such as the buildout of data centers and the consequent shortages of key resources such as land, water, power, and copper.

But of all these bottlenecks, memory is by far the most significant. The demand for memory is now outpacing the demand for other drivers of compute capacity. The implications of this will ripple through not just the economics of data centers, but the cost of every single consumer and enterprise hardware device.

In this piece, we unpack the market action around memory prices, its ripple effects across the consumer and industrial electronics market, and the supply and demand curve that is emerging around AI. Critically, we explain why the amount of memory being purchased by AI companies like OpenAI seems to be more than what they need, and how the threat of on-device inference might actually be incentivizing an engineered memory shortage.

all 13 comments
sorted by: hot top controversial new old
[–] paultimate14@lemmy.world 25 points 1 hour ago (2 children)

For those who don't want to read several pages of unnecessary text telling you what you probably already know:

The math, while pretty involved, may tell a straightforward story (if you’re interested in the details of our analysis, see the Appendix). OpenAI has contracted 900K memory wafers per month from Samsung and SK Hynix. Partner commentary seems to indicate that’s a monthly number, so that represents 10.8 million wafers over 12 months. In terms of demand, a fully built-out 10GW Stargate cluster would require ~3 million GB200 Bianca Boards. Each board requires ~50% of a memory wafer in total; split between the HBM3e stacks embedded into its two B200 GPU (~30%) and its 480 GB of LPDDR5X system memory (~20%). That puts total wafer demand for the entire cluster at ~3 million wafers.

Therefore, according to our best estimates, OpenAI likely needs less than 30% of the 10.8 million wafers it's planning to buy

So this is just putting some numbers to what a lot of people already guessed. The AI companies are not just buying a ton of RAM to build out their data centers. They aren't buying enough other components to even use that RAM. They're buying it so that no one else can.

[–] ryper@lemmy.ca 3 points 14 minutes ago (1 children)

It's OpenAI in particular trying to screw everyone else. The wafers they contracted from Samsung and SK Hynix are something like 40% of those companies' production. There isn't enough production volume for the other AI companies to over order like that.

[–] jqubed@lemmy.world 1 points 12 minutes ago

So this is the strategy of putting 4 houses on your properties in Monopoly and never upgrading them to hotels because that way there are no houses for your opponents to buy

[–] Domino@quokk.au 5 points 48 minutes ago (1 children)

Hopefully this accelerates their crash.

[–] corsicanguppy@lemmy.ca 2 points 7 minutes ago

Not if they sell it on the surge.

They may have millions extra, and that just means they've now become a shitty version of best buy as they schlepp it at surge pricing to make back the bank.

[–] RaoulDook@lemmy.world 4 points 51 minutes ago (1 children)

Oligarchs trying to buy up all the digital real estate so they can be the digital landlords of computerland

[–] IratePirate@feddit.org 1 points 32 minutes ago* (last edited 32 minutes ago)

I guess that's the point when I'll just go offline for good and learn a solid, old-fashioned trade.

[–] nukeforyou@lemmy.zip 13 points 1 hour ago

Why sell you a computer, when they can rent you one for $$ per query you do

[–] umbrella@lemmy.ml 27 points 2 hours ago (1 children)

haven't read the article just yet, but these companies are known for price fixing and colluding for decades now