Technology
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
Every large AI startup is racing to be the last one standing. They are all gobbling up compute resources to ensure that they have the best competitive advantage when others go broke. That includes soaking up all the future supply they can to restrict their competitors ability to do the same. In < 5 years time there is only going to be one commercial AI company left, and all the rest will just be skeletons picked clean of all their resources.
Be prepared to live with whatever hardware you have now for about 10 years. If you're lucky things will be back on an even keel by then.
I do think the consumer market might still look depressing in upcoming years, but I don't think there will be one AI company left. I mean, even if we don't take it literally, like I also wanted to mention how OpenAI gets to build its fabulous data centers while Anthropic just signs partnerships, and both LLMs (ChatGPT and Claude) are good and competitive. And don't forget about FOSS models like DeepSeek.
There is something those companies aren't loud and clear about, like they don't talk about architectural bottlenecks, that what they need is not scaling but an architectural shift. And once photonics enters the game, should we expect the prices[*] to drop or will they justify it by even more compute power.
[*] edit: I mean LLM pricing (tokens), not chips
Because of Stargate.
AI was definately hurting supply before that, but it wasn't 'unlimited money' hurting supply, they could only buy up at a reasonable rate.
Trump's Stargate project and China's instant response has eaten all the ram.
AFAIK, before AI it was COVID coupled with cryptomining, yet the only thing it hurt was GPU prices going up, not DRAM. Now, we have both GPUs and RAM sticks costing as much as a decent PC that you could build at least two years ago... yeah, I am somewhat hurt over my dream of building a high-end battlestation, which might not come to reality anytime soon.