this post was submitted on 30 Oct 2026
129 points (99.2% liked)

technology

24516 readers
321 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 6 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] AntifaSuperWombat@hexbear.net 52 points 4 days ago (2 children)

He seems pretty scared of locally run AI. I always had a hunch that this will break the necks of all those AI corporations. If you can just have your own AI agent instead of being under the control of those tech bro freaks, then it's only businesses and government institutions that are left as clients. Of course you need good enough hardware for that, but it's just a matter of time until such hardware becomes affordable to the masses.

[–] Aradino@hexbear.net 29 points 4 days ago (1 children)

You can run it on a mid range gaming PC just fine these days. Which is why he's terrified

[–] somename@hexbear.net 15 points 4 days ago (1 children)

Yeah, people don’t really get the point of the massive data centers. While they do need a decent chunk of infrastructure to run their models for customers, a large amount of it is just for training, data processing and collection, and other R&D tasks.

The models themselves, once trained, are much more reasonable in terms of computation.

[–] ElChapoDeChapo@hexbear.net 15 points 4 days ago* (last edited 4 days ago) (1 children)

it also means that once the model has been trained to the point of diminishing return the data center just becomes a pollution factory that does nothing

which to be fair is what they already were but this also may be where we are

[–] somename@hexbear.net 2 points 3 days ago

More models! More training! Infinite growth!

[–] SootySootySoot@hexbear.net 27 points 4 days ago* (last edited 4 days ago) (2 children)

When the bubble pops (or at the very least when all that data center hardware gets obsolete) GPU and RAM prices gonna TANK. I'm not a fan of AI, but by that point, local-run models will be extremely cost-effective.

Only reason AI companies are even slightly competitive on price currently is because supply hasn't yet caught up to their mass cut-price purchases, plus the fact they're subsidising price still on huge losses.

[–] Collatz_problem@hexbear.net 10 points 3 days ago (1 children)

When the bubble pops (or at the very least when all that data center hardware gets obsolete) GPU and RAM prices gonna TANK.

There is a very high probability that the hardware companies will significantly reduce their production to keep the prices from falling.

[–] SootySootySoot@hexbear.net 3 points 3 days ago* (last edited 3 days ago) (1 children)

I'm sure they will reduce their production, but unless they convince most datacentres to chuck their old hardware, I don't think it'll be close to enough to accommodate the flood of hardware to come.

We've already had a year of massive over-production, and rising still. Even better, Chinese companies have been increasingly entering the market and they don't tend to stop for sheet.

Unless the bubble pops very soon, no amount of reducing production will stop an oversupply.

[–] Collatz_problem@hexbear.net 6 points 3 days ago (1 children)

I don't think that the datacenter hardware is going to the retail market instead of getting bought by the surveillance state as a form of bailout.

[–] SootySootySoot@hexbear.net 1 points 2 days ago* (last edited 2 days ago) (1 children)

The surveillance state does not have need (nor dare I say, even want) of a trillion dollars worth of RAM.

[–] Collatz_problem@hexbear.net 1 points 2 days ago

They are going to use those datacenters to radically expand and automate surveillance.