this post was submitted on 10 Aug 2025
823 points (99.6% liked)
Technology
73967 readers
3597 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You're right about the general idea, but I think you're even underestimating the scale here.
I don't think these servers will be doing much on CPU, they'll be on GPUs. HPE will sell you a 48 rack unit behemoth with 36 Blackwell GB200s for a total of 72 GPUs and 36 CPUs. The CPUs are actually negligible here, but each of the 36 units use a total of 2700 watts (single GPU itself is supposedly 1200 watts so that would make the CPU 300 watts?)
36 * 2.7 = 97.2 kilowatts. You put just a hundred of these in a data center and you're talking over 10 megawatts once cooling and everything is factored in. So this is what, 100k m^2 of solar panels for 100 racks?
You'd want them to be running most of the time too, idle hardware is just a depreciating asset. Say they run 75% of the time. 0.75 * 10 * 24 * 365 = 65700 MWh which I will not even convert to gigawatt hours to simplify this: The average American household uses about ~11 MWh of electrical energy per year. A single AI-focused data center without even all that many racks uses as much power as ~6000 households. They're building them all over the country, and in reality I think they're actually way bigger than what I mentioned. It's putting a significant dent in the power grid, to the point AI companies should be required to commission nuclear power plants before being allowed to build their data centers.