Memes

Oh damn. Very good article btw.

According to numbers floating around online, thiat would mean one llama query is around as expensive as 10 google searches. And it's likely that those costs will increase further.

It still seems like the biggest factor here is the scale of adaptation. Unfortunately the total energy costs of AI might even scale exponentially since the more complex the queries get, the better the responses will likely be. And that will further drive adaptation.

This pace is so clearly unsustainable it's horrifying, and while it was obvious to some degree, it seems it's worse than I thought.

This article is dubious. When it comes to training it uses a lot of sensationalist and unsupported estimates. Notice the following quote:

OpenAI and President Donald Trump announced the Stargate initiative, which aims to spend $500 billion—more than the Apollo space program—to build as many as 10 data centers (each of which could require five gigawatts, more than the total power demand from the state of New Hampshire).

I am DEEPLY sceptical of those figures. Like, what data center uses FIVE BLOODY GIGAWATTS. DO YOU KNOW HOW MUCH FIVE GIGAWATTS IS. DO YOU KNOW HOW MUCH THAT'D COST.

The use of metaphor is also concerning, comparing it to San Francisco or New Hampshire or household electricity consumption.

America produced 4,000TWH of electricity a year. This report says "22% of household consumption in 2028", which if I commit the faux pass of mixing data it gets me 7% of US power consumption. A lot, but not apocalyptic and merely a projection for future power consumption. It's also less than the 50GW to 10 data centers alone in the line I quoted above.

It’s right in that the core problem is that we don’t know and so I can’t fault it for assuming the worst, but even then there are limits.

As for the usage, the document you linked puts generating an image using stable diffusion at 400W seconds, or as much as my computer consumes at idle for 8 seconds. I'm gonna stop reading this article because I'm tired and this isn't worth it.

I'm not pro-AI. I don't like how it makes it so easy to fill the internet with slop. I don't like how it discourages the people who use it from any and all critical thought. I've used AI twice, to reword by assignment questions in college because no amount of googling made the phrasing make sense. All I want is for the fearmongering about AI power consumption to stop, not just because it's inaccurate, but also because it encourages investment into gas-fired power generation to "prepare for the AI boom".