DEFINITELY NOT A BUBBLE EVERYBODY NOTHING TO SEE HERE
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
assuming API pricing
API pricing is not what it costs openai to offer the inference.
API pricing is what they're currently selling their inference, with profit included in price.
"But if the user didn't get a subscription, he would have spent $14k in token" is a wrong assumption.
The user is wasting the tokens on useless tasks because they're free to him, but once he has to pay them, he wouldn't ask to generate 100 images of a toilet eating carrots anymore
Headline is innacuralte. Customers who purchase a $200/month subscription, can save up to $13800 on token costs compared to "a la carte" token pricing. Open AI does lose over $1 per $ in revenue, but this is more a function of them having too much compute, and very high training costs, rather than a loss per gpu hour on tokens served, it should stilll be a loss for OpenAI:
Open source model pricing per gpu hour, ranges from 80% margins at high batch saturation per user (low tps per user) to 50% at concurency of 8, to loss at fewer user requests per gpu. https://inferencex.semianalysis.com/compare/deepseek-r1-b300-vs-h200
OpenAI has very high prices, and too much compute. They would likely lose $6000 per user who maxes out their $200 plan, and certainly over $1000 per user.
Is this a reverse psychology trick to convince people to pay for ChatGPT subscriptions?
If you have it through work you know what to do
Welp, just got fired for sending 18000 prompts to ChatGPT today.
Rookie mistake. Send 18000 Codex prompts next time and they'll hail you as a god amongst men
I salute your sacrifice.
Totally not a bubble, honest guv!
How much of our water, electricity, tax breaks, and public land does it use?
Yes!
Nice try, OpenAI sales reps.