It annoys me that Chat GPT flat out lies to you when it doesn’t know the answer, and doesn’t have any system in place to admit it isn’t sure about something. It just makes it up and tells you like it’s fact.
this post was submitted on 19 Aug 2025
358 points (95.9% liked)
Technology
74247 readers
5984 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
It doesn't admit anything, it's a language machine
It doesn‘t know that it doesn‘t know because it doesn‘t actually know anything. Most models are trained on posts from the internet like this one where people rarely ever just chime in to admit they don‘t have an answer anyway. If you don‘t know something you either silently search the web for an answer or ask.
So since users are the ones asking ChatGPT, the LLM mimics the role of a person that knows the answer. It only makes sense AI is a „confidently wrong“ powerhouse.
Chat GPT makes up everything it says. It’s just good at guessing and bullshitting.
It's literally a guess machine ..
It's a feature. Not a bug of LLMs.
It wouldnt finish a lyric for me yesterday because it was copyrighted. I sid it was public domain and it said "You are absolutely right, given its release date it is under copyright protection"
Wtf
yeah, there are guardrails but for copyright, not for bullshit. ig they think copyrighted content is worse than bullshit.
In the end it's a word generator that has been trained so much it uses facts often enough to be convincing. That's its basic architecture.
You can ask it to give a confidence level to have an indication of how sure it is of the answer.
Someone I know (not close enough to even call an "internet friend") formed a sadistic bond with chatGPT and will force it to apologize and admit being stupid or something like that when he didn't get the answer he's looking for.
I guess that's better than doing it to a person I suppose.
Chat GPT makes up everything it says. It’s just good at guessing and bullshitting.
load more comments
(9 replies)
“I literally lost my only friend overnight with no warning,” one person posted on Reddit
It was meant to be satirical at the time, but maybe Futurama wasn't entirely off the mark. That Redditor isn't quite at that level, but it's still probably not healthy to form an emotional attachment to the Markov chain equivalent of a sycophantic yes-man.
Markov chain equivalent of a sycophantic yes-man.
not only that, but one that is fully owned and operated by a business that could change it any time they want, or even cease to exist completely.
This isn’t like a game where you could run your own server if you’re a big enough fan. if chatgpt stops existing in its current form that’s it.
sure but you can absolutely run c.ai instances locally. 4o and it's cross chat memory was probably more useful to these individuals though.
After reading about the ELIZA effect, I both learned how people are super susceptible to this, and just need to remember the core tenants of it to avoid getting affected:
I’m honestly surprised your’s is not the top comment. Like, whatever, the launch was bad, but there is a serious mental health crisis if people are forming emotional bonds to the software.
Humans emotionally bond pretty easily, no? Like, we have folks attached to roombas, spiders, TV shows, and stuffed animals. Having a hard time thinking of anything X that I don't personally know a person Y with Y emotionally engaged with X. Maybe taxes and concrete?
load more comments
(3 replies)
It's a human trait. Hell, we'll even emotionally bond with a volleyball given circumstances.
load more comments
(1 replies)
There's an entire active subreddit for people who have a "romantic relationship" with AI. It's terrifying.
load more comments
(5 replies)
"we fucked up our massive new generation product launch.. oh well lets invest trillions in new data centers" How do investors keep falling for this shit.
Don’t they have enough?!? How about they fix and optimize their fancy autocompletion software instead?
They took a path they believed would develop into something, and it's a narrow alley they can't turn around in. They have to keep going with more compute and power to continue the chase. Thing is, everyone else seemingly thought they were onto something and followed as well, so they're all in the same predicament where reversing course is suicide. So they hope they can keep selling the dream a bit longer until something happens.
To be fair, it's a lot more than just autocomplete. But it's a lot less than what they wanted by now too.
load more comments
(2 replies)
Don’t they have enough?!?
No no, it's just 1 more data center bro, then we'll fix the hallucinations, promise bro!
load more comments
(1 replies)
He's saying the launch was done badly because some users are in love with GPT-4 and it should not be removed. From a point of view of a investor having people addicted to your product is a good thing.
load more comments
(8 replies)
Eh. Your load of money made a oopsie. Another load of money will surely fix it.
Altman also said that he thinks we’re in an AI “bubble.”
No shit, Sherlock.
He fucking helped create it
Hell, he‘s the single main driver. What stupid times we live in.
How about your responsibility for the damaging and lethal product of yours, OpenAI?
Well one thing's for sure, data centers are going to be insanely cheap in the near future.
And they'll all be optimized for GPU workloads :(
If anyone actually spent money on science anymore, I bet this would be great for, like, protein folding, that sort of thing.
Terrible for running websites though.
load more comments
(1 replies)
load more comments
(6 replies)
That someone is so attached to this stochastic parrot is truly disturbing.
load more comments
(1 replies)
Every picture of this guys face feels like " I don't know how I got here and i'm afraid to touch anything"
Sam Altman admits Rambling meth dealer ‘totally screwed up’ its super meth launch and says the company will spend trillions of dollars on data centers
I love my AI hype word replacement script
Besides helping students cheat. What does AI actually do? It gets answers wrong. It gets facts wrong, foreign countries are actively feeding its training algorithm wrong info [Russia]. It almost like the old birds that were mystified by landing on the moon are still chasing that American success high.
Spend your money if you want. Life in america is not gonna get better with this.
You can be assured that it's not just Russia and China feeding it garbage. There is a vast amount of propaganda in all forms of media that AI is trained on, and a lot likely originates from the west.
load more comments
(2 replies)
load more comments
(10 replies)