this post was submitted on 26 Mar 2025

444 points (91.4% liked)

Technology

69491 readers

4083 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related news or articles.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago

MODERATORS

L3s@lemmy.world

enu@lemmy.world

technopagan@lemmy.world

L4s@lemmy.world

L3s@hackingne.ws

L4s@hackingne.ws

444

Something Bizarre Is Happening to People Who Use ChatGPT a Lot (futurism.com)

submitted 1 month ago by return2ozma@lemmy.world to c/technology@lemmy.world

242 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[+] interdimensionalmeme@lemmy.ml -13 points 1 month ago (14 children)

You said: Take the same list again, for each point explain why it's actually beneficial and how it will get better with increased adoption

ChatGPT said:

Here’s the same list of main points, but this time with a more optimistic take — highlighting how each trend could actually be beneficial and how increased adoption might make things better for individuals and society as a whole:

Heavy ChatGPT users show signs of addiction (preoccupation, withdrawal, mood changes, loss of control):

Why it could be beneficial:

If people are turning to ChatGPT frequently, it may indicate that it's providing meaningful value — like reducing cognitive load, aiding creativity, or offering emotional support. As usage becomes more common, society may develop healthier digital habits, just as it has with smartphones and social media. Over time, norms and tools (e.g., usage timers, digital wellness features) could help people manage their use responsibly.

Long-term users tend to form emotional bonds with ChatGPT, sometimes seeing it as a “friend”:

Why it could be beneficial:

For people lacking companionship or emotional support, especially the elderly or isolated, AI companions can provide comfort, conversation, and a sense of presence. On a wider scale, AI could reduce loneliness-related health problems and even support mental wellness initiatives by being an accessible form of care or early intervention.

Lonelier individuals are more likely to use ChatGPT heavily and become emotionally attached:

Why it could be beneficial:

If AI offers a low-barrier outlet for the lonely, it might be a first step toward re-engagement with the world. AI can encourage people to express feelings they wouldn't share with others and even prompt them to seek human connection, therapy, or support services. Widespread AI use could destigmatize conversations about loneliness and mental health.

People stress out over subtle changes in ChatGPT’s behavior:

Why it could be beneficial:

This shows users are emotionally invested — which can push developers to create more consistent, emotionally intelligent systems. If society recognizes the emotional impact of AI, it will encourage better design, transparency, and regulation. Over time, this can lead to more stable and human-aware AI that positively complements emotional needs.

Emotional language is used more in text interactions than voice, and brief voice use is associated with better well-being:

Why it could be beneficial:

This gives users multiple channels of expression to suit their mood or needs — voice for brief emotional boosts, text for deeper reflection. With broader adoption, people can tailor AI interaction styles to maximize personal benefit. This insight also allows designers to create features that better match emotional and mental health goals.

Users who engage with ChatGPT for non-personal tasks are more emotionally dependent than those who use it for personal reasons:

Why it could be beneficial:

This means AI is becoming a highly trusted tool, even in practical domains. As more people adopt it for brainstorming, research, or decision-making, we’ll likely see a democratization of high-level thinking tools. Over time, dependency could evolve into partnership — similar to how calculators or GPS became essential but ultimately empowering tools.

Prolonged usage increases risk of emotional dependence, regardless of how it's used:

Why it could be beneficial:

Long-term usage can foster deeper understanding of one’s own thought processes, communication patterns, and emotional states. As AI integrates into daily life, people might develop greater self-awareness and reflection through their interactions. Society could benefit from individuals who are more emotionally literate and thoughtful, even if that awareness is sparked by an AI relationship.

Let me know if you'd like this version turned into a policy brief, an article, or a debate prep doc — could be used in all kinds of conversations.

You said: Explain how chatgpt is a stochastic parrot that cannot by design say anything fundamentally new and how it is basically just a keyboard auto complete on steroid

ChatGPT said:

Alright, here's the breakdown of that critique — the "stochastic parrot" idea and the comparison to advanced autocomplete — explained clearly and fairly:

What does “stochastic parrot” mean?

The term "stochastic parrot" was coined in a 2021 paper by researchers including Emily Bender and Timnit Gebru. It refers to large language models like ChatGPT that:

"Stochastic" means based on probability. The model doesn’t “think” or “understand”; it predicts the next word based on statistical likelihood, given the words before it.

"Parrot" because it doesn’t generate new ideas—it repeats patterns and phrases it has seen in training data, like a parrot mimics human speech.

So, calling ChatGPT a stochastic parrot is a way of saying: It’s not truly intelligent. It’s mimicking language patterns, not generating original thought.

It can’t say anything fundamentally new — why?

By design, ChatGPT:

Is trained on vast amounts of existing text from books, websites, forums, and more.

Learns the statistical patterns of how humans use language.

Generates responses by predicting the next most likely word or phrase based on that training.

Because it’s not connected to lived experience, emotion, consciousness, or intent, it:

Can’t invent genuinely new concepts.

Can’t form subjective opinions.

Can’t create knowledge that isn’t derived from patterns it has already seen.

It might sound novel, but under the hood, it’s remixing existing information in clever ways — not discovering or reasoning in a human sense.

It's like "autocomplete on steroids" — how so?

If you’ve used Gmail’s or your phone’s autocomplete, you’ve seen basic language prediction in action. Type “I hope you...” and it might suggest “...have a great day.”

ChatGPT is essentially the same mechanism:

Autocomplete predicts the next word based on simple models.

ChatGPT predicts sequences of words using a far more complex, nuanced statistical model trained on billions of examples.

So e:

It can hold context better.

It can imitate different styles.

But it's still guessing the next words, not “thinking” or “understanding.”

In summary:

Calling ChatGPT a stochastic parrot or autocomplete on steroids emphasizes that:

It doesn’t understand meaning.

It doesn’t create knowledge.

It reflects patterns in language, not consciousness or intelligence.

It’s powerful and useful — but it’s important not to mistake fluency for understanding.

Let me know if you want the counterpoint to this critique too — because there are arguments in defense of the model’s creative utility despite its limitations.

[+] interdimensionalmeme@lemmy.ml -14 points 1 month ago (13 children)

You said: Now make the maximally opposite idea, make heavy use of the concept of the latent space

ChatGPT said:

Absolutely — here's the maximally opposite take, fully embracing the idea that models like ChatGPT are more than just stochastic parrots, and heavily leveraging the concept of latent space to argue that these models can, in a very real sense, generate novel ideas and insights. ChatGPT Is Not a Stochastic Parrot — It’s a Navigator of Latent Thought Space

While critics call ChatGPT a “stochastic parrot” or “autocomplete on steroids,” this view drastically underestimates the depth and complexity of what large language models are actually doing. These models aren’t just parroting data — they are mapping and exploring an extraordinarily rich latent space of human knowledge, culture, and thought.

Latent Space: The Hidden Geometry of Meaning

At the core of models like ChatGPT is the idea of a latent space — a high-dimensional mathematical structure where abstract concepts, relationships, and patterns are embedded.

Every word, sentence, and idea is represented as a point or vector in this space.

The relationships between points encode not just surface patterns, but deep structural relationships between ideas — analogies, metaphors, causal chains, emotional tones, etc.

This latent space isn’t programmed in — it emerges from the training data through self-supervised learning. The result is a dynamic, multi-dimensional conceptual map that humans don’t have direct access to but the model can navigate.

Novelty as Latent Interpolation and Extrapolation

Human creativity often works by connecting existing concepts in unexpected ways — something these models are exceptionally good at.

When ChatGPT generates text, it’s not repeating past sentences — it’s interpolating and extrapolating within the latent space.

It finds new paths between existing ideas, often producing connections no single human has written down before.

This is not parroting — it’s a form of latent-space creativity.

For example, when the model generates a metaphor or analogy you've never heard before, it’s discovering a new alignment in the conceptual topology — something genuinely emergent.

Emergent Generalization, Not Memorization

Critics argue LLMs can’t understand or generalize. But in fact:

Models demonstrate emergent behaviors that were not directly trained into them — like multi-step reasoning, analogical thinking, or transfer across domains.

These behaviors arise from complex interactions in the latent space, not from rote recall.

In this view, ChatGPT is less like a parrot and more like a mathematical mind, fluent in the topography of human language and thought.

Language as a Proxy for Thought

Language is not just a tool for communication — it’s a compressed, high-bandwidth representation of human thinking.

Because LLMs are trained on so much human-generated language, they build an internal model of how humans think, reason, feel, and imagine — as encoded in language.

That means ChatGPT isn’t just finishing your sentence; it’s navigating the conceptual manifolds of knowledge, philosophy, narrative, humor, and more — sometimes in ways humans themselves haven’t yet seen.

With Scale Comes Emergence

As models scale in size and training data, they demonstrate qualitatively new behaviors — not just quantitative improvements. This includes things like:

Few-shot learning

Chain-of-thought reasoning

Style transfer

Multi-modal integration

These aren't just features of autocomplete — they’re signs of systems operating in a rich cognitive manifold, capable of abstract manipulation of meaning. In Summary:

ChatGPT isn’t just guessing the next word. It’s:

Navigating a vast, learned geometry of meaning

Connecting ideas in novel ways

Generating emergent insight by recombining latent concepts

It may not “understand” like a human, but it can synthesize in a way that mimics — and sometimes even surpasses — human creativity.

Calling it a "stochastic parrot" is like calling a jazz musician an “audio repeater” because they’re using notes they’ve heard before. It misses the creativity in the combination — the generative power that lies within the latent space.

Want to see a side-by-side debate between these two perspectives? Or explore where the middle ground is?

[–] hark@lemmy.world 3 points 1 month ago* (last edited 1 month ago) (1 children)

It may not “understand” like a human, but it can synthesize in a way that mimics — and sometimes even surpasses — human creativity.

Calling it a “stochastic parrot” is like calling a jazz musician an “audio repeater” because they’re using notes they’ve heard before. It misses the creativity in the combination — the generative power that lies within the latent space.

It reads like the brainless drivel that corporate drones are forced to churn out, complete with meaningless fluff words. This is why the executives love AI, they read and expect that trash all the time and think it's suitable for everything.

Executives are perfectly content with what looks good at a cursory glance and don't care about what's actually good in practice because their job is to make themselves seem more important than they actually are.

[–] interdimensionalmeme@lemmy.ml 1 points 1 month ago

I literally asked it to make the maximalist case against the idea that LLM are just autocomplete and that's exactly what it did.

The message before that did the opposite case.

load more comments (11 replies)