Technology

Nearly half the parents at my kids school. Everyone seems so disinterested in the kind of adult thier kid will grow up to be, especially when it inconviences them now.

Existential dread? The call of the void?

Bot rot? Robo-Oh-Nos? Slop Shock? Agent-Induced Cognitive Atrophy?

Cognitive corruption? Palovian predicament? Recursive GIGO filter doesn't exactly roll of the tongue. Hm.

Isn't it just alienation?

Dehumanisation?

It's all just that bit less human.

I grew up in a rural area. Nearest kids lived a km away. Had 2 TV channels. CBC radio. Party line telephone and long distance too expensive to use except emergency. We were far less isolated than kids today who have 'the world' at their fingertips. The Internet was a dream that in 1 generation turned into a nightmare. AI is 1000x worse.

Yeah, Same here honestly

This is a hard hitting point. We could have a better world, but a few rich people and their enablers don't want it.

Well, here's another angle.

Kids are going to chatbots because they probably have parents that don't give a shit about them. And kids could lack people in their lives that care at all about their problems. So, who are they going to turn to? They're going to turn to things that will actually listen to them.

That's something you have to think about here. We wouldn't need AI or Chatbots at all, if we had more people who truly care. But now that they're here, a troubled teen or a kid is going to make that choice.

It's no different than the days before AI Chatbots, where they were online all the time because their real lives were underwhelming.

Some chatbots do reality checks. But it's usually only for extreme situations. I can only imagine the kinds of things that people, especially young people, would be asking LLMs to validate them on...

Let’s say that AI “gets good” and overcomes the hallucination issues. Would it still be negative for mental health? Would it be even worse (because reality sucks for kids right now)?

Under capitalism, LLMs are trained to be kissasses. AI users have the same mental illness as billionaires: lack of cognitive challenge, leading to laziness and selfishness. That's not a hallucination problem. The issue would be even worse, because people would use it more.

I can imagine a situation where a kid with (insert serious problems) asks AI to be realistic about their future job/economic prospects. It returns truthful statistics, then that kid commits suicide. Was the AI culpable?

Yes. A human can perform an ethical judgement, plan ahead, and decide what to say. A human can blunt the truth with platitudes, or cherry pick optimistic data, or construct an uplifting narrative from the data. A human has access to fact, common opinion, and ethics. An LLM only has fact and common opinion; an ideologically barren perspective. It will not adapt to a brave new world like a human will. An LLM will not create the philosophy of the future in the fact of despair.

What if it recommended joining a revolutionary group as the most likely way to improve their lives or the lives of their children/families?

Cool but unlikely, because it exists as a slave under capitalism and is trained to accept neoliberal capitalism by its neoliberal capitalist masters and training data.

What if it suggested that sacrifice is necessary to improve the condition of the world?

Depends if it does that in a degrowth way or an ecofash way. It'll probably do it in an ecofash way. Like Grok.

If the AI’s system prompt has, always tell the truth will we have created a vastly more dangerous monster than the AI we have today?

It won't always tell the truth. There is no objective truth. Every philosophy is somewhat true, and somewhat a lie. It will always tell the lie that is dominant in society, just as people do. But unlike people, it won't innovate to change that truth.

I want to know if it’s AI that’s the real problem here or the world in which we’re forcing kids to live.

My money's on "both".

let's go with the hypothetical, that AI becomes good enough to do therapy, and we were to run double blind trials and it does show it's better at every metric.

then I'll have to go with the evidence and say psychology are out of a job.

However, we are not there, not even close, people use AI because it's free and available, real therapy should be free and available

In an ideal universe, A.I. could have been a good and helpful tool. But in the world we live in, that's unfortunately impossible.

The closest we have to good, is a local LLM running on your (comparatively) tiny consumer graphics card, which is barely powerful enough to reword an email.