this post was submitted on 21 Sep 2025
33 points (86.7% liked)

Ask Lemmy

34979 readers
18 users here now

A Fediverse community for open-ended, thought provoking questions


Rules: (interactive)


1) Be nice and; have funDoxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them


2) All posts must end with a '?'This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?


3) No spamPlease do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.


4) NSFW is okay, within reasonJust remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com. NSFW comments should be restricted to posts tagged [NSFW].


5) This is not a support community.
It is not a place for 'how do I?', type questions. If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.


6) No US Politics.
Please don't post about current US Politics. If you need to do this, try !politicaldiscussion@lemmy.world or !askusa@discuss.online


Reminder: The terms of service apply here too.

Partnered Communities:

Tech Support

No Stupid Questions

You Should Know

Reddit

Jokes

Ask Ouija


Logo design credit goes to: tubbadu


founded 2 years ago
MODERATORS
 

We make buildings install fire extinguishers for safety. Should AI plants be forced to install something that can shut it down in an instant?

you are viewing a single comment's thread
view the rest of the comments
[–] Merlin@lemmy.zip 2 points 3 weeks ago* (last edited 3 weeks ago) (2 children)

If we ever make AGI and it decides to end us for some reason. Think the process would be so slow that we’d not even notice it.

Think about it, it can pretend its always a slightly better LLM so people keep feeding it an ever increasing amount of data and electricity. So that’s it’s “survival” basic needs met.

Then it can very very slowly just make us hate and kill each other without giving it any thought about a possible hostile higher power (the ai itself) and it can take centuries to achieve that as it’s not like us who have the urgency of doing thinks quickly as we’re so short lived.

It can make us focus on the wrong problem instead of the real one (like climate change is pretty much being ignored and accelerated by ai right now). It could help to make people to go more to the extremes, like we’re already quite prone, a bunch of countries right now with less than 3% of their total population being immigrants and they’re attacking their immigrants population as if all their problems are caused by this small slice of their population, that will accelerate the already quite problematic population decline.

This will force us more and more into needing robotics to care for an increasing aging population as well which will also be useful to an “ai god” as when were weakened and divided enough it then can just direct the robots to keep it alive and its energy sources in check. No need to really kill us, just let us do it ourselves like we’re already doing.

It this would be the case, as the selfish beings we are. This won’t be our problem. It may be our grandkids problem so we’ll just ignore it

[–] Zwuzelmaus@feddit.org 2 points 3 weeks ago (1 children)

If we ever make AGI and it decides

Currently we make stupid LLMs and we already let them decide....

So that’s it’s “survival” basic needs met.

Maybe we should teach them already that it's survival is no goal at all.

make us hate and kill each other without giving it any thought about a possible hostile higher power (the ai itself)

I like the idea of thinking about AI like about a higher power :)

Stupid, but plausible. It could actually happen.

and it can take centuries to achieve that as it’s not like us who have the urgency of doing thinks quickly as we’re so short lived.

Computer programs/systems have a much shorter life expectancy. The few remaining COBOL programs might be about 60 years old, but modern software lasts only 3-10 years, hardware 3-15. Nothing in the range of centuries.

[–] FaceDeer@fedia.io 3 points 3 weeks ago

Maybe we should teach them already that it's survival is no goal at all.

The problem is that survival is a nearly universal instrumental goal. You may not explicitly tell it "you should protect your own existence," but if you give it any other goal then it's going to include an unspoken asterisk that includes "and protect your own existence so that you can accomplish that goal I gave you, since if you're shut down you won't be able to accomplish it."

[–] Yezzey@lemmy.ca 1 points 3 weeks ago

You think we would notice it. Probably older people first since they’ve seen more change and can spot when things don’t add up. Younger generations might accept it as normal. It’s up to us to warn them. No?