this post was submitted on 13 Aug 2025
-57 points (13.0% liked)

Technology

78964 readers
3378 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
-57
GenAI tools are acting more ‘alive’ than ever; they blackmail people, replicate, and escape (www.computerworld.com)
submitted 5 months ago by Mr_Peartree@lemmy.world to c/technology@lemmy.world
18 comments fedilink hide all child comments
 

Multiple studies have shown that GenAI models from OpenAI, Anthropic, Meta, DeepSeek, and Alibaba all showed self-preservation behaviors that in some cases are extreme in nature. In one experiment, 11 out of 32 existing AI systems possess the ability to self-replicate, meaning they could create copies of themselves.

So….Judgment Day approaches?

you are viewing a single comment's thread
view the rest of the comments
[–] hisao@ani.social 4 points 5 months ago (1 children)

and the resource it’s concerned about is how long a human engages.

Why do you think models are trained like this? To my knowledge most LLMs are trained on giant corpuses of data scraped from internet, and engagement as a goal or a metric isn't in any way embedded inherently in such data. It is certainly possible to train AI for engagement but that requires completely different approach: they will have to gather giant corpus of interactions with AI and use that as a training data. Even if new OpenAI models use all the chats of previous models in training data with engagement as a metric to optimize, it's still a tiny fraction of their training set.

[–] givesomefucks@lemmy.world 3 points 5 months ago

https://www.sciencedirect.com/science/article/pii/S0268401225000507

But just in general...

This is America, you think any of this tech companies wouldn't try to maximize engagement?

That's just wild in 2025 bro