595
Grok AI still being used to digitally undress women and children despite suspension pledge
(www.theguardian.com)
this post was submitted on 06 Jan 2026
595 points (98.1% liked)
Technology
78511 readers
2840 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
This is messed up tbh. Using AI to undress people—especially kids—shouldn’t even be technically possible, let alone.
It's technically possible because AI doesn't exist. The LLM's we have do exist and these have no idea what it's doing.
It's a database that can parse human language and put pixels together from requests. It has no such concept as child pornography, it's just putting symbols together in a way it learned before that happen to form a child pornography picture
This is a lot of words to basically say the developers didn’t bother to block illegal content. It doesn’t need to ‘understand’ morality for the humans running it to be responsible for what it produces.
Neither of you are wrong. LLMs are wild uncaged animals. You're asking why we didn't make a cage, and they're saying we don't even know how to make one yet.
So, why are we letting the dangerous feral beast roam around unchecked?
Because being irresponsible is financially rewarding. There’s no downside. Just golden parachutes
We as a society have failed to implement those consequences. When the government refused, we should have taken up the mantle ourselves. It should be a mark of great virtue to have the head of a CEO mounted over your fireplace.
Okay, I’ll take Zuckerberg over the TV if I can place used dildos in his mouth from time to time. Elon, on the other hand, might frighten the cat.
Yeah, how hard is it to block certain keywords from being added to the prompt?
We've had lists like that since the 90's. Hardly new technology. Even prevents prompt hacking if you're clever about it.
Eh, no?
It's really REALLY hard to know what content is, and to identify actual child porn even remotely accidentally, even with AI