595
Grok AI still being used to digitally undress women and children despite suspension pledge
(www.theguardian.com)
this post was submitted on 06 Jan 2026
595 points (98.1% liked)
Technology
78511 readers
3254 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
How they undress underage without this data on their server to train the models?
AI crawlers are scraping every site. Every site. Random public-but-unlisted hobby sites are getting scraped and spiking users' data. There was a Lemmy post about someone who had that experience just yesterday.
Think of how much Child Porn is stored on public sites that are shared in private groups. Also consider that FaceBook is the largest distributor of Child Sex Abuse material. These models are absolutely trained on Child Porn.
"Also consider that FaceBook is the largest distributor of Child Sex Abuse material"
Why is this not all over the news too? A rhetorical question. Sadly, I think we all know the answer by now.
Instagram literally has “mommy daughter” accounts that are 100% CP fetish material, and every single comment is by an older man
Meta doesn’t give a FUCK as long as you drive engagement
Disgusting
For the same reason the media pushed the AI bubble. Silicon Valley holds their chosen boys...
People posting photos online of their kid in the bath, at the beach, etc. with reckless abandon maybe.
For as far as I remember (and that's quite far these days), we've kept telling people to not post pictures of their kids online as much as possible. Way before the facebooks and way before the LLM craze, so people can't mess with them. Guess 20 years of heads up wasn't enough.
Can confirm. Been a mod on one minor social media site. Once banned a group that claimed to be "nudist". More than half of photos were featuring under aged children. This shit happens more often than we think.
They don't need to.
Take pictures of normal dressed children, combine with pictures of naked adults. Now you have CP.
I haven't seen these pictures, so I can't say how good/bad it works, but if that was only that, the results would be more or less wrong. Kids are quite different from adults.
On the other hand, plenty of pictures of naked/semi naked kids in a non sexual context can probably be found online already, so it's not inconceivable that their model had plenty of references to use anyway.