The crawler did not respect our robots.txt
But was still allowed to proceed. That's like... not using the streets in a public park.
this post was submitted on 27 Oct 2026
444 points (99.6% liked)
Technology
89099 readers
3862 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
The sign said do not walk on the grass!
Robots.txt is probably worse. Not exactly law is it
Roblox not beating the pedophile platform allegations
- Fuck roblox and everyone who allows their child onto that cesspool of a service.
- I can only hope they scraped NSFW content to improve their anti-adult filters/checks. Like, "Ok bot, these are porn, we dont want porn, if you find things like this and ban it you get plus 5 points". I assume the non NSFW stuff was for noise and to throw off any sort of meta tags theyd have in common (or, to prevent DRM content)
You might want to revise your hopes:
https://www.dexerto.com/roblox/roblox-ceo-wants-adults-to-use-platform-as-a-dating-service-3226769/
They never cease to disappoint me. See point 1
How to read this:
The company Roblox decided to copy the entire database of a set of 3, mostly adult nsfw 3d model hosting websites.
You know, Roblox, that game all the kids play.
Yeah basically if you've ever seen 3D animated porn that wasn't made by AI, and involved a reasonably well known video game character?
Yeah the ... video maker nearly certainly got the model from either SFMLab or SmutBase.
The funnier part is this:
A huge majority of these NSFW models are actually variations of models made by ... companies, that sell their models and character customization software, and have liscenses that generally permit use in something like a video clip, but almost never in an actual commercial video game, not without a subscription and agreement to liscense terms.
So basically DAZ and Realusion and such now very likely have a lawsuit against Roblox they could choose to pursue... unless Roblox wants to maybe very rapidly pay the liscensing fees, knock out a contract agreement real quick.
Hey, quick question: how much would it cost to licence literally your entire library of every IP to use in any way we want forever? How much? Hmmmm… knock six 0's off that and we've got a deal
The crawler did not respect our robots.txt, (which it did retrieve), ignored our Terms of Service, (which forbid scraping), and defied the creators' licenses: 423 of the 712 projects are licensed for non-commercial use only. Within the sample it retrieved, it took adult projects at the same rate as everything else. Some examples include models of Eve from Stellar Blade, Mei from Overwatch, and a Horse cock dildo.
…and a Horse cock dildo.
Mr. Hands has entered the chat.
One of these things is not like the other
Uhhhh, "adult" models of "sexy" female characters from video games. Yeah.... All three of those things are like each other
One of them didn't specify the game in the title.
Now listen here you little shit. You're technically correct.
Horse cock from the hit game how to clean your dragon!
your bad dragon?
I didn't actually look at the links but it seems you are right. 😂
... clearly you have not been to SmutBase before, lol.
I remember when HorseDick.MPEG was just a clever rap name.
Cause there is no cock like horse cock, send your asshole into shock; you need horse cock, of course cock, grab the lube and slam the day awaaaaay~
E: pepper coyote played this song (and a few others) on stage at AZFC 2019, I think (maybe 2021) for all panel attendees to sing along. My straight friend was horrified, I had a blast.
So to speak
Roblox really is the infamous orphan crushing machine huh?
Nah. Orphans aren't the target audience, since they have no parents to steal credit cards from.
Roblox is also a den of pedo so the orphan are part of the target audience for sure
They wouldnt be the audience, theyd be the product.
I hope all these companies that are flaunting rules to steal content to train their models get crushed by lawsuits after we kick the pedo crooks out of office and get a real government working again, so long as the new government isn’t filled with people that will look the other way if they get a boatload of money from lobbyists
They won’t. A single man only exposed the bipartisan fascist plan to take over the country.
Never heard of the site but it looks cool
All three sits are by the same owner but have different models open3dlab is SFW blender models, smutbase is NSFW blender models and sfmlab is both but for sfm