this post was submitted on 13 Jul 2026
608 points (98.3% liked)

Technology

86332 readers
4182 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 3 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
608
AI giants learn what everyone else on the modern internet already knows (www.businessinsider.com)
submitted 1 day ago by LuckyDevil@piefed.social to c/technology@lemmy.world
78 comments fedilink hide all child comments
 

For years, tech giants have argued that if information is available on the internet, it can be used for AI model development and outputs. They call it fair use. Content owners have tried to prevent this, with no success.

Now Anthropic, OpenAI, and Google are discovering what the rest of the internet has already learned through painful experience: once you put something online, people will find ways to use it in ways you don't like and can't stop.

The latest flashpoint is something called "distillation," using the outputs of one AI model to improve another. Anthropic says competitors are harvesting its outputs at scale, turning billions of dollars of research into a shortcut for rivals. OpenAI and Google have made similar warnings recently.

Remove Paywalls Link

you are viewing a single comment's thread
view the rest of the comments
[–] Tollana1234567@lemmy.today 7 points 1 day ago (2 children)

havnt they realized they eventually will train thier "llm" on slop created by other LLM slop.

[–] Holytimes@sh.itjust.works 1 points 20 hours ago

That was a problem that's been basically solved. So no, it's not actually an issue anymore.

That's why this is happening. You basically want to train a model that's going to train the next model and that's going to train the next model.

Doing a bunch of other fancy s*** means that each consecutive level improves the quality instead of reducing it.

So we're at the point where it's more effective to let your opponent do all the heavy, more expensive training of the less effective model. Then train the model that you want to make on that because paying them to run their finished model is cheaper than making it in the first place to train the next one.

In a sense, it's sort of like compression. The harder you compress the longer and more expensive and more difficult it becomes. So ideally you want to be the last guy in the chain to do the final compression so you get a reap all of the rewards without any of the overhead.

[–] echodot@feddit.uk 2 points 1 day ago

Yeah they call that artificial data and tout it as a good thing