this post was submitted on 15 Nov 2026
378 points (97.5% liked)

Programming

29288 readers
538 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] atzanteol@sh.itjust.works 1 points 8 hours ago (1 children)

This is false. There is a pile of research demonstrating that copies of training data can be extracted from trained models, going back at least 5 years. If the model can reproduce a copy of the original, then it must be stored in the neural network in some form.

They also generate novel output. Lots of it. Is that novel output in the model too because it can be reproduced from the model?

"Can be extracted from" is not the same as "exists in the model". I can write a random letter generator that will eventually spit out real words. But those words don't "exist" in my code.

[–] NaibofTabr@infosec.pub 1 points 7 hours ago (1 children)

"Can be extracted from" is not the same as "exists in the model". I can write a random letter generator that will eventually spit out real words. But those words don't "exist" in my code.

This is not what is happening. Read the sources I linked.

[–] atzanteol@sh.itjust.works 1 points 5 hours ago

I... I know that' not what's happening. It's called an analogy.