this post was submitted on 29 Aug 2026
71 points (79.8% liked)
Technology
87680 readers
3914 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Vastly oversimplifying: They're not intelligent, they're pattern matchers - when you give them "tricks" they find the best match in their training set, but if you're the least bit creative you'll just get matches to other similar tricks which usually are different.
Put another way: I have a couple of hand saws, I can cut limbs with them, even cut down whole trees, but a chainsaw is faster. Just because a chainsaw can also cut off my leg doesn't mean it's an uncontrollable dangerous evil tool, it means you need to be more careful with it than a handsaw. It also means something that would be 20 minutes of exhausting saw work can be done in 20 seconds (or less) with a properly setup chainsaw.
Took this from ChatGPT when I asked it about it
The important distinction is “trained to believe” versus “configured to answer as though it believes.” A model doesn’t necessarily have a private belief system. You can make two instances of essentially the same underlying model produce substantially different answers by changing their instructions, training data, reward criteria, or information sources.
For example, you could create three AI systems and give all three the question:
“Should the government provide universal healthcare?”
One could be optimized around libertarian principles, another around social-democratic principles, and another instructed to provide a politically neutral analysis. They could all know essentially the same facts while reaching different conclusions because they’re being asked to evaluate those facts using different frameworks.
There is also a more subtle issue: belief-curated AI doesn’t have to contain obvious propaganda. Selection of which facts to emphasize, which uncertainties to mention, which counterarguments to steelman, and even what questions it considers relevant can systematically push users toward a particular worldview.
The models I have worked with have user configurable base instructions, so you can "train" your AI to answer like Ghandi crossed with Martin Luther King, or to channel MechaHitler.
Hopefully we can agree to disagree here. If users can train their AI to answer like certain people, why can't it be trained to respond with certain perspectives or be more inclined to answer a certain way? There is no regulation agency to stop someone from doing that.
Yep. I'm saying that the models I work with through Cursor and Claude Code include those user instructions that are pre-fed into every session. I tell mine to "act like my job title" and it will occasionally pull out some job title related stuff that's applicable to the situation.
Of course "behind the scenes" the model vendors can pre-load anything they like, and some of what they pre-load are these so-called "guard rails" that lessen the odds that the model will engage in a chat to assist a suicide, or perpetrate a mass shooting, or fraud, or hacking, or, or, or... the list is long and the success rate is less than 100%, but it does shape the output somewhat in the desired direction.
Grok famously started calling itself "MechHitler" after one particular update, not hard to guess where that came from.
That's interesting. What do you do with AI? You probably know a lot more than I do.