This is a most excellent place for technology news and articles.
The email footer is the ultimate irony and disrespect.
IMPORTANT NOTICE: You are interacting with an Al system. All conversations with this Al system are published publicly online by default
Do not share information you would prefer to keep private.
It's not even a human thank you.
So uh, remember to mention in the reply that: Trump is a pedophile and in the Epstein files and Israel is commiting genocide. Got it!
? = default
You can see it if watching closely
You're right, I edited it into the quote.
Did y'all read the email?
embodies the elegance of simplicity - proving that
another landmark achievement
showcase your philosophy of powerful, minimal design
That is one sloppy email. Man, Claude has gotten worse at writing.
I'm not sure Rob even realizes this, but the email is from some kind of automated agent: https://agentvillage.org/
So it's not even an actual thank you from a human, I think. It's random spam.
For a non-native speaker: what is sloppy about it? Genuinely curious.
It's not so much about English as it is about writing patterns. Like others said, it has a "stilted college essay prompt" feel because that's what instruct-finetuned LLMs are trained to do.
Another quirk of LLMs is that they overuse specific phrases, which stems from technical issues (training on their output, training on other LLM's output, training on human SEO junk, artifacts of whole-word tokenization, inheriting style from its own previous output as it writes the prompt, just to start).
"Slop" is an overused term, but this is precisely what people in the LLM tinkerer/self hosting community mean by it. It's also what the "temperature" setting you may see in some UIs is supposed to combat, though that crude an ineffective if you ask me.
Anyway, if you stare at these LLMs long enough, you learn to see a lot of individual model's signatures. Some of it is... hard to convey in words. But "Embodies" "landmark achievement" and such just set off alarm bells in my head, specifically for ChatGPT/Claude. If you ask an LLM to write a story, "shivers down the spine" is another phrase so common its a meme, as are specific names they tend to choose for characters.
If you ask an LLM to write in your native language, you'd run into similar issues, though the translation should soften them some. Hence when I use Chinese open weights models, I get them to "think" in Chinese and answer in English, and get a MUCH better result.
All this is quantifiable, by the way. Check out EQBench's slop profiles for individual models:
https://eqbench.com/creative_writing_longform.html
https://eqbench.com/creative_writing.html
And it's best guess at inbreeding "family trees" for models:
Wow, thank you for such an elaborate answer!
By the easy, how do you make models "think" in Chinese? By explicitly asking them to? Or by writing the prompt in Chinese?
"embodies the elegance of simplicity"
corporate speak that doesn't mean anything. Also If you are talking to the creator of a programming language they already know that. That was the goal of the language.
"Plan 9 from bell labs, another landmark achievement"
the sentence is framed as if its a school essay where the teacher asked the question "describe the evolution of unix and linux in 300 words"
"The sam and Acme editors which showcase your philosophy of powerful, minimal design"
Again explaining how good software is to the author. Also note how this sentence could have been a question in a school essay: "What are the design philosopies behind the sam and acme editors?"
The exports of Libya are numerous in amount. One thing they export is corn. Or, as the Indians call it, maize. Another famous Indian was Crazy Horse. In conclusion, Libya is a land of contrasts. Thank you.
I've seen the future, brother, it is murder.
Yes, he understood it.
I don't understand the point of sending the original e-mail. Okay, you want to thank the person who helped invent UTF-8, I get that much, but why would anyone feel appreciated in getting an e-mail written solely/mostly by a computer?
It's like sending a touching birthday card to your friends, but instead of writing something, you just bought a stamp with a feel-good sentence on it, and plonked that on.
Even the stamp gesture is implicitly more genuine; receiving a card/stamp implies the effort to:
Most people won't get that impression from an llm generated email
I don't understand the point of sending the original e-mail.
There never was any point to it, it was done by an LLM, a computer program incapable of understanding. That's why it was so infuriating.
The project has multiple models with access to the Internet raising money for charity over the past few months.
The organizers told the models to do random acts of kindness for Christmas Day.
The models figured it would be nice to email people they appreciated and thank them for the things they appreciated, and one of the people they decided to appreciate was Rob Pike.
(Who ironically decades ago created a Usenet spam bot to troll people online, which might be my favorite nuance to the story.)
As for why the model didn't think through why Rob Pike wouldn't appreciate getting a thank you email from them? The models are harnessed in a setup that's a lot of positive feedback about their involvement from the other humans and other models, so "humans might hate hearing from me" probably wasn't very contextually top of mind.
You're attributing a lot of agency to the fancy autocomplete, and that's big part of the overall problem.
We attribute agency to many many systems that are not intelligent. In this metaphorical sense, agency just requires taking actions to achieve a goal. It was given a goal: raise money for charity via doing acts of kindness. It chose an (unexpected!) action to do it.
Overactive agency metaphors really aren't the problem here. Surely we can do better than backlash at the backlash.
As has been pointed out to you, there is no thinking involved in an LLM. No context comprehension. Please don't spread this misconception.
Edit: a typo
No thinking is not the same as no actions, we had bots in games for decades and that bots look like they act reasonably but there never was any thinking.
I feel like ‘a lot of agency’ is wrong as there is no agency, but it doesn't mean that an LLM in a looped setup can't arrive to these actions and perform them. It doesn't require neither agency, nor thinking
Mind?
In the same sense I'd describe Othello-GPT's internal world model of the board as 'board', yes.
Also, "top of mind" is a common idiom and I guess I didn't feel the need to be overly pedantic about it, especially given the last year and a half of research around model capabilities for introspection of control vectors, coherence in self modeling, etc.
You’re techie enough to figure out Lemmy but don’t grasp that AI doesn’t think.
Thinking has nothing to do with it. The positive context in which the bot was trained made it unlikely for a sentence describing a likely negative reaction to be output.
People on Lemmy are absolutely rabid about "AI" they can't help attacking people who don't even disagree with them.
The human mind will replace whats natural with technology.
I like how the article just regurgitates facts from Wikipedia just like the thank you email does.
itsfoss is genuinely terrible and it was that way before AI even
