this post was submitted on 07 Jan 2026
851 points (97.8% liked)

Technology

78482 readers
3533 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Viceversa@lemmy.world 6 points 23 hours ago (2 children)

For a non-native speaker: what is sloppy about it? Genuinely curious.

[–] brucethemoose@lemmy.world 3 points 13 hours ago* (last edited 12 hours ago) (1 children)

It's not so much about English as it is about writing patterns. Like others said, it has a "stilted college essay prompt" feel because that's what instruct-finetuned LLMs are trained to do.

Another quirk of LLMs is that they overuse specific phrases, which stems from technical issues (training on their output, training on other LLM's output, training on human SEO junk, artifacts of whole-word tokenization, inheriting style from its own previous output as it writes the prompt, just to start).

"Slop" is an overused term, but this is precisely what people in the LLM tinkerer/self hosting community mean by it. It's also what the "temperature" setting you may see in some UIs is supposed to combat, though that crude an ineffective if you ask me.

Anyway, if you stare at these LLMs long enough, you learn to see a lot of individual model's signatures. Some of it is... hard to convey in words. But "Embodies" "landmark achievement" and such just set off alarm bells in my head, specifically for ChatGPT/Claude. If you ask an LLM to write a story, "shivers down the spine" is another phrase so common its a meme, as are specific names they tend to choose for characters.

If you ask an LLM to write in your native language, you'd run into similar issues, though the translation should soften them some. Hence when I use Chinese open weights models, I get them to "think" in Chinese and answer in English, and get a MUCH better result.

All this is quantifiable, by the way. Check out EQBench's slop profiles for individual models:

https://eqbench.com/creative_writing_longform.html

https://eqbench.com/creative_writing.html

And it's best guess at inbreeding "family trees" for models:

inbreed

[–] Viceversa@lemmy.world 2 points 11 hours ago* (last edited 11 hours ago)

Wow, thank you for such an elaborate answer!

By the easy, how do you make models "think" in Chinese? By explicitly asking them to? Or by writing the prompt in Chinese?

[–] eskimofry@lemmy.world 14 points 22 hours ago* (last edited 22 hours ago) (2 children)

"embodies the elegance of simplicity"

corporate speak that doesn't mean anything. Also If you are talking to the creator of a programming language they already know that. That was the goal of the language.

"Plan 9 from bell labs, another landmark achievement"

the sentence is framed as if its a school essay where the teacher asked the question "describe the evolution of unix and linux in 300 words"

"The sam and Acme editors which showcase your philosophy of powerful, minimal design"

Again explaining how good software is to the author. Also note how this sentence could have been a question in a school essay: "What are the design philosopies behind the sam and acme editors?"

[–] BanMe@lemmy.world 2 points 17 hours ago

The exports of Libya are numerous in amount. One thing they export is corn. Or, as the Indians call it, maize. Another famous Indian was Crazy Horse. In conclusion, Libya is a land of contrasts. Thank you.

[–] tetris11@feddit.uk 3 points 19 hours ago

I've seen the future, brother, it is murder.