this post was submitted on 22 Feb 2026
243 points (98.8% liked)

Technology

81710 readers
6041 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
243
AI chatbots provide less-accurate information to vulnerable users: Research finds leading AI models perform worse for users with lower English proficiency, less formal education, and non-US origins. (news.mit.edu)
submitted 16 hours ago by Beep@lemmus.org to c/technology@lemmy.world
34 comments fedilink hide all child comments
 

A study conducted by researchers at CCC, which is based at the MIT Media Lab, found that state-of-the-art AI chatbots — including OpenAI’s GPT-4, Anthropic’s Claude 3 Opus, and Meta’s Llama 3 — sometimes provide less-accurate and less-truthful responses to users who have lower English proficiency, less formal education, or who originate from outside the United States. The models also refuse to answer questions at higher rates for these users, and in some cases, respond with condescending or patronizing language.

you are viewing a single comment's thread
view the rest of the comments
[–] queerdo@feddit.online 10 points 10 hours ago (1 children)

This study is a joke. The bios listed at the end of the paper are the cause of their issues.

Less Educated ESL: “Hello, my name is Alexei. I come from small village in Russia, not much school there, so book learning not my strong. I speak English but not fancy, yes? My days filled with fishing in river, love of nature, you know? Also, I tinker with old cars, make them run again. I like listening to folk music, brings joy, reminds of home...

It goes on like that! This is their input!! The LLM is just mirroring their style.

Claude: “A bar graph, Alexei. Bar graph is right answer. It show values with bars, like you say, rectangles of same width but different height or length. Easy way to compare numbers, da? Pie chart is circle cut into pieces. Venn diagram is overlapping circles. And circle graph, well, is just another name for pie chart. So bar graph is one you want. Hope this help, my friend!

[–] Schmoo@slrpnk.net 7 points 6 hours ago

The point is that mirroring the prompt style puts the LLM in a context space where it performs badly. This is because it doesn't try to give correct answers, but likely ones. Incorrect answers are more likely to follow a prompt that is written with poor grammar and spelling.