this post was submitted on 27 May 2026
801 points (98.7% liked)
Technology
84980 readers
3547 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It's one study, so I'd take it with a grain of salt, and also the study says
And a comment I read on it says "56% of the participants had never used Cursor before, 1/4th of the participants did better, 3/4 did worse. One of the top performers for AI was also someone with the most previous Cursor use. "
So it really might just be a tooling / experience issue, and the tooling has also improved substantially over the past year, like Claude Code and Chat GPT's Codex. Outputs from LLMs are substantially better in programming than a year ago.
Edit: Looks like they did a followup study with some of the same participants which is always nice to see. I hope they do a 2027 one and they have the same participants again.
https://metr.org/blog/2026-02-24-uplift-update/#wider-adoption-of-ai-has-made-it-more-difficult-to-measure-task-level-productivity
So it's likely people getting used to it, tooling is better, and now they're potentially seeing modest improvements.
They tested it again back in March and got similar results which, being an AI hype company, they buried in their paper.
Many of the programmers refused to not use AI, probably related to the declined cognitive function that some other studies have shown to occur in AI users. I read one testimonial saying that his head would explode if he couldn’t use AI.
So plenty of experience by that point.
I was editing my reply as you replied, but the new study showed they fared better, not worse or the same. Even the new people to the study fared better, but worse than the existing.
They said it did better, every news story for their March test says the opposite.
They are an AI hype company. It’s in their interest to tweak the results and the study to make things look better.