this post was submitted on 27 May 2026
801 points (98.7% liked)

Technology

84980 readers
3547 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] TRBoom@lemmy.zip 12 points 23 hours ago* (last edited 23 hours ago) (3 children)

You’d be surprised…

An AI hype company did a fairly ok study with programmers. Some used ai some didn’t and they compared the difference in completion time.

The AI users were 20% slower than the non AI users, but thought they were faster.

So for your scenario, the company would need to hire 20 extra people to make up for the lost productivity.

[–] hark@lemmy.world 7 points 21 hours ago (1 children)

Not just 20 extra people. I'm seeing a funny trend in my company where managers decide to get into vibe coding and they get super excited at getting something somewhat functional running, so now they've been presenting "their work" and expecting developers to merge their heaping trash in. That'll require quite a few more people.

[–] NotMyOldRedditName@lemmy.world 3 points 18 hours ago* (last edited 18 hours ago)

This is the real problem thats leading to them thinking they can fire so many people. They get all excited because it can sometimes do something (and possibly do it terribly behind the scenes, but still do it) and oh shit we don't need any humans anymore!

Then you get companies regretting laying people off. The wrong people are making the decisions without understanding what is happening.

[–] NotMyOldRedditName@lemmy.world 5 points 23 hours ago* (last edited 22 hours ago) (1 children)

It's one study, so I'd take it with a grain of salt, and also the study says

However, we see positive speedup for the one developer who has more than 50 hours of Cursor experience, so it's plausible that there is a high skill ceiling for using Cursor, such that developers with significant experience see positive speedup.

And a comment I read on it says "56% of the participants had never used Cursor before, 1/4th of the participants did better, 3/4 did worse. One of the top performers for AI was also someone with the most previous Cursor use. "

So it really might just be a tooling / experience issue, and the tooling has also improved substantially over the past year, like Claude Code and Chat GPT's Codex. Outputs from LLMs are substantially better in programming than a year ago.

Edit: Looks like they did a followup study with some of the same participants which is always nice to see. I hope they do a 2027 one and they have the same participants again.

https://metr.org/blog/2026-02-24-uplift-update/#wider-adoption-of-ai-has-made-it-more-difficult-to-measure-task-level-productivity

Our raw results show some evidence for speedup. Our early 2025 study found the use of AI causes tasks to take 19% longer, with a confidence interval between +2% and +39%. For the subset of the original developers who participated in the later study, we now estimate a speedup of -18% with a confidence interval between -38% and +9%. Among newly-recruited developers the estimated speedup is -4%, with a confidence interval between -15% and +9%.

So it's likely people getting used to it, tooling is better, and now they're potentially seeing modest improvements.

[–] TRBoom@lemmy.zip 7 points 22 hours ago (1 children)

They tested it again back in March and got similar results which, being an AI hype company, they buried in their paper.

Many of the programmers refused to not use AI, probably related to the declined cognitive function that some other studies have shown to occur in AI users. I read one testimonial saying that his head would explode if he couldn’t use AI.

So plenty of experience by that point.

[–] NotMyOldRedditName@lemmy.world 3 points 22 hours ago (1 children)

I was editing my reply as you replied, but the new study showed they fared better, not worse or the same. Even the new people to the study fared better, but worse than the existing.

[–] TRBoom@lemmy.zip 2 points 22 hours ago

They said it did better, every news story for their March test says the opposite.

They are an AI hype company. It’s in their interest to tweak the results and the study to make things look better.

[–] Valmond@lemmy.dbzer0.com 1 points 17 hours ago

Managers have died for a valid metric about programmer productivity, I haven't heard any breakthroughs about that really, so your "study" is as bs as the CEO "AI is productive" study.