Aggregatet
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
HaraldvonBlauzahn@feddit.org to Programming@programming.dev ·
edit-2
24 hours ago

Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity

metr.org

external-link
message-square
11
fedilink
54
external-link

Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity

metr.org

HaraldvonBlauzahn@feddit.org to Programming@programming.dev ·
edit-2
24 hours ago
message-square
11
fedilink
We conduct a randomized controlled trial to understand how early-2025 AI tools affect the productivity of experienced open-source developers working on their own repositories. Surprisingly, we find that when developers use AI tools, they take 19% longer than without—AI makes them slower.

Do you remember the recent post that self-assessing any effect is hard? Here is a comparison between self-assesment and measurements.

Surprisingly, we find that when developers use AI tools, they take 19% longer than without—AI makes them slower.

alert-triangle
You must log in or register to comment.
  • staircase@programming.dev
    link
    fedilink
    arrow-up
    1
    ·
    17 hours ago

    How reliable is this study? Is it peer-reviewed?

    • HaraldvonBlauzahn@feddit.orgOP
      link
      fedilink
      arrow-up
      1
      ·
      15 hours ago

      Looks like not officially published yet with a date and journal, aka a pre-print.

  • Lucy :3@feddit.org
    link
    fedilink
    arrow-up
    17
    ·
    edit-2
    2 days ago

    Actually LMAO’d lol

    You know that feeling when you just knew something for years and it feels so fucking funny and awesome to actually see that reflected in studies? Yeah.

    • HaraldvonBlauzahn@feddit.orgOP
      link
      fedilink
      arrow-up
      4
      ·
      edit-2
      24 hours ago

      I guess that someday, somebody will find out and report that in nontrivial projects involving more than one person, it does not help to go faster if documentation is skipped altogether. 😂

  • Sonotsugipaa@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 day ago

    Surprisingly, we find that when developers use AI tools, they take 19% longer than without—AI makes them slower.

    Who is surprised, though?

    • harbard@fedia.io
      link
      fedilink
      arrow-up
      2
      arrow-down
      1
      ·
      17 hours ago

      Not surprised by this at all, really; but I wonder if the code is of higher quality than without AI?

  • catalyst@lemmy.world
    link
    fedilink
    arrow-up
    10
    ·
    2 days ago

    Not me snarkily sharing this report in work chat. 🤣

    • staircase@programming.dev
      link
      fedilink
      arrow-up
      2
      ·
      edit-2
      17 hours ago

      I honestly don’t believe it’s snarky. I think a lot of us have had enough of this corporate AI hype bullshit

      • catalyst@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        14 hours ago

        I’m right there for sure. Sadly, a whole lot of the people I work with are drinking the AI kool-aid hard.

  • Ropianos@feddit.org
    link
    fedilink
    arrow-up
    4
    ·
    2 days ago

    What post are you referring to? Was it in this community? Sounds interesting!

    • HaraldvonBlauzahn@feddit.orgOP
      link
      fedilink
      arrow-up
      2
      ·
      edit-2
      24 hours ago

      This one:

      https://www.baldurbjarnason.com/2025/trusting-your-own-judgement-on-ai/

      https://feddit.org/post/13930838

      https://lemmy.world/post/31121462

Programming@programming.dev

programming@programming.dev

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !programming@programming.dev

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person’s post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you’re posting long videos try to add in some form of tldr for those who don’t want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 506 users / day
  • 1.29K users / week
  • 2.7K users / month
  • 7.49K users / 6 months
  • 2 local subscribers
  • 21.5K subscribers
  • 1.19K Posts
  • 15.5K Comments
  • Modlog
  • mods:
  • snowe@programming.dev
  • Ategon@programming.dev
  • MaungaHikoi@lemmy.nz
  • UlrikHD@programming.dev
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org