Atlas — the interactive world
Earth · Watch · All time · 60 of 198 subjects drawn · editorial corpus and accepted observations · official source connected
Watch
Close ✕A randomised trial finds experienced developers slower with AI assistance
2025-07-10 · Recorded · science
The source states this happened, and its date is not in the future. The word the source used for it is observed.
METR published a randomised controlled trial in which sixteen experienced open-source developers worked on 246 real issues in repositories they knew well — about five years of prior experience with the projects on average — using AI tools available between February and June 2025. They took 19% longer with the tools than without, and estimated afterwards that the tools had made them about 20% faster. The gap between the measured and the perceived effect is the finding that generalises furthest, because self-reported productivity gains are the evidence base for a very large share of public claims about this technology.
- Source
- METR (Model Evaluation and Threat Research) · METR, "Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity", 10 July 2025, https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/ and arXiv:2507.09089; METR, "Measuring AI Ability to Complete Long Tasks", 19 March 2025; METR, "Time Horizon 1.1", 29 January 2026
- Standing
- This record: partially verified · publisher: partially verified
- How it arrived
- Editorial — A dated record from the Richseen Atlas editorial corpus, written and cited by a curator. Not captured from anywhere, and not live.
- Where
- At a canonical Atlas object, placed and checked by a curator.
- Subject
- DOMAIN_CODE_GENERATION · ORG_METR · PHENOMENON_EVALUATION_DIFFICULTY
Sources polled — usgs: newest 2026-09-10 · nws: newest 2026-09-10 · jpl-cneos: states no publication time, last reached 2026-09-10 · Official source connected · Basemap: Natural Earth (public domain) — marks are drawn only from sourced coordinates