Indicator
Experienced developer productivity
Measure by METR
Early-2025 randomized trial
19% longer
METR
independent evaluator
METR
Independent evaluations, task horizons and productivity studies. Selected historical snapshots, not a live leaderboard.
Published evidence
Indicator
Experienced developer productivity
Measure by METR
Late-2025 study update
Qualitative result
METR
Relevant sources
Time Horizon 1.1 ↗
organizational research article · 2026-01-29 · available
Evaluating frontier AI R&D capabilities of language model agents against human experts ↗
organizational research article · 2024-11-22 · available
Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity ↗
organizational research article · 2025-07-10 · available
We are Changing our Developer Productivity Experiment Design ↗
organizational research article · 2026-02-24 · available
Recent Frontier Models Are Reward Hacking ↗
organizational research article · 2025-06-05 · available