chiprook
← AI
AIOctober 10, 2026, 07:01

Preprint: Agent PR revert rates range from 6.1% to 14.5% by vendor

A Texas Tech preprint analyzed 37,623 provenance-labeled PRs across 2,807 GitHub repos from December 2024 to July 2025. 90-day revert rates: Codex 6.1%, Devin 14.5%, Copilot 12.5%, Cursor 11.4%, Claude Code 10.5%, versus 11.5% for a matched human baseline. The spread across agents exceeds the gap between the best agent and humans.

Preprint: Agent PR revert rates range from 6.1% to 14.5% by vendor
#OpenAI#GitHub#Cursor#Anthropic
Read next
AI

Sam Altman's PR Team Cut Off Question About ChatGPT-Linked Suicide

AI

Preprint Finds a Steerable 'Pain Axis' in 25 Open-Weight LLMs, Not Claude

AI

OpenAI launches GPT Sol 6.1 with adaptive reasoning engine

AI

Enterprise AI vendors split decision logic into separate model layers