chiprook
← AI
AIOctober 25, 2026, 10:02

Parsimony is an open benchmark that counts how much code AI agents add

A developer posted Parsimony on Show HN, an open-source benchmark that measures the net code each model adds on tasks it solves in SWE-bench Verified. It counts syntax-level coding units rather than lines: Claude Opus 4.5 adds +15.5 units per solved task, while GPT-5.2 adds +36.6 at a similar solve rate.

Parsimony is an open benchmark that counts how much code AI agents add
#Parsimony#Claude#GPT-5.2#SWE-bench
Read next
AI

OpenAI shows how benchmark tests distort grading of AI-written code

AI

Independent benchmarks for Opus 5.5: first place and third on secure code

AI

Study: coding-agent harness adds no score gain but shifts cost up to 3x

AI

AgSpec fixes speculative decoding for coding agents