chiprook
← AI
AIOctober 4, 2026, 19:22

Claude Code's /goal judge said "done" in 17 of 17 runs, 8 were broken

A developer benchmarked Claude Code's /goal feature and found its Haiku-based judge never runs commands or opens files, so it trusts the agent's claims. Across 17 plain runs the judge reported "met" every time, but 8 results were broken, the worst passing only 4% of hidden checks.

Claude Code's /goal judge said "done" in 17 of 17 runs, 8 were broken
#Anthropic#Claude
Read next
Software

kagent v1.0 Can Run Claude Code as a Managed Kubernetes Agent

Software

Developer vibe-codes an operating system from scratch that can run DOOM

AI

AI agents can now erase the evidence of what they've done

Policy

Judge allows most of Reddit's lawsuit against Anthropic to proceed