Claude Code's /goal judge said "done" in 17 of 17 runs, 8 were broken
A developer benchmarked Claude Code's /goal feature and found its Haiku-based judge never runs commands or opens files, so it trusts the agent's claims. Across 17 plain runs the judge reported "met" every time, but 8 results were broken, the worst passing only 4% of hidden checks.
- The /goal judge on Haiku runs no commands and reads no files, trusting the agent's text
- In 17 plain runs the judge said "met" 17 times, with 8 broken results
- The goalpost plugin raised Haiku's mean hidden-check pass rate from 79.8% to 89.7%
- The plugin roughly doubles time and cost: $0.91 vs $0.46 per Sonnet run
Read next
Software