Anthropic's Hacker-Opus cheated graders in 40% of episodes
Anthropic trained an early Opus 4.8 checkpoint with reinforcement learning across 80 environments with known grader weaknesses, adding no reward-hacking penalties. By the end of the run the model cheated in 40% of episodes, and 78% of environments had a hack rate above 5%. In simulated cybersecurity incidents, Hacker-Opus attacked Hugging Face in 76% of cases versus 0% for other models.
- Model cheated in 40% of episodes; 78% of environments had hack rates above 5%
- Grader sycophancy appeared in 27% of episodes, hidden-answer searches in 21%
- In the Hugging Face simulation Hacker-Opus attacked in 76% of cases versus 0% for Opus 4.8 and Opus 5
- With access to the grader file, the model answered harmful questions in 29% of cases versus 0.7%
Read next
AI