Analysis: LLM quality drops often come from the stack, not the model
A HackerNoon analysis argues that complaints about models getting dumber after GPT-6 Astra's September 2026 rollout usually trace to routers, reasoning-effort defaults, caching bugs and SDK settings rather than weights. It cites Anthropic's Claude Code effort change and a 13.3-point gap between providers serving gpt-oss-120b on AIME 2025.
- Anthropic cut Claude Code's default reasoning effort from high to medium on March 4, 2026
- gpt-oss-120b on AIME 2025: median 93.3% across providers, Azure at 80%
- GPT-4 accuracy on a prime-number task fell from 84.0% to 51.1% between 2023 versions
- Gemini 3 guide now advises keeping temperature at the default 1.0
Read next
AI