chiprook
← AI
AIOctober 18, 2026, 19:21

Haiku 5.5 vs 4.5: 100-prompt test shows far less repeatable answers

A developer ran the same 100 fixed prompts through Claude Haiku 4.5 and 5.5 twice a day for 11 days. Haiku 5.5 returned an identical answer on only 41–49 of 100 questions versus 95–100 for 4.5, rejects temperature and top_k, and adds a thinking block to a third of responses.

Haiku 5.5 vs 4.5: 100-prompt test shows far less repeatable answers
#Anthropic#Claude
Read next
AI

Kinetic-4B beats Claude Haiku 4.5 on tool calling

AI

Anthropic launches Claude Haiku 5.5: $0.10 per million tokens, 1M context

AI

Mistral Large 4 and Claude Haiku 5.5 headline new AI model releases

AI

Claude Haiku 5.5 Consumes 3X More Tokens Than ChatGPT 6 Luna