chiprook
← AI
AIOctober 28, 2026, 23:56

HKUST: swapping agent harness breaks frozen models

Researchers at HKUST show that benchmarking agent harnesses with a frozen model measures the mismatch penalty, not the harness ceiling. On MiniWoB++, reordering observation fields cut a policy's success rate from 85.0% to 19.2%.

HKUST: swapping agent harness breaks frozen models
#HKUST#Qwen#DeepAgents#Terminal-Bench
Read next
AI

Terminal-Bench task stumps frontier AI agents on PDF redaction

AI

Anthropic releases Claude Sonnet 5.5: 70.6% on Terminal-Bench 4.0 at $2/$10

AI

SpaceXAI launches Grok 4.7: half the price of rivals, Terminal-Bench nearly doubles

AI

OpenRig: multi-agent harness for persistent terminal coordination