chiprook
← AI
AIOctober 20, 2026, 07:30

LSCBench audit: 2,700 agent traces recomputed against the leaderboard

LSCBench, a secure-code benchmark from NUS and the Qwen team, ships 2,700 agent trajectories across 450 tasks built from 150 real vulnerabilities in seven languages. Recomputing from catalog.json matched the paper's numbers except Kimi-K3's functional pass rate, 92.2% versus 91.3%.

LSCBench audit: 2,700 agent traces recomputed against the leaderboard
#Qwen#Claude#GPT-5#DeepSeek
Read next
AI

Benchmark: top LLMs know only 24% of post-cutoff 2025-2026 facts

Hardware

Microsoft: RTX Spark laptops run 284B local models that beat GPT-5 in coding

AI

OpenAI curbs ChatGPT sycophancy, retires GPT-4o

AI

CareManage-Bench: LLMs Skip Safety Checks in Clinical Care Tasks