chiprook
← AI
AIOctober 19, 2026, 20:19

Benchmark of 14 AI coding agents: success ranges from 100% to 0%

The author ran 14 agentic AI coding tools on the same task set with the same gemini-3.5-flash-lite model on a GPU-less PC. Cline passed 7/7, Aider, OpenHands, Kilo Code and OpenCode 6/6, while SWE-agent, Void and Roo Code scored 0%. On local qwen3.5:4b the leaders hit 67% and most tools hovered near 25%.

Benchmark of 14 AI coding agents: success ranges from 100% to 0%
#Cline#Aider#OpenHands#Ollama
Read next
AI

Cline makes the case for an open AI coding harness

AI

UserProxyBench: 24.4% of successful agent benchmark runs break the simulated user's own contract

Security

Archestra's OpenAPPA Hits 0% Attack Success Rate on Two Security Benchmarks

AI

Blog vs Bytecode benchmark: AI catches bad code but cries wolf on clean code