chiprook
← AI
AIOctober 22, 2026, 18:00

Benchmark: Meta's open-weight Muse Spark Open fails as a coding agent

Meta's open-weight Muse Spark Open (816B parameters, 42B active) scored 0.091 and 0.0877 out of 1 on the agentic coding Forge 2.0 test, versus 0.8523 for the best build. Its Gauntlet 7.2 attempt got no verdict after a provider timeout. Local Gemma 4, Granite 4.2, LFM2.5, Xing 4.0 and Nemotron 3.5 Bolt did no better.

Benchmark: Meta's open-weight Muse Spark Open fails as a coding agent
#Meta#MuseSpark#Qwen#Gemma
Read next
AI

Preprint Finds a Steerable 'Pain Axis' in 25 Open-Weight LLMs, Not Claude

AI

Benchmark: LLMs struggle with Spain's VeriFactu invoice hashes

AI

Anthropic Red Team: Small AI Models May Soon Self-Replicate on IoT Devices

AI

Featherless launches Simple Jev for text-free classification