chiprook
← AI
AIOctober 17, 2026, 19:55

Strata serves 125B Qwen3.8-Flash-Next coding model on a single RTX 5090

Open-source engine Strata runs the 125B MoE model Qwen3.8-Flash-Next on a rented 32 GB RTX 5090 using DASLab's 1-bit Coder build (58.4 GB) and a 256K context. One developer gets 144 tokens/s, four get 38 each and eight get 19 each, with total throughput staying flat.

Strata serves 125B Qwen3.8-Flash-Next coding model on a single RTX 5090
#Qwen#Nvidia#ClaudeCode
Read next
AI

Strata runs a 125B-parameter model on a 12 GB consumer GPU

AI

Strata runs a 125B LLM on a gaming PC with 12 GB VRAM

AI

Qwen3.8-Flash-Next vs Qwen3.8-27B: 125B Parameters, 6B Active — What the Qwen4 Preview Changes

AI

$1,600 RTX 4090 hits 100 T/s on 125B Qwen model, beating H100