chiprook
← AI
AIOctober 28, 2026, 15:18

FlashMap drafter delivers up to 6.14x faster lossless LLM decoding

Polymathic AI, Princeton University and partners released FlashMap, a speculative decoding drafter that uses a continuous flow map to propose a 16-token block in one forward pass. On Qwen3-8B with a 0.5B-parameter drafter it reports up to 6.14x lossless speedup on GSM8K. Weights for Qwen3-8B and Qwen3-4B are on Hugging Face with vLLM and SGLang plugins.

FlashMap drafter delivers up to 6.14x faster lossless LLM decoding
#FlashMap#Qwen3#VLLM#SGLang
Read next
AI

SGLang's 75% sampler speedup skips Qwen3 chat requests

AI

Google Cloud ships llm-d 1.0 with cache-aware routing for TPU and GPU fleets

AI

Prime Inference splits prefill and decode across separate GPU pools

AI

OpenAI and Microsoft launch typed decision APIs for AI agents