chiprook
← Software
SoftwareOctober 3, 2026, 12:20

llama-server sleep race hangs or crashes requests arriving just before sleep

A developer found a race in llama-server's sleep mode: a request arriving tens of milliseconds before the model unloads either hangs in the queue or crashes the server with SIGSEGV in the tokenizer. On build b11368 with Gemma 3 1B, the hang reproduced 32 of 32 times and the crash 41 of 41 times.

llama-server sleep race hangs or crashes requests arriving just before sleep
#Llama.cpp#Llama-server
Read next
Science

Two Driverless Cars Crashed at 155 mph at A2RL Race in Imola

Software

SteamOS 3.8.28 Beta Fixes AMD GPU Performance Drops After Sleep

Gadgets

Apple's $3,699 Vision Pro flops as N224 sequel hangs by a thread

Software

System76's COSMIC bans LLM-generated content in pull requests