chiprook
← Software
SoftwareOctober 21, 2026, 05:41

llama-server marks truncated replies and tool calls as completed

In llama.cpp build b11753, llama-server's /v1/responses endpoint returns status "completed" and incomplete_details: null even when a reply is cut off by max_output_tokens. A truncated tool call arrives with invalid JSON arguments but is also marked completed, while /v1/chat/completions correctly reports finish_reason: "length". No upstream fix exists yet.

llama-server marks truncated replies and tool calls as completed
#Llama.cpp
Read next
Software

llama-server prompt cache reuses KV computed under a different LoRA scale

Software

llama-server returns placeholder logprobs when speculative decoding is on

Software

llama-server sleep race hangs or crashes requests arriving just before sleep

Software

Superfluid: open-source local LLM server for multi-agent inference