chiprook
← Software
SoftwareOctober 22, 2026, 12:49

Ollama keep_alive on a loaded model cancels eviction and stalls queued requests

With OLLAMA_MAX_LOADED_MODELS=1, a request carrying keep_alive for the loaded model cancels its pending unload, so a request for another model waits out the entire keep_alive. On Ollama 0.40.8 the second model answered in 9 seconds without keep_alive but did not answer within 150 seconds with keep_alive 30m; sending keep_alive: 0 released the queue in 1.5 seconds. A fix is proposed in PR #19190 and is not yet released.

Ollama keep_alive on a loaded model cancels eviction and stalls queued requests
#Ollama
Read next
Software

Microsoft confirms Copilot+ PCs are alive, getting Hybrid Intelligence

Software

Ubuntu 26.04 sudo-rs leaves sudo su processes alive after SSH drop

Software

Telethon is alive on Codeberg. Its GitHub repo has been archived since February

Software

CircleCI outage: transaction log filled its disk and stalled pipelines for 5 hours