GitHub Repo
Ollama Pre-Release Reuses Verified Models, Cutting Warm Embedding Request Latency by More Than 40%
On October 12, Ollama merged a model lookup optimization and included it in v0.40.4-rc0, reducing repeated processing for subsequent requests to the same model. Maintainer tests showed warm-request latency reductions of 41% to 56% for two embedding models, though the results still need validation in real deployments.