GitHub Repo
vLLM Community Test: Enabling Pinned Memory in WSL2 Cuts Single-GPU Decoding Latency by About 12%
A single-machine test suggests that changing a memory setting can reduce GPU wait time during decoding. The default remains disabled; benefits and capacity limits should be validated in each deployment environment.