推論系統
HeadWiseKV Configures Long-Context Caching per Attention Head, Extending Qwen3.6-27B’s Usable Length to 161K
HeadWiseKV stops retaining the same amount of history for every attention head. Instead, it uses offline calibration to assign multilevel windows to individual heads and actually reduces physical KV residency. In fixed-model tests, the paper extends the maximum successfully validated context from 114K to 161K, although the higher figures reported by the public repository rely on specific quantization settings and a single RTX 4090D.