All News

1528 technical news articles

推論系統

HeadWiseKV Configures Long-Context Caching per Attention Head, Extending Qwen3.6-27B’s Usable Length to 161K

HeadWiseKV stops retaining the same amount of history for every attention head. Instead, it uses offline calibration to assign multilevel windows to individual heads and actually reduces physical KV residency. In fixed-model tests, the paper extends the maximum successfully validated context from 114K to 161K, although the higher figures reported by the public repository rely on specific quantization settings and a single RTX 4090D.