GitHub Repo
Transformers Community Reports Qwen4-Exp Cache Reset Gap That May Change Sparse Attention Results
A Transformers community report on October 19 says leftover position information may alter sparse attention selection when Qwen4-Exp reuses a reset cache. The report includes a reproduction and a local patch, but maintainers have not confirmed it, and evaluation with pretrained models remains incomplete.