AI 基礎設施
MISA-T Schedules Mixed RL Rollouts by KV Residency Time, Boosting Step3.7 Throughput by 53.3%
Rather than selecting inference nodes based solely on prefix hits, MISA-T also limits how many sessions from different workloads can occupy the KV cache concurrently. The authors measured rollout throughput gains of 43.6% to 53.3% on Step3.7 and Qwen3.6-35B-A3B, but the implementation has not yet been released.