最新模型
SGLang 0.5.16 Dynamically Adjusts Speculative Verification Length Based on Confidence and Overhauls Caching for Hybrid Architectures
The new SGLang release introduces DSpark, which changes the verification window for each round based on the draft model’s confidence, and makes UnifiedRadixTree the default cache for sliding-window, Mamba, and sparse-attention models. The release also removes several quantization backends and changes the rollout transport format, so compatibility must be checked before upgrading existing services.