推論系統
WIDE Dynamically Prunes Attention and FFNs for Every Token, Accelerating End-to-End LLM Decoding by 1.55×
WIDE brings dynamic pruning down to token-level attention-head groups and FFN channel groups, supporting both prefill and decode. At 50% sparsity, the study reports up to a 4.95× decoding speedup for core layers, but the end-to-end gain falls to 1.55×.