GitHub Repo
vLLM Community Traces H20 MoE Scheduling Inefficiency to Expert-Load Kernel Selection
Community tests suggest FlashInfer’s workload estimate may cause the H20 to select an inefficient compute kernel. After adjustment, a specific MoE operator ran about 3.21× faster. The patch has not been merged, and overall serving gains and some correctness tests remain unverified.