推論系統
Atlas Takes On vLLM With a Pure Rust/CUDA Inference Engine on a Single GB10, Delivering Up to 22.5% Higher Throughput Under High Concurrency
Atlas has published reproducible Qwen3.8-27B-NVFP4 benchmarks showing it outperforming vLLM at concurrency levels from 1 to 128 on DGX Spark. The results cover only one model and a short-input, long-output workload, so they cannot yet be generalized to typical data center deployments.