推論系統
MLPerf Inference 6.1 Adds End-to-End RAG and Edge Agent Tests as Benchmark Expands to Full Inference Pipelines
MLCommons is no longer testing only individual models. Inference 6.1 incorporates retrieval, reranking, generation, and multi-turn agent workflows. The new release also introduces an API-based client/server harness, signaling that data center benchmarking will shift toward the more production-like MLPerf Endpoints suite.