推論系統
NVIDIA Dynamo Provides Multi-Node Deployment Recipes for Kimi K3; Million-Token Inference Requires at Least 16 GB200/GB300 GPUs
An experimental Dynamo release adds multimodal processing, reasoning, and tool-call parsing for Kimi K3, along with Kubernetes recipes for aggregated inference and disaggregated prefill/decode. The recipes quantify the deployment threshold for the 2.8T-parameter MoE model in terms of rack topology, but they have not undergone formal QA, and the GB200 configuration still has a known startup error.