推論系統
Axon Generates Five LLM Backends from a Strongly Typed DSL, Cutting MLX Median Latency to 48.3% of Transformers
Axon expresses model architectures as functional specifications with symbolic tensor shapes, then compiles them to PyTorch, Triton, JAX, MLX, and native vLLM. Across 467 inference tests, it accelerated most generative models, though some BF16, encoder, and sequence-to-sequence models still showed accuracy or performance regressions.