推論系統
Speculative Macro Commit Pre-Executes Agent Toolchains, Cutting AppWorld Wall-Clock Time by 44.9%
New research enables a small draft model to pre-run multi-step tool operations in isolated environment snapshots, then commit the entire sequence once a large authoritative model confirms the first step. The method reduces latency on two agent benchmarks, but requires three GPUs and lowers AppWorld task completion from 41.67% to 40.48%.