推論系統
WitProbe Builds a Runtime Risk Ledger for Four Types of Attention Memory, With 12.4 Million Reads Staying Within Budget
A new study uses typed error contracts to unify monitoring across KV caches, latent caches, sparse selectors, and recurrent states, while using Lean to verify formalizable composition rules. The public repository can reproduce the paper’s figures and 67 theorems, but excludes architecture-specific probes and the complete serving platform.