代理工具
optstop Dynamically Stops Evaluations Using Bayesian Credible Intervals, Saving Up to 97.3% of Trials Across Nine Test Sets
The UK AI Security Institute has open-sourced optstop, which uses posterior uncertainty at the item and task levels to decide when to stop repeated evaluations. Across nine shadow tests, it saved an average of 81.1% of trials, though performance varied with score type, item ordering, and the exchangeability assumption.