AI 安全
StepGuard Reviews Agent Actions Before Tool Execution, but Adds About 2.53 Seconds of Inference per Task
A team including the Shanghai AI Laboratory has released StepGuard, a 4B-parameter model that uses paired safe/dangerous trajectories and Balance-GRPO to calibrate overblocking and missed detections. It substantially reduces attack success rates in two agent environments, but its training corpus and data generator have not yet been released, and it still misses some policy violations.