AI 安全
Canary Tools Divides Agent Tool-Misselection into Six Categories, With an Approximately 36-Fold Difference in Deception Rates Across Eight Models
A new benchmark plants targeted probes—including semantic lures, parameter traps, and capability illusions—in MCP tool lists, using erroneous calls to pinpoint agents’ tool-selection weaknesses. Across 11,520 experiments, model tier did not consistently predict safety, while the ability to recover after being deceived raised task success rates from 16% to 52%.