代理工具
CAPA Tests Cross-Session Memory in Coding Assistants: Same-User History Raises First-Try Success by 15.6 Points on Average
CAPA embeds implementation preferences that users repeatedly omit into 600 executable coding tasks, testing whether assistants can infer new requirements from past conversations. Across 12 models, adding same-user history increased final success rates by only 6.8 points on average, but raised first-try success by 15.6 points—suggesting that memory mainly reduces clarification rounds rather than eliminating failures.