代理工具
SWE-Bench ProMax Expands Refactoring Tests to Seven Languages, but the Best Agent Still Solves Only 41.2%
SWE-Bench ProMax selected 170 multi-file refactoring tasks from 29,782 candidate commits, with experts rewriting the requirements and reviewing the tests. GPT‑5.2 paired with OpenHands achieved the highest solve rate, but its trajectories show that agents often fail to update related call sites, configuration, and test files.