代理工具
SWE-bench Science Covers 20 Scientific Domains, but the Best Coding Agent Solves Only 47.90% of 119 Tasks
SWE-bench Science uses 98 real-world scientific software repositories to test implicit contracts involving units, coordinate systems, numerical invariants, file formats, and more. Claude Code with Opus 5 currently ranks first, but its pass@1 remains below 50%, falling to just 27.78% on engineering integration tasks.