代理工具
26 Testing Prompts Fail to Reliably Improve Coding Agents; More Tests Do Not Mean Higher Accuracy
A Zstandard implementation experiment compared 26 conditions, including TDD, fuzzing, property-based testing, and formal verification. None consistently outperformed the default group, which received no additional instructions. Agents often correctly identified high-risk areas, yet generated invalid inputs, proved irrelevant properties, or encoded incorrect outputs into tests.