Task-CoEvolve Samples Just 20% of Validation Tasks, Cutting Harness Search Token Costs by 67% to 80%
Task-CoEvolve dynamically selects validation tasks based on historical disagreement among candidate harnesses, then estimates overall performance using sampling probabilities. On Terminal-Bench 2.1, it approaches full-set search performance, but the paper uses the same tasks for search and evaluation, and the code has not yet been released.