AI 安全
Only 10 of 30 LLM Vulnerability Validation Artifacts Passed Patched-Version Falsification After Reruns
A preregistered reproducibility audit found that a vulnerability PoC that executes and triggers a crash does not necessarily reproduce the specified CVE. In 20 of the 30 evaluable cases, the same signal still appeared in the patched version, showing that agentic security benchmarks need stricter oracles than strings and exit codes.