Trail of Bits releases agent plugins for fixing bugs and checking for regressions
Trail of Bits has published two plugins, patching-bugs and regression-hunt, that let engineers hand bug fixes and regression checks to coding agents and then review the results. They came out of Patch the Planet, its joint initiative with OpenAI, where a review of over 130 of its merged open-source patches confirmed 21 regressions, none of which broke a security protection. Every claim must be backed by a proof of concept run against a built, running copy of the project, and a fix only counts if the bug fails before the patch, passes after it, and fails again when the patch is reverted. In Trail of Bits' preliminary evaluations, regression-hunt produced 25% fewer false positives than a baseline Codex agent prompted to "review the PR for regressions", though its stricter evidence rules left some known regressions marked as borderline.
Why it matters: If coding agents write fixes in your codebase, borrow the habit: add a THREAT_MODEL.md and a PATCHING_GUIDELINES.md to the repo, and require the bug to be reproduced before and after every fix.
Trail of Bits ↗AI-assisted, reviewed by Sorted AI
▲ 0
0 comments