Findings from building Brownout.
Write-ups of what the harness measured, with the code and numbers on GitHub.
In 89 of 322 correct answers, the agent never checked the evidence
Cloud-OpsBench pays the same reward for a confirmed diagnosis and for one read off a single error message. A re-grade of 1,095 saved runs, with an audit of the checker itself.
Read the post →