Blog

Findings from building Brownout.

Write-ups of what the harness measured, with the code and numbers on GitHub.

In 89 of 322 correct answers, the agent never checked the evidence

Cloud-OpsBench pays the same reward for a confirmed diagnosis and for one read off a single error message. A re-grade of 1,095 saved runs, with an audit of the checker itself.

Read the post →