How Claude Code's team checks Claude's work
Claude blog · Addy Osmani · Nov 16
Coding tools
How the Claude Code team verifies agent work
Written with AI assistance, reviewed by the ACN desk.
“Our rule is that if a change can modify the check that judges it, the check is broken.”
Anthropic says Claude writes and reviews roughly 90% of the code produced by the team building Claude Code, The New Stack reports. In an engineering post on Monday, November 16, the company described how it verifies that work without engineers inspecting every change.
Deterministic checks go first. Anthropic told The New Stack that the build, linters and tests run first, because they “cost very little to rerun.” Model review is reserved for what a test can’t answer, such as whether a change takes the right approach.
The team also guards against agents gaming their own tests. “Our rule is that if a change can modify the check that judges it, the check is broken,” Anthropic said. Claude may not skip flaky tests or rerun them until they pass, and its reviewer reads review instructions from the base branch, not from the change.
Anthropic says merged pull requests to Claude Code more than doubled between June and September. Over the same months, the share of reverted changes fell by more than 40%. It did not say how much of that came from its verification loops, and it does not publish its reviewers’ error rates.
Some developers on Hacker News questioned the inference cost and argued that reusable browser tests could do much of the work. Anthropic would not give a cost figure. “A person is accountable for every change that ships, whoever typed it,” the company said.
“Our rule is that if a change can modify the check that judges it, the check is broken.”
Sponsor
Spot an error? Email corrections@aicodingnews.si. Fixes are logged on the corrections page.
Sponsor
Sponsor
Claude blog · Addy Osmani · Nov 16
Code moves to Verse · more assets stored as text for AI
Agent spend tied to the pull requests it produced
New default for agent sessions · Local harness removed Feb 2027
Sponsor
Sponsor