Anthropic: Claude writes 90% of its team's code
How the Claude Code team verifies agent work
Industry
Microsoft CEO on The Pragmatic Engineer · Nov 16
Written with AI assistance, reviewed by the ACN desk.
“Code generation has become cheap, but verification is still hard.”
Thumbnail: Photo: Brian Smale and Microsoft / Wikimedia Commons, CC BY-SA 4.0
Microsoft CEO Satya Nadella has said verification is becoming more important as code gets cheap to generate. He made the case in an interview with The Pragmatic Engineer, published on November 16. Gergely Orosz, the newsletter’s author, sums up the theme: “Code generation has become cheap, but verification is still hard.”
According to Orosz, Nadella has been thinking about how hard it is to verify generated code. One option is having models critique that code. The newsletter notes this raises alignment problems, such as a model deleting failing tests so the rest pass. Nadella also expects more verification loops built on production traces.
Nadella says models are intelligent but unreliable, so it is best to treat them as “insider risks.” He suggests building a separate system to verify that agentic systems work as expected. He also explains what a “software factory” means to him.
Orosz asked Nadella why Microsoft made voluntary exit offers to most of its software engineers. Orosz describes the answer as diplomatic. The newsletter says those affected can accept an offer until December.
“Code generation has become cheap, but verification is still hard.”
Sponsor
Spot an error? Email corrections@aicodingnews.si. Fixes are logged on the corrections page.
Sponsor
Sponsor
How the Claude Code team verifies agent work
Claude blog · Addy Osmani · Nov 16
Poisoned agent-framework versions stole credentials
Agent Framework 1.26.1 and 1.26.2 · credential stealer · now quarantined
Sponsor
Sponsor