ACN · Presented by Levr
ACN WIRE

ACN Wirevia MIT Technology Review

METR adds judgment-heavy tasks to its AI time horizon plot

Written with AI assistance, reviewed by the ACN desk.

A new report from AI evaluation nonprofit METR finds that some AI capabilities are continuing to improve along an exponential trajectory, but models are not as good at tasks that require judgment as they are at coding, according to MIT Technology Review. The update to METR’s time horizon plot adds longer and more open-ended tasks, including designing new AI evaluations and scoring philosophical arguments. None of the AI-designed evaluations was good enough for METR employees to consider useful for their research, the publication reported, though newer models such as Opus 5.5 reached what METR calls “borderline above the bar” performance.

Full reportMIT Technology ReviewPublished Nov 20, 2026Read the full report (opens in a new tab)

Spot an error? Email corrections@aicodingnews.si. Fixes are logged on the corrections page.

Sponsor

All stories →

More from the wire

All wire briefs →

From our sponsors

Sponsor

Sponsor

Sponsor

Sponsor