Friday, November 20, 2026
Tech Beat
Nov 20, 2026, 6:15 PMStartups

The most misunderstood graph in AI just got a major update

EXECUTIVE SUMMARY A new report from the AI evaluation nonprofit METR finds that some AI capabilities are continuing to improve along an exponential…

Summary

EXECUTIVE SUMMARY A new report from the AI evaluation nonprofit METR finds that some AI capabilities are continuing to improve along an exponential trajectory—but it also indicates that models aren’t quite as good at tasks that require judgment as they are at coding. The report is an update to the organization’s time horizon plot, which was widely shared— and widely misinterpreted, owing to the complexity of the measures it used. METR evaluated models by having them attempt a large suite of tasks, each of which had also been completed by humans. Each task’s difficulty was scored by how long it took the human testers to finish it—and then models were rated according to the length of the tasks that they could complete.

Positives

  • EXECUTIVE SUMMARY A new report from the AI evaluation nonprofit METR finds that some AI capabilities are continuing to improve along an exponential trajectory—but it also indicates that models aren’t quite as good at tasks that require judgment as they are at coding.
  • That plot showed that AI systems were rapidly improving—every four months, the length of the tasks that frontier models could successfully complete doubled.
  • The updated plot adds more tasks—some that are estimated to take humans far longer than those in the original suite, and others that are more open-ended.
  • One of the biggest questions in AI right now is the extent to which progress on “verifiable” tasks—where it’s possible to check automatically whether an AI system has succeeded or failed—carry over into tasks on which success or failure is harder to measure.

Risks & concerns

  • EXECUTIVE SUMMARY A new report from the AI evaluation nonprofit METR finds that some AI capabilities are continuing to improve along an exponential trajectory—but it also indicates that models aren’t quite as good at tasks that require judgment as they are at coding.
  • One of the biggest questions in AI right now is the extent to which progress on “verifiable” tasks—where it’s possible to check automatically whether an AI system has succeeded or failed—carry over into tasks on which success or failure is harder to measure.
Primary sourceArtificial intelligence – MIT Technology Reviewhttps://www.technologyreview.com/2026/11/20/1149399/the-most-misunderstood-graph-in-ai-just-got-a-major-update/
Read full article
Editorial note: Tech Beat summarizes and analyzes third-party reporting. The source link is the authoritative article. This page does not reproduce the full source text.

More From The Wire

StartupsNov 20

Bending Spoons buys Mailchimp for $3.68B

StartupsNov 20

Anthropic’s 7 founders cashed out nearly $2B in record-breaking IPO

StartupsNov 19

Anthropic’s IPO could deliver $156 billion to charity