Topic
Transformer Limitations
2 stories tagged Transformer Limitations, newest first.
Nov 3, 2026, 5:15 PMArtificial Intelligence
StateBench Finds GPT-6, Claude and Gemini Falter on Long State Tracking
StateBench finds recurrent and hybrid models outlast transformers on long state tracking, while frontier AI falls to 13% on the hardest tests as inputs grow.
DateSectionHeadlineSource
Oct 6
Artificial Intelligence
Why AI Fails in Long Conversations and Complex Workflows
Microsoft Research