Benchmarks disagree on GPT-6 Astra, but its human-beating efficiency on ARC-AGI-3 pulls Chollet’s AGI forecast forward
Source: The Decoder (opens in a new tab) · Maximilian Schreiner
Intel Summary
OpenAI's GPT-6 Astra has generated conflicting benchmark results across evaluation platforms. Epoch AI ranked the model in the lead with 169 points, whereas Artificial Analysis evaluated it on par with its predecessor and behind Claude Fable 5.1. However, on ARC-AGI-3, Astra operated more efficiently than the average human, leading ARC Prize lead François Chollet to advance his AGI timeline after observing progress moving twice as fast as projected.
Why It Matters
Conflicting evaluation metrics highlight growing divergence in how independent tracking organizations assess frontier AI performance across standard workloads versus abstract reasoning. Demonstrating superior efficiency to humans on ARC-AGI-3 accelerates timelines for complex problem-solving capabilities, even as conventional benchmark improvements appear uneven across competing frontier models.
Part of an ongoing development
Independent reportingOpenAI GPT-6 Astra evaluated across frontier benchmarks
OpenAI's GPT-6 Astra has generated conflicting benchmark results across evaluation platforms. Epoch AI ranked the model in the lead with 169 points, whereas Artificial Analysis evaluated it on par with its predecessor and behind Claude Fable 5.1. Claims are as reported; this summary makes no determination about accuracy or significance.
- Confidence
- Moderate confidence
- Corroboration
- Limited corroboration
Organizations & Entities
Related Intelligence
- DevelopmentStableAlso involving OpenAI
Google rolls out Gemini 4 Argon
Google has rolled out Gemini 4 Argon, described as Alphabet's most advanced AI model to date. Claims are as reported; this summary makes no determination about accuracy or significance.
6 independent sources - DevelopmentStableAlso involving OpenAI
OpenAI launches Dots agentic assistant
During its DevDay keynote, OpenAI announced Dots, an agentic assistant powered by its GPT-6 Astra model. Designed to compete with Meta's Muse AI, Dots operates as an always-on background system capable of executing tasks across connected applications while continuously learning user preferences over time. Claims are as reported; this summary makes no determination about accuracy or significance.
7 independent sources - DevelopmentStableAlso involving OpenAI
Microsoft updates Copilot to unify business AI capabilities
CNBC reports that Microsoft is updating its Copilot application to combine multiple business AI capabilities into a unified app. The consolidation comes as Microsoft refines its commercial AI strategy to compete directly against rivals including Anthropic. Claims are as reported; this summary makes no determination about accuracy or significance.
5 independent sources - ReportAlso involving Artificial Analysis
MiniMax M3.1 Flash shows China's AI price race has no floor in sight
MiniMax has released M3.1 Flash, scoring 42 on the Artificial Analysis Intelligence Index—a 13-point increase over its predecessor—at half the operational cost. The model also scored 73.7 percent on the DeepSWE v1.1 coding benchmark at under $0.30 per task, matching Deepseek V4.1 Flash 1017 across both benchmark performance and pricing metrics.
The Decoder