AI performance costs are falling faster than those of any previous technology
Source: The Decoder (opens in a new tab) · Alan Truly
Intel Summary
Research from Epoch AI and MIT indicates that the cost of achieving a fixed AI benchmark performance level is dropping rapidly. Epoch AI measures an annual price decline of approximately 13x, while MIT estimates that algorithmic progress alone drives roughly a 3x annual efficiency gain after controlling for hardware advances and market competition. However, advanced reasoning models can still lead to higher overall costs due to increased per-task compute requirements.
Why It Matters
Rapidly declining baseline compute costs make established model capabilities increasingly affordable, shifting deployment economics for builders and enterprises. Nevertheless, frontier architectures like reasoning models require substantially more compute per task, requiring teams to balance unit pricing against latency, error rates, and task quality.
Part of an ongoing development
Independent reportingEpoch AI and MIT publish research on falling AI performance costs
Research from Epoch AI and MIT indicates that the cost of achieving a fixed AI benchmark performance level is dropping rapidly. Epoch AI measures an annual price decline of approximately 13x, while MIT estimates that algorithmic progress alone drives roughly a 3x annual efficiency gain after controlling for hardware advances and market competition. Claims are as reported; this summary makes no determination about accuracy or significance.
- Confidence
- Moderate confidence
- Corroboration
- Limited corroboration
Organizations & Entities
Related Intelligence
- DevelopmentNewAlso involving Epoch AI
Epoch AI reports GLM 5.3 autonomously generated Firefox exploit chains
Epoch AI researchers reported that the open-weight AI model GLM 5.3 autonomously generated full exploit chains targeting six Firefox releases by analyzing public security fixes. Operating with zero human input in under 48 hours, the model developed functional exploits before updates reached users, costing approximately $1,000 in API fees per release without triggering safety filters from tested providers. Claims are as reported; this summary makes no determination about accuracy or significance.
- Report
Jensen Huang resigns as Nvidia CEO after espionage scandal wipes out $1.4 trillion in market value
The Decoder reports that Jensen Huang has resigned immediately as CEO, president, and board member of Nvidia. The executive departure follows an alleged espionage scandal that reportedly eliminated $1.4 trillion in market valuation, according to a reported statement.
The Decoder - Report
Nvidia CEO Jensen Huang Resigns, Creating Uncertainty for the AI Sector
Nvidia CEO and co-founder Jensen Huang has resigned, the company announced in a statement. Finance chief Colette Kress has been named interim CEO. The resignation follows a board-initiated independent investigation announced three days earlier into reports that Huang was targeted by a foreign intelligence effort, following U.S. intelligence conclusions that he had formed a close relationship with an individual suspected of spying for a foreign government.
The Information - Report
Jensen Huang Is Out; Are Inference Providers Screwed?
Nvidia announced that CEO and cofounder Jensen Huang has resigned following reports of extramarital affairs involving an employee and a woman alleged to have spied for Beijing. Chief Financial Officer Colette Kress has been named interim CEO while the board searches for a permanent successor, raising immediate questions regarding Nvidia's AI chip business and startup investment strategy.
The Information