Skip to main content
BusinessModelsResearch

AI performance costs are falling faster than those of any previous technology

Source: The Decoder (opens in a new tab) · Alan Truly

Intel Summary

Research from Epoch AI and MIT indicates that the cost of achieving a fixed AI benchmark performance level is dropping rapidly. Epoch AI measures an annual price decline of approximately 13x, while MIT estimates that algorithmic progress alone drives roughly a 3x annual efficiency gain after controlling for hardware advances and market competition. However, advanced reasoning models can still lead to higher overall costs due to increased per-task compute requirements.

Why It Matters

Rapidly declining baseline compute costs make established model capabilities increasingly affordable, shifting deployment economics for builders and enterprises. Nevertheless, frontier architectures like reasoning models require substantially more compute per task, requiring teams to balance unit pricing against latency, error rates, and task quality.

Part of an ongoing development

Source

Epoch AI and MIT publish research on falling AI performance costs

Research from Epoch AI and MIT indicates that the cost of achieving a fixed AI benchmark performance level is dropping rapidly. Epoch AI measures an annual price decline of approximately 13x, while MIT estimates that algorithmic progress alone drives roughly a 3x annual efficiency gain after controlling for hardware advances and market competition. Claims are as reported; this summary makes no determination about accuracy or significance.

Organizations & Entities