BusinessEnterpriseResearch

OpenAI's first custom chip "Jalapeño" reportedly beats Nvidia's Blackwell and Rubin in inference benchmarks

Source: The Decoder · Matthias Bastian

Intel Summary

At the Hot Chips conference, OpenAI unveiled 'Jalapeño,' its first custom in-house inference chip. According to benchmark assessments reported by research firm SemiAnalysis, the first-generation silicon reportedly outperforms Nvidia's Blackwell and Rubin architectures in both operational throughput and energy efficiency. While first-generation custom accelerators historically lag incumbent merchant silicon, initial disclosures indicate OpenAI's specialized design targets major bottlenecks in running production large language models at scale.

Why It Matters

If independent production yields match conference benchmarks, OpenAI could significantly decrease its reliance on Nvidia hardware, improving its operating margins and compute availability. The development represents a major strategic shift in AI datacenter hardware, intensifying competition for semiconductor market share and pushing hyperscalers toward proprietary application-specific integrated circuits for model inference.

Part of an ongoing development

Independent reporting

OpenAI unveiled custom inference chip Jalapeño

At the Hot Chips conference, OpenAI unveiled 'Jalapeño,' its first custom in-house inference chip. According to benchmark assessments reported by research firm SemiAnalysis, the first-generation silicon reportedly outperforms Nvidia's Blackwell and Rubin architectures in both operational throughput and energy efficiency. Claims are as reported; this summary makes no determination about accuracy or significance.

Confidence
High confidence
Corroboration
Strongly corroborated

Organizations & Entities