CAISI Evaluation of DeepSeek AI Models Finds Shortcomings and Risks
Source: NIST AI (opens in a new tab) · Sarah Henderson
Intel Summary
The U.S. National Institute of Standards and Technology's Center for AI Standards and Innovation (CAISI) has released an official evaluation of multiple artificial intelligence models from China-based DeepSeek. The assessment highlights specific technical shortcomings, safety risks, and performance limitations. This review provides an authoritative U.S. government technical analysis regarding the operational reliability and risk profiles of DeepSeek's widely used model portfolio.
Why It Matters
Widespread enterprise interest in DeepSeek models has surged due to cost efficiencies and competitive benchmark performance. NIST's risk findings establish an official baseline for enterprise risk managers, compliance teams, and security officers assessing foreign-developed open and proprietary models. Organizations deploying these models must review their risk posture against CAISI findings to ensure adequate safeguards and compliance with emerging standards.
Part of an ongoing development
SourceCAISI releases evaluation of DeepSeek AI models
National Institute of Standards and Technology's Center for AI Standards and Innovation (CAISI) has released an official evaluation of multiple artificial intelligence models from China-based DeepSeek. This review provides an authoritative U.S. government technical analysis regarding the operational reliability and risk profiles of DeepSeek's widely used model portfolio. Claims are as reported; this summary makes no determination about accuracy or significance.
- Confidence
- Low confidence
- Corroboration
- Unconfirmed
What we know
- Product:DeepSeek models
- Availability:General availability
- Available in:United States
- Organization:Center for AI Standards and Innovation (CAISI)
Organizations & Entities
Related Intelligence
- ReportAlso involving China
DeepSeek reportedly raises $15B days after US restrictions
TechCrunch reports that AI company DeepSeek has raised $15 billion in one of China's largest funding rounds. The reported investment comes shortly after the US government directed federal agencies to remove the company's technology over national security concerns.
TechCrunch - ReportAlso involving China
DeepSeek Raises Nearly $16 billion in Second Funding Round
The Information reports that Chinese AI company DeepSeek has closed a second funding round of 106 billion yuan (approximately $15.9 billion), citing three people familiar with the transaction. The capital raised reportedly more than doubles DeepSeek's initial target of 50 billion yuan.
The Information - ReportAlso involving China
U.S. bans DeepSeek from government agency systems amid AI rift with China
CNBC reports that the U.S. Department of Homeland Security has banned DeepSeek-related technology across federal civilian agency IT systems amid escalating artificial intelligence tensions between the United States and China.
CNBC Tech - ReportAlso involving China
How DeepSeek Is Shaping Huawei’s AI Chips in a Growing Challenge to Nvidia
DeepSeek is collaborating closely with Huawei Technologies to guide the architectural design of future AI semiconductors, according to reporting from The Information. Huawei engineers are reportedly incorporating DeepSeek's technical input on calculation and inter-processor data transfer into AI chips planned for release next year and beyond, aiming to support frontier AI development independently of Nvidia hardware.
The Information