DeepSeek, a Chinese AI lab, has released a version of DeepSeek R1, its reasoning model. It claims that this open version performs as well or better than OpenAI o1 in certain AI benchmarks.
Hugging Face’s AI development platform offers R1 under a MIT license. This means it can be used without restrictions commercially. According to DeepSeek R1 beats out o1 in the benchmarks AIME MATH-500 and SWE Bench Verified. AIME uses other models to assess a model’s performance. MATH-500, on the other hand, is a collection word problems. SWE-bench verified, on the other hand, focuses on programming.
As a reasoning model R1 checks its own facts, which helps to avoid some of those pitfalls that models normally fall into. The time it takes for a reasoning model to reach a solution is usually a few seconds or minutes longer than a nonreasoning one. They are more reliable in areas such as physics and science.
The R1 model contains 671 billion variables. DeepSeek is revealed in a Technical reportParameters roughly correlate to a modelโs problem-solving abilities, and models with more parameter tend to perform better than those who have fewer parameters.
671 billion parameters may seem large, but DeepSeek has also released “distilled versions” of R1 that range in size from 1,5 billion parameters to 70 trillion parameters. The smallest version can run on laptops. The full R1 requires beefier hardware but is available through DeepSeekโs API for prices 90-95% lower than OpenAIโs o1. Clem Delangue, CEO of Hugging face, said that the R1 is available through DeepSeek’s API for prices 90%-95% cheaper than OpenAI’s o1. On Monday, a post on Xrevealed that developers had created more than 500 โderivativeโ models of R1 which have been downloaded 2.5 million times — five times as many downloads as the official R1.
R1 has a downside. It’s a Chinese model and therefore subject to China’s internet regulator benchmarking to ensure that R1’s responses “embodies core socialist values”
Kyle Wiggers, a senior reporter for TechCrunch, has a special interest on artificial intelligence. His writings have appeared in VentureBeat, Digital Trends and a variety of gadget blogs, including Android Police and Android Authority, Droid-Life and XDA-Developers. He lives in Brooklyn, with his partner who is a piano teacher, and plays the piano occasionally. Sometimes — but mostly unsuccessfully.
View Bio