1. Tubelator AI
  2. >
  3. Videos
  4. >
  5. Education
  6. >
  7. Exploring New Chinese GPUs and DeepSeek R1: What it Means for NVIDIA

Exploring New Chinese GPUs and DeepSeek R1: What it Means for NVIDIA

Available In Following Subtitles
English
Variant 1
Posted on:
Discover the impact of the Chinese DeepSeek R1 model on the GPU market and the emergence of new Chinese GPUs. Learn why this presents a significant opportunity and what it means for NVIDIA as competition evolves.
tubelator logo

Instantly generate YouTube summary, transcript and subtitles!

chrome-icon Install Tubelator On Chrome

Video Summary & Chapters

No chapters for this video generated yet.

Video Transcript

0:00
the release of the Chinese DeepSeek R1 model  caused a really big splash on the stock market  
0:06
and this week the discussions around it continued  meanwhile new models and new Chinese GPUs made  
0:14
headlines so in this video I want to focus on  the impact of all of this on the GPU market  
0:21
and why it's in fact a huge opportunity which may  not happen again I will also break down some new  
0:29
very interesting Chinese GPUs that are on the way  right now so if you want to know where the market  
0:36
is shifting watch till end in December 2024 the  Chinese AI company DeepSeek released their V3  
0:45
based model which was extremely efficient but no  one paid any attention to it at the end of January  
0:52
they released the Reasoning Model R1 which they  claimed achieved comparable performance to Open's  
0:57
AI 01 and this release just exploded and the first  reason was due to its Hardware training costs what  
1:07
many people concluded is that the best NVIDIA GPUs  may not be needed to make big strides in AI and I  
1:16
think it's very important to discuss what's going  on here first of all High-Flyer is a hedge fund  
1:22
that also founded DeepSeek and High-Flyer used  to be one of the biggest NVIDIA customers in  
1:29
the Chinese market purchasing tens of thousands of  A100 and H100 GPUs so no way they are a threat to  
1:39
NVIDIA but still this $6 million figure training  cost made all the headlines because it's very low  
1:46
compared to Open's AI estimated 100 million for  a similar model and then we all witnessed how the  
1:53
media as always messed up the whole story if we  now look at the bigger picture DeepSeek reportedly  
2:02
has access to roughly 50,000 GPUs among them are  older A100 GPUs but mostly different adaptations  
2:12
of H100 Hopper GPU for the Chinese market among  them are H800 and H20 versions what's interesting  
2:22
if we look at the specs H800 GPU almost matches  the peak performance of H100 GPU you in the most  
2:31
performance metrics biggest difference is in  the memory and NVLink bandwidth in practice  
2:38
this means slower data movement between memory  and the processing cores as well as in between  
2:44
GPUs as discussed before by now H800 is also  not allowed and only H20 is allowed and this  
2:53
is quite funny because H20 is in fact preferable  because it has more memory and in 2024 NVIDIA sold  
3:02
roughly 1 million H20 GPUs to China and the next  NVIDIA GPU to come to the Chinese market was B20  
3:12
which is a derivative of B200 Blackwell GPU but  the exact specs are yet unknown when I saw NVIDIA  
3:20
stock dropping I was like shopping time because  long term I think this DeepSeek drama will only  
3:28
increase the evaluation of NVIDIA straighten  expert controls and it will all come to the  
3:34
fact that Chinese companies will have to move to  the domestic options which are getting better and  
3:40
better and now we are at the most interesting  part let's discuss which options do they have  
3:46
and what is yet to come in fact DeepSeek  are one reduced requirements on the compute  
3:53
side open the door to many domestic hardware  and yes before the restrictions took effect  
4:00
NVIDIA share on the Chinese market was roughly  90% but over the last few years Chinese companies  
4:06
have been working on getting a share of this  pie including companies like Huawei Alibaba  
4:13
Moore Threads Biren Tencent Enflame Hygon and  many more among them the most interesting story  
4:21
is Huawei their Ascend 910b GPU is the most  powerful GPU which is designed and manufactured  
4:30
in China and it's in a very high demand now  if you look at the official specs its peak  
4:35
performance at 8bit precision is 512 TeraFLOPs so  theoretically it has higher FLOPs than NVIDIA H20  
4:43
GPU and now Huawei is ramping up its R1 model  on Huawei Cloud which is partially built out of  
4:52
Ascend 910b GPUs Huawei is challenging Nvidia  with a new chip for Artificial Intelligence  
4:58
according to the Wall Street Journal Huawei has  reportedly told potential clients that the chip  
5:03
is comparable to NVIDIA's H100 at the same time  the new Ascend 910c GPU is in development they've  
5:12
already manufactured the first samples and plan to  ramp up mass production already this year if you  
5:19
previously watched this video you know that SMIC  or SMIC Chinese semiconductor manufacturing giant  
5:26
is currently struggling with a yield in N+3 process which is roughly at 20% now and this  
5:34
number is far off from what is typically  required to bring a product such as this  
5:39
GPU to mass production if you want to know more  details on this subscribe to the channel now and  
5:46
watch this video right after this one now talking  of 910c GPU is manufactured in N+3 process node  
5:54
by SMIC which is equivalent to 6nm process by  TSMC or N6 and it's rumored to be a doubled  
6:03
die design means doubling the same silicon of 910b  GPU and this is very interesting for many reasons  
6:12
first of all because it's following the general  industry trend of building larger GPUs because  
shape-icon

Download extension to view full transcript.

chrome-icon Install Tubelator On Chrome