- Tubelator AI
- >
- Videos
- >
- Science & Technology
- >
- NVIDIA AI 2024: Unveiling Blackwell Platform, Robots, AGI, and World Model
NVIDIA AI 2024: Unveiling Blackwell Platform, Robots, AGI, and World Model
Discover the revolutionary NVIDIA Blackwell platform with stunning AI advancements in 2024, including new robots, AGI innovations, world modeling capabilities, and more. Learn about the groundbreaking features of Blackwell and its impact on the future of AI technology.
Video Summary & Chapters
No chapters for this video generated yet.
Video Transcript
Blackwell is not a chip. Blackwell is the name of a platform.
People think we make GPUs, and we do, but GPUs don't look the way they used to.
This is hopper. Hopper changed the world. This is blackwell.
It's okay, hopper. You're very good.
Good boy. Good girl.
208 billion transistors. And so you could see,
I can see there's a small line between two dies.
This is the first time two dies have a button like this together in such a way that the two
dies think it's one chip.
There's 10 terabytes of data between it.
10 terabytes per second.
So that these two sides of the blackwell chip have no clue which side they're on.
There's no memory locality issues, no cache issues.
It's just one giant chip and it goes into two types of systems.
The first one is form-fit function compatible to hopper.
And so you slide on hopper and you push in blackwell.
That's the reason why one of the challenges of ramping is going to be so efficient.
And so this is a hopper version for the current HGX configuration.
And this is what the second hopper looks like this.
Now, this is a prototype board and Janine, could I just borrow?
Ladies and gentlemen, Janine Paul.
And so this is a fully functioning board.
And I'll just be careful here.
This right here is, I don't know, $10 billion.
And the way it's going to go to production is like this one here.
And so you're going to take this.
It has two black well chips and four black well dyes connected to a grace CPU.
What's amazing is this computer is the first of its kind where this much computation first
of all fits into this small of a place.
Second, it's memory coherent.
They feel like they're just one big happy family working on one application together.
We created a processor for the generative AI era.
And one of the most important parts of it is content token generation.
We call it this format is FP4.
The rate at which we're advancing computing is insane.
And it's still not fast enough so we built another chip.
This chip is just an incredible chip.
We call it the NVLink switch.
It's 50 billion transistors.
It's almost a size of hopper all by itself.
This switch ship has four NV links in it each 1.8 terabytes per second. What is this chip for if we were to build such a chip
We can have every single GPU talk to every other GPU at full speed at the same time
You can build a system that looks like this
Now this system is kind of insane. This is one DGX
This is what a DGX looks like now just so you know
So there are only a couple of two, three exopflops machines on the planet as we speak.
And so this is an exopflops AI system in one single rack.
I want to thank some partners that are joining us in this.
AWS is gearing up for Blackwell.
They're going to build the first GPU with secure AI.