NVIDIA Vera Rubin NVL72 Enters The Stage With A Monstrous 10x Uplift In Token Throughput Versus Blackwell, Achieves 800,000 Tokens/s Vs GB200’s 80,000 at The Same 150MW

NVIDIA's Vera Rubin is finally here, delivering unimaginable amounts of AI performance versus Blackwell as the first systems power on.

NVIDIA Vera Rubin Now Deployed & Pumps Out 800,000 Tokens/s In DeepSeek-R1, Crushing Blackwell At The Same Wattage

Well, it's here: the most powerful AI platform that the world has seen so far, Vera Rubin. Part of NVIDIA's Extreme Co-Design initiative, which aims to deliver a full-fledged stack of AI-ready hardware and software, enabling unprecedented levels of performance per watt & delivering the lowest token cost, Vera Rubin ushers in a new era of AI.

2 of 9

The NVIDIA Vera Rubin platform is a diverse set of hardware and software solutions, which are the realization of the five-layer cake framework forming a comprehensive AI ecosystem. The stack houses a total of six trays, with some of the world's most advanced chips ever made:

• NVIDIA Vera Rubin NVL72 Compute Tray (Rubin + Vera + Grace Bluefield + ConnectX-9)
• NVIDIA Vera Rubin NVL72 NVLink Switch Tray (NVLink6 Switch)
• NVIDIA Vera CPU Tray (Vera)
• NVIDIA Spectrum-6 SPX Switch Tray (Spectrum-6 Switch)
• NVIDIA Groq 3 LPX Tray (Groq 3)
• NVIDIA Vera Bluefield-4 STX Storage Tray (Vera Bluefield)

NVIDIA's rack-scale solution process has also seen continuous refinements. Just like how the Raptor engines got refined by SpaceX, resulting in the Raptor 3, which is a sleeker and neater version with more advanced capabilities, NVIDIA refined its Vera Rubin trays, eliminating the use of cables, fans, and housings, in favor of a more streamlined and liquid-cooled system that fits into the rack seamlessly with a modular approach. This shows how the engineering efforts went beyond just chips and code.

Now, NVIDIA's first Vera Rubin NVL72s are powering on, and the first resultsa re coming in. Last month, we reported how Coreweave and other major cloud providers were installing & validating NVIDIA's Vera Rubin platforms; well today, we get to see how they perform too.

In the first DeepSeek R1 tests shared by Coreweave, the company has managed to sustain a 10x higher token throughput per watt versus Grace Blackwell. An NVIDIA GB200 NVL72 Grace Blackwell system managed just 80,000 Tokens/s at 150MW. The NVIDIA VR200 NVL72 Vera Rubin platform offers 800,000 tokens/s at the same wattage, showcasing a massive increase in MoE workloads.

2 of 9

And this is only the beginning; NVIDIA's Vera is all set to disrupt the market when more systems come online and showcase their potential. Backed by a strong suite of networking solutions that will enable companies to achieve Gigascale levels of AI, NVIDIA is once again showcasing why it is the leader in AI.

Follow Wccftech on Google to get more of our news coverage in your feeds.