This is not investment advice. The author has no position in any of the stocks mentioned. Wccftech.com has a disclosure and ethics policy.
Jensen Huang had termed Elon Musk "superhuman" when he described in a recent interview how xAI was able to bring together NVIDIA's gear and operationalize it within its own data center in just 19 days. Now, Musk appears determined to subdue his competitors by continuing to pursue a shock and awe campaign that will see xAI's Supercluster double in size.
For the benefit of those who might not be aware, xAI's Colossus supercomputer cluster currently consists of 100,000 units of NVIDIA's liquid-cooled H100 GPUs. Dubbed the world's largest AI supercomputer, the Colossus is right now training xAI's Grok family of large language models (LLMs).
Now, NVIDIA has revealed in a dedicated press release that xAI is doubling the size of its Colossus supercluster:
"xAI is in the process of doubling the size of Colossus to a combined total of 200,000 NVIDIA Hopper GPUs."
Bear in mind that xAI and NVIDIA were able to bring the Colossus online in just 122 days when it would ordinarily take "many months to years" to operationalize such an intricate system. What's more, xAI was able to commence the training of its Grok LLM within 19 days of the first H100 GPU rack rolling onto the floor of the AI gigafactory.
NVIDIA goes on to note:
"Across all three tiers of the network fabric, the system has experienced zero application latency degradation or packet loss due to flow collisions. It has maintained 95% data throughput enabled by Spectrum-X congestion control."
Meanwhile, as we mentioned earlier, NVIDIA's CEO was quite effusive of Elon Musk in a recent interview (watch here), going so far as to term him a "superhuman" and "singular" in his understanding of engineering and construction:
"... Just building a massive factory, liquid-cooled, energized, permitted in the short time that was done...I mean that is, like, superhuman. Yeah, there's. And, as far as I know, there's only one person in the world who could do that. You know, I mean, Elon is singular in this understanding of engineering and construction and large systems, and marshaling resources ..."
Bear in mind that Morgan Stanley expects NVIDIA to sell around 1.5 million units of its Hopper GPUs in the fourth quarter of 2024, before ramping the sales down to 1 million units in the first quarter of 2025 as Blackwell volumes begin to soar.
About the author: Writing is my one incontrovertible passion. Over the past six years, he has authored over 2,200 distinct articles on financial and tech-related topics, spanning nearly 1 million words. And he has been a member of Wcctech mobile team since 2025. As an alumnus of the University of Toronto, Rotman Commerce Program, I bring nuance, in-depth knowledge, and a unique perspective to every topic that I cover. When I'm not writing, I'm traveling the world, exploring hidden confectionaries and restaurants as an aspiring food connoisseur.
Follow Wccftech on Google to get more of our news coverage in your feeds.
