SMC Offers “Immersion Cooling” In NVIDIA’s Blackwell AI Servers, Scaling Down Power Consumption By 50%

Aug 28, 2024 at 08:30am EDT
SMC Offers "Immersion Cooling" In NVIDIA's Blackwell AI Servers, Scaling Down Power Consumption By 50% 1

SMC has unveiled a unique way of cooling down large-scale AI clusters, which involves immersion cooling for solutions such as NVIDIA's Blackwell AI servers.

SMC's Cooling Solution Allows Enterprises To Operate Data Centers At Significantly Improved Performance Per Watt, Scaling Up For NVIDIA's Blackwell AI Solutions

With the computing requirements of the industry growing at an unprecedented rate, data centers are being equipped with high-end components, and this has brought in demand for an adequate cooling solution that is effective and cheaper to implement. NVIDIA has sought one alternative by utilizing liquid-cooling dominantly on its AI servers, but it looks like Sustainable Metal Cloud (SMC) has come up with a great solution, creating "cubic structures" that allow users to place NVIDIA's servers into a synthetic oil, contributing to cooling.

Related Story Never-Released GeForce RTX 3050 Ti Desktop Card Appears Online, Featuring GA106 Die With 3328 CUDA Cores
Image Source: SMC

SMC utilizes the immersion technique in its HyperCubes, which utilize polyalphaolefin as the primary liquid to dissipate heat. While immersion cooling hasn't been a success in the past, especially while looking at ventures such as Intel's $700 million investment in this particular segment, SMC says that their HyperCubes manages to lower the power consumption figures by up to 50%, and it said to be 28% cheaper than other counterparts.

It enables high density hosting for GPUs. It enables the sort of hosting that we need to see for platforms like [Nvidia’s] Grace Blackwell.

- Tim Rosenfield, co-Founder and co-CEO of SMC

Given the design of HyperCubes, SMC says that their deployment in data centers is universal, and it can be offered to clients from all around the globe. Interestingly, SMC has already partnered up with NVIDIA as a cloud partner, but the firm hasn't seen adoption for its HyperCubes, at least on the bigger stage. SMC is currently looking to expand its business, look for new market opportunities, and raise $400 million in equity and $550 million in debt to go global.

Image Source: NVIDIA

Liquid cooling in data centers has witnessed massive traction in markets, given that next-gen AI servers are unable to sustain themselves without utilizing the benefits of the cooling mechanism. It was recently reported that the demand for liquid cooling components is at its all-time highs in the markets, to the point where server suppliers like SMCI and Foxconn are having difficulty sustaining the demand, which shows that the industry indeed sees this segment as an opportunity.

While SMC's HyperCubes certainly look optimistic, the market still has a long way to go before such cooling mechanisms are formally adopted, given their manufacturing complexities and other issues.

News Source: CNBC

About the author: Muhammad Zuhair is a hardware and technology reporter for Wccftech, specializing in the semiconductor industry and the complex interplay between technology, manufacturing, and geopolitics. His coverage focuses on the corporate strategies and technological roadmaps of industry giants like TSMC, NVIDIA, Samsung, and Intel. Zuhair's expertise lies in deconstructing complex topics such as fabrication nodes (e.g., 2nm process), the economic impact of policies like the CHIPS Act, and the strategic development of AI infrastructure from NVIDIA, AMD and Intel.

Follow Wccftech on Google to get more of our news coverage in your feeds.