Feb. 28, 2025 — SoftBank Corp., ZutaCore and Hon Hai Know-how Group (Foxconn) as we speak introduced that they applied ZutaCore’s two-phase direct liquid cooling know-how*1 in an AI server utilizing NVIDIA accelerated computing.
The businesses mentioned that is the primary implementation*2 of ZutaCore’s two-phase DLC*1 utilizing NVIDIA H200 GPUs. As well as, SoftBank designed and developed a rack-integrated answer that integrates every element of the server, together with cooling gear with two-phase DLC know-how, on a rack scale, and carried out an operational demonstration and efficiency analysis at its information heart in February 2025.
The demonstration outcomes indicated the answer handed NVIDIA’s temperature take a look at (NVQual), thereby confirming the compatibility, stability and reliability of this rack-integrated answer. The answer additionally achieved pPUE (partial Energy Utilization Effectiveness) of 1.03 (precise measured worth) per rack for cooling effectivity*3.
With the unfold and elevated adoption of AI, demand for AI servers and different computing assets is predicted to develop considerably, additional rising energy consumption at information facilities. On the identical time, lowering energy consumption from the angle of lowering carbon dioxide (CO2) emissions has change into a urgent challenge worldwide, requiring information facilities to change into extra environment friendly, eat much less energy, and introduce modern warmth elimination options. Since Could 2024, SoftBank has been collaborating with ZutaCore, a world chief within the growth and enterprise deployment of two-phase DLC know-how, to develop options optimized for low energy consumption at AI information facilities.
NVIDIA H200
SoftBank, ZutaCore and Foxconn will proceed their efforts to attain larger effectivity and decrease energy consumption in AI information facilities utilizing NVIDIA accelerated computing, and collaborate on the event of rack-integrated options optimized with two-phase DLC know-how for sensible use and deployment within the international market.
Options of the rack-integrated answer embody:
- Plug & Play answer
By integrating server elements corresponding to cooling gear outfitted with 2-phase DLC know-how, which conventionally needed to be optimized individually, on a rack scale, it’s attainable to offer a “Plug & Play”*4 answer that can be utilized instantly by merely connecting the gear. This makes it simple and easy to put in in AI information facilities.
- 2-phase DLC cooling system
ZutaCore’s two-phase DLC know-how, which cools the chipsets (CPUs, GPUs, reminiscence, and so forth.) which can be the warmth sources within the server by bringing them into contact with a chilly plate, circulates a particular insulating warmth switch (dielectric) fluid with a low boiling level within the chilly plate and makes use of warmth absorption throughout the part change from liquid to fuel attributable to the warmth supply. Environment friendly cooling is achieved by means of repeated evaporation and condensation. As well as, the water temperature will be maintained at the next temperature than in standard water-cooled amenities, which improves the warmth transport capability of the water used for cooling and reduces the move price of water to attain the required cooling impact. This makes it attainable to scale back the stress of the pump that delivers the water for cooling, contributing to decrease energy consumption. Moreover, the usage of insulating warmth switch fluid prevents critical injury to the server within the occasion of a spill of particular fluid.
- AI server with compatibility, stability and reliability
Foxconn developed an AI server based mostly on NVIDIA H200 GPUs, optimized with ZutaCore’s two-phase DLC know-how. This AI server was in a position to exceed goal efficiency figures in NVIDIA’s certification take a look at (NVQual), which determines the compatibility, stability, and reliability of server methods.
- Scalable rack for high-density placement of AI servers
SoftBank developed a rack designed to maximise cooling effectivity and enhance operational effectivity with its two-phase DLC know-how. Along with being designed to be versatile and scalable for high-density placement of the most recent AI servers, the rack has airflow for improved cooling effectivity, and energy provide. As well as, energy provide and wiring are concentrated within the rear of the rack for operational security and robot-friendly operation. The rack can also be appropriate with 21-inch servers and standard 19-inch servers compliant with the ORV3 normal, which is a specification set by the Open Compute Challenge (OCP), a non-profit group that promotes open-source {hardware} specs and designs. The specs are designed to be deployed in accordance with international requirements.
“As we work to develop one of many largest AI infrastructures in Japan and homegrown large-scale language fashions (LLMs), enhancing the vitality effectivity of knowledge facilities is crucial to speed up AI growth and notice a sustainable society” mentioned Hironobu Tamba, Vice President and Head of the Knowledge Platform Technique Division at SoftBank Corp. “The operational demonstration of this rack-integrated answer with optimized two-phase DLC know-how has confirmed secure operation and improved vitality effectivity of high-density GPU servers with liquid cooling. Sooner or later, we are going to work on the sensible software of this answer to be used in AI information facilities and AI factories to construct a sustainable AI infrastructure and maximize computational effectivity.”
“ZutaCore is honored to companion with international trade leaders SoftBank and Foxconn to introduce the world’s first 2-phase DLC rack integration answer utilizing NVIDIA accelerated computing for AI servers,” mentioned Erez Freibach, Co-founder and CEO at ZutaCore. “This groundbreaking collaboration highlights the transformative potential of our waterless DLC cooling know-how to ship unmatched effectivity whereas addressing the rising want for sustainable vitality options. Collectively, we aren’t simply assembly as we speak’s challenges however setting a brand new normal for energy-efficient innovation in next-generation AI information facilities and factories, driving progress whereas safeguarding the planet.”
*1 A know-how that cools the chilly plate on the semiconductor chip (processor) contained in the server by circulating an insulating refrigerant with out water in a two-phase system (liquid and fuel).
*2 As of January 2025, in accordance with ZutaCore analysis.
*3 In line with ZutaCore analysis. PUE is a measure of cooling effectivity in information facilities. pPUE is a measure of the effectivity of a specific space or facility, corresponding to a server room or module. The nearer the quantity is to 1.0, the extra vitality environment friendly it’s.
*4 This method that mechanically acknowledges peripherals and makes the mandatory settings when peripherals are linked to the principle unit of a tool.
