Liquid Cooling Unit Addresses AI Workloads
The Vertiv CoolChip CDU 100, a compact in-rack liquid cooling unit, is gaining attention for managing high-density AI workloads. Social media discussions highlight its ability to deliver up to 100 kW of cooling capacity, addressing the thermal challenges of powerful AI accelerators in smaller footprints.
- Direct-to-chip liquid cooling, the technology used by the CDU 100, places cold plates directly on heat-generating components like GPUs. This method can remove 70-75% of the heat produced by the equipment in a server rack, leaving the remainder to be handled by traditional air-cooling systems. - The push for advanced liquid cooling is driven by the soaring power consumption of new AI accelerators. For instance, NVIDIA's upcoming GB200 system is expected to consume 2,700W, a significant increase from the H100's 700W, while Intel's future Falcon Shores processor is projected to draw 1,500W. - As a result of this increased power draw, server rack power densities are now routinely exceeding 30 kW and pushing towards 100 kW, surpassing the effective limits of traditional air cooling. - The Vertiv CoolChip CDU 100 is a liquid-to-liquid heat exchanger housed in a 4U rack-mounted form factor. It provides precise temperature control, keeping the cooling fluid stable within ±1°C. - This unit is part of a broader portfolio of liquid cooling solutions from Vertiv, which includes systems with capacities as high as 1,350 kW. The company also offers prefabricated modular data centers, like the MegaMod HDX, that support densities over 100 kW per rack with a total power capacity of up to 10 MW. - A key design feature of modern liquid cooling systems is the ability to retrofit them into existing data centers. Some systems can be deployed without requiring a facility-wide chilled water loop, a common barrier to adoption for many operators. - The global electricity demand from data centers is projected to double by 2030, largely driven by the expansion of AI workloads. This makes the energy efficiency of cooling systems a critical factor in managing operational costs and environmental impact. - The CDU 100 is designed for incremental adoption, allowing engineering teams to implement or pilot liquid cooling on a rack-by-rack basis without needing a massive initial investment in infrastructure.
