Supermicro Solidifies Position as a Leader in Complete Rack Scale Liquid Cooling Solutions -- Currently Shipping Over 100,000 GPUs Per Quarter
Rhea-AI Summary
Supermicro (NASDAQ: SMCI) announces a complete liquid cooling solution for data centers, including Coolant Distribution Units (CDUs), cold plates, Coolant Distribution Manifolds (CDMs), cooling towers, and management software. This solution aims to reduce power costs and infrastructure expenses for data centers. Supermicro has already deployed over 100,000 GPUs with liquid cooling for major AI factories and CSPs.
Key benefits include:
- Up to 40% power reduction
- Quadrupled computing density
- Support for servers approaching 12kW of power
- Ability to cool racks generating over 100kW of heat
- Up to 40% energy savings for infrastructure
- 80% space savings
Supermicro's CEO, Charles Liang, emphasizes the company's innovation in delivering full data center plug-and-play rack scale liquid cooling solutions, reducing deployment time to weeks.
Positive
- Deployed over 100,000 GPUs with liquid cooling solution for major AI factories and CSPs
- Up to 40% power reduction in data centers
- Quadrupled computing density with ultra-dense server design
- Up to 40% energy savings for infrastructure and 80% space savings
- Reduced deployment time to weeks instead of months
Negative
- None.
Insights
Supermicro's announcement reveals significant scale achievements in the liquid cooling market, shipping over 100,000 GPUs quarterly and having delivered more than 2,000 liquid-cooled racks since June 2024. This isn't merely incremental progress but represents substantial market penetration in the high-density AI computing space.
The company has strategically positioned itself as an end-to-end liquid cooling provider rather than just a component supplier - offering everything from cold plates and distribution manifolds to cooling towers and management software. This integrated approach creates meaningful differentiation from competitors who typically provide partial solutions requiring third-party integration.
Their technical specifications are particularly impressive: cold plates handling up to 1600W for next-gen GPUs, rack-CDU solutions with 250kW cooling capacity, and configurations supporting up to 96 NVIDIA B200 GPUs per rack. These capabilities directly address the critical thermal challenges of deploying dense AI clusters.
Most compelling is their claim of 40% energy savings and 80% space savings compared to traditional cooling. With data centers increasingly constrained by power and space limitations, these efficiency gains translate to significant competitive advantage for customers deploying AI infrastructure at scale.
Supermicro's successful deployment for "some of the largest AI factories ever built" suggests they've established credibility with major AI infrastructure customers - validation that should accelerate adoption among others facing similar cooling challenges as they scale their AI operations.
Supermicro's liquid cooling announcement signals substantial revenue momentum in high-margin data center infrastructure. The 100,000+ quarterly GPU shipments with liquid cooling represents significant business volume in the premium data center segment where average selling prices and margins typically exceed those of standard server configurations.
The company's strategic shift from component supplier to complete solution provider likely enhances margins through value-added integration. Their end-to-end offering transforms Supermicro from a hardware vendor into a strategic data center partner, potentially decreasing price sensitivity while increasing customer retention.
By addressing the critical AI infrastructure bottleneck of cooling high-density compute clusters, Supermicro is capturing share in what's arguably the fastest-growing segment of data center spending. Their claimed ability to deploy complete solutions "in weeks, not months" directly addresses the urgent time-to-market pressure facing AI companies.
The 2,000+ liquid-cooled racks delivered since June 2024 demonstrates meaningful traction rather than speculative potential. With each AI rack generating 100kW+ of heat and requiring specialized cooling, these deployments represent substantial infrastructure projects with corresponding revenue impact.
Supermicro's positioning at the intersection of two high-growth trends - AI computing and sustainable data center design - creates a compelling business catalyst. Their ability to reduce both capital expenditures (through space efficiency) and operating expenses (through power reduction) strengthens their value proposition in an increasingly cost-conscious market focused on AI infrastructure optimization.
Designed for Data Center Scale Reduction in TCO and Enabling Large AI Clusters to Perform with a Lower Energy Budget, Liquid Cooling Solution Handles the Highest Wattage Servers Containing the Latest GPUs and CPUs, Resulting in Lower Costs for AI Factories – Over 2,000 Liquid Cooled Racks Delivered Since June 2024
"Supermicro continues to innovate, delivering full data center plug-and-play rack scale liquid cooling solutions," said Charles Liang, CEO and president of Supermicro. "Our complete liquid cooling solutions, including SuperCloud Composer for the entire life-cycle management of all components, are now cooling massive, state-of-the-art AI factories, reducing costs and improving performance. The combination of Supermicro deployment experience and delivering innovative technology is resulting in data center operators coming to Supermicro to meet their technical and financial goals for both the construction of greenfield sites and the modernization of existing data centers. Since Supermicro supplies all the components, the time to deployment and online are measured in weeks, not months."
Learn more about Supermicro liquid cooling solutions at www.supermicro.com/liquidcooling
Many organizations require the highest-performing GPUs and CPUs to remain competitive and need these servers to run constantly. Supermicro's ultra-dense server with dual top-bin CPUs and 8 NVIDIA HGX GPUs in just 4U with liquid cooling is the ultimate AI server needed in AI factories. When installed in a rack, this server quadruples the computing density, allowing organizations to run larger training models with a smaller data center footprint.
Supermicro recently deployed more than 100,000 GPUs with liquid cooling solution (DLC) for some of the largest AI factories ever built, as well as other CSPs. With each server approaching 12kW of power needed for AI and HPC workloads, liquid cooling is a more efficient choice to maintain the desired operating temperature for each GPU and CPU. A single AI rack now generates over 100kW of heat, which needs to be efficiently removed from the data center. Datacenter-scale liquid cooling significantly reduces the power demand for a given cluster size. Up to
The entire liquid cooling solution directly from Supermicro includes:
- Optimally designed cold plates that allow liquid to flow through microchannels with a maximum surface area that dissipates up to 1600W for next-generation GPUs.
- Specifically designed CDM (horizontal and vertical) to enable the highest GPU per rack density with up to 96 NVIDIA B200 GPUs per rack.
- State-of-the-art rack-CDU solutions with increased cooling capacity of 250kW and hot swappable pumps and power supplies to avoid any downtime
- Modular cooling towers tailored to cool DLC Racks with the latest energy efficient EC fan technology are ready to ship and deploy in days, enabling a faster Time-to-Online (TTO).
- SuperCloud Composer life cycle management software monitors the systems, SW, CDUs, racks, and cooling towers, optimizing the operational cost and managing the integrity of liquid-cooled data centers.
Direct Liquid Cooling delivers several advantages over air cooling, including:
- Up to
40% energy savings for infrastructure and80% space savings, eliminating the need for traditional CRAC/CRAH units - Support for warm water cooling up to 113°F (45°C) and allow for the reuse of heat generated by AI systems for applications such as district heating and greenhouses.
Supermicro's leadership in Direct Liquid Cooling (DLC) technology is revolutionizing data center infrastructure towards Green Computing. From winning top industry awards to setting new efficiency benchmarks with a PUE of less than 1.1, Supermicro DLC solutions are leading in innovation and sustainability. By integrating DLC with modular cooling towers and SuperCloud Composer management software, Supermicro provides an end-to-end, complete data center scale total solution empowering CSPs and enterprise customers to achieve more with less while achieving higher operational efficiency, lower environmental impacts and much quicker TTO.
About Super Micro Computer, Inc.
Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in
Supermicro, Server Building Block Solutions, and We Keep IT Green are trademarks and/or registered trademarks of Super Micro Computer, Inc.
All other brands, names, and trademarks are the property of their respective owners.
View original content to download multimedia:https://www.prnewswire.com/news-releases/supermicro-solidifies-position-as-a-leader-in-complete-rack-scale-liquid-cooling-solutions----currently-shipping-over-100-000-gpus-per-quarter-302268615.html
SOURCE Super Micro Computer, Inc.
FAQ
What is Supermicro's new liquid cooling solution for data centers?
How many GPUs has Supermicro deployed with liquid cooling since June 2024?
What are the key benefits of Supermicro's liquid cooling solution for data centers?
How does Supermicro's liquid cooling solution impact deployment time for data centers?
What is the stock symbol for Supermicro?
