Supermicro Delivers Direct-Liquid-Optimized NVIDIA Blackwell Solutions

Rhea-AI Summary

Supermicro announces new SuperCluster solutions featuring NVIDIA Blackwell platform for generative AI. The system incorporates NVIDIA HGX B200 8-GPU systems with enhanced liquid cooling, promising increased GPU compute density compared to current NVIDIA HGX H100 and H200-based SuperClusters. The upgraded system includes improved thermals, power delivery, and supports dual 500W Intel Xeon 6 or AMD EPYC 9005 processors. Key innovations include vertical coolant distribution manifolds, efficient cold plates, and advanced hose design. The company also introduces solutions for NVIDIA GB200 Grace Blackwell Superchips, including NVL4 and NVL72 systems.

Positive

• Enhanced GPU compute density with new liquid cooling technology
• Support for higher performance processors (500W Intel Xeon 6 and AMD EPYC 9005)
• Improved power efficiency through direct liquid cooling
• Capability to deploy large-scale AI data centers with 100,000 GPUs

Negative

• None.

Insights

Tech Expert

This announcement of Supermicro's new liquid-cooled NVIDIA Blackwell-based systems represents a significant technological leap in AI infrastructure. The SuperCluster design with improved cooling efficiency enables higher GPU density and better performance per rack, while reducing operational costs. The support for NVIDIA's GB200 Grace Blackwell Superchips, particularly the NVL72 system delivering exascale computing in a single rack, is a game-changing development for high-performance computing.

The new systems feature substantial improvements including support for dual 500W Intel Xeon 6 or AMD EPYC processors, 8800 MT/s DDR5 memory and integration with NVIDIA BlueField-3 DPUs. The 1:1 GPU-to-NIC ratio and enhanced interconnect capabilities suggest these systems are optimized for large-scale AI training operations, particularly beneficial for companies developing foundation models.

Market Research Analyst

This product launch strengthens Supermicro's competitive position in the rapidly growing AI infrastructure market. The company's ability to deliver large-scale deployments of 100,000 GPUs demonstrates significant manufacturing and deployment capabilities. The timing aligns perfectly with increasing demand for AI computing resources, particularly from hyperscalers and AI research organizations. The focus on power efficiency through direct liquid cooling addresses a critical concern in data center operations and could lead to increased market share in enterprise and cloud provider segments.

Supermicro's SuperClusters with NVIDIA HGX^TM B200 8-GPU, NVIDIA GB200, NVL4, and NVL72 Systems Deliver Unprecedented AI Compute Density

SAN JOSE, Calif and ATLANTA, Nov. 18, 2024 /PRNewswire/ -- Supercomputing Conference – Supermicro, Inc. (NASDAQ: SMCI), a Total IT Solution Provider for AI, Cloud, Storage, and 5G/Edge, is announcing the highest-performing SuperCluster, an end-to-end AI data center solution featuring the NVIDIA Blackwell platform for the era of trillion-parameter-scale generative AI. The new SuperCluster will significantly increase the number of NVIDIA HGX B200 8-GPU systems in a liquid-cooled rack, resulting in a large increase in GPU compute density compared to Supermicro's current industry-leading liquid-cooled NVIDIA HGX H100 and H200-based SuperClusters. In addition, Supermicro is enhancing the portfolio of its NVIDIA Hopper systems to address the rapid adoption of accelerated computing for HPC applications and mainstream enterprise AI.

"Supermicro has the expertise, delivery speed, and capacity to deploy the largest liquid-cooled AI data center projects in the world, containing 100,000 GPUs, which Supermicro and NVIDIA contributed to and recently deployed," said Charles Liang, president and CEO of Supermicro. "These Supermicro SuperClusters reduce power needs due to DLC efficiencies. We now have solutions that use the NVIDIA Blackwell platform. Using our Building Block approach allows us to quickly design servers with NVIDIA HGX B200 8-GPU, which can be either liquid-cooled or air-cooled. Our SuperClusters provide unprecedented density, performance, and efficiency, and pave the way toward even more dense AI computing solutions in the future. The Supermicro clusters use direct liquid cooling, resulting in higher performance, lower power consumption for the entire data center, and reduced operational expenses."

For more information, please visit: www.supermicro.com/hpc

Proven AI Performance at Scale: Supermicro NVIDIA HGX B200 Systems

The upgraded SuperCluster scalable unit is based on a rack-scale design with innovative vertical coolant distribution manifolds (CDMs), which allow for an increased amount of compute nodes in a single rack. Newly developed and efficient cold plates and an advanced hose design further improve the efficiency of the liquid cooling system. A new in-row CDU option for large deployments is also available. Traditional air-cooled data centers can also take advantage of the new NVIDIA HGX B200 8-GPU systems with a new air-cooled system chassis.

The new Supermicro NVIDIA HGX B200 8-GPU systems come with a range of upgrades compared to the previous generation. The new system includes improvements to thermals and power delivery, support for dual 500W Intel® Xeon® 6 (with DDR5 MRDIMMs at 8800 MT/s), or AMD EPYC^TM 9005 Series processors. A new air-cooled 10U form-factor Supermicro NVIDIA HGX B200 system features a redesigned chassis with expanded thermal headroom to accommodate eight 1000W TDP Blackwell GPUs. These systems are designed with a 1:1 GPU-to-NIC ratio supporting NVIDIA BlueField®-3 SuperNICs or NVIDIA ConnectX^®-7 NICs for scaling across a high-performance compute fabric. In addition, two NVIDIA BlueField-3 data processing units (DPUs) per system streamline data handling to and from attached high-performance AI storage.

Supermicro Solutions Featuring NVIDIA GB200 Grace Blackwell Superchips

Supermicro also offers solutions for all NVIDIA GB200 Grace Blackwell Superchips, including the newly announced NVIDIA GB200 NVL4 Superchip and the NVIDIA GB200 NVL72 single-rack exascale computer.

Supermicro's lineup of NVIDIA MGX designs will support the NVIDIA GB200 Grace Blackwell NVL4 Superchip. This superchip unlocks the future of converged HPC and AI, delivering revolutionary performance through four NVIDIA NVLink™-connected Blackwell GPUs unified with two NVIDIA Grace™ CPUs over NVLink-C2C. Compatible with Supermicro's liquid-cooled NVIDIA MGX modular systems, the Superchip provides up to 2x performance for scientific computing, graph neural network (GNN) training, and inference applications over the prior generation.

The NVIDIA GB200 NVL72 SuperCluster with Supermicro end-to-end liquid-cooling solution delivers an exascale supercomputer in a single rack with SuperCloud Composer (SCC) software, providing comprehensive monitoring and management capability for liquid-cooled data centers. 72 NVIDIA Blackwell GPUs and 36 NVIDIA Grace CPUs are all connected via fifth-generation NVIDIA NVLink and NVLink Switch, effectively operating as one powerful GPU with a massive pool of HBM3e memory, facilitating 130TB/s of total GPU communication bandwidth with low latency.

Accelerated Computing Systems with NVIDIA H200 NVL

Supermicro's 5U PCIe accelerated computing systems are now available with NVIDIA H200 NVL, ideal for lower-power, air-cooled enterprise rack designs that require flexible configurations, delivering acceleration for many AI and HPC workloads regardless of size. With up to four GPUs connected by NVIDIA NVLink, a 1.5x memory capacity, and a 1.2x bandwidth increase with HBM3e, NVIDIA H200 NVL can fine-tune LLMs in a few hours, delivering up to 1.7x faster LLM inference performance over the previous generation. NVIDIA H200 NVL also includes a five-year subscription to NVIDIA AI Enterprise, a cloud-native software platform for developing and deploying production AI.

Supermicro's X14 and H14 5U PCIe accelerated computing systems support up to two 4-way NVIDIA H200 NVL systems through NVLink technology with a total of 8 GPUs in a system, providing up to 900GB/s GPU-to-GPU interconnection with a combined pool of 564GB of HBM3e memory per 4-GPU NVLink domain. The new PCIe accelerated computing system can support up to 10 PCIe GPUs and now also features the latest Intel Xeon 6 or AMD EPYC 9005 Series processors to deliver flexible and versatile options for HPC and AI applications.

Supermicro at Supercomputing Conference 2024

Supermicro will showcase a complete portfolio of AI and HPC infrastructure solutions at the Supercomputing Conference, including our liquid-cooled GPU servers for AI SuperClusters.

Check out the speaking sessions at our in-booth theater where customers, experts from Supermicro, and our technology partners will be presenting on the latest breakthroughs in computing technology.

Visit Supermicro at booth #2531, Hall B at SC24.

About Super Micro Computer, Inc.

Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in San Jose, California, Supermicro is committed to delivering first-to-market innovation for Enterprise, Cloud, AI, and 5G Telco/Edge IT Infrastructure. We are a Total IT Solutions provider with server, AI, storage, IoT, switch systems, software, and support services. Supermicro's motherboard, power, and chassis design expertise further enable our development and production, enabling next-generation innovation from cloud to edge for our global customers. Our products are designed and manufactured in-house (in the US, Taiwan, and the Netherlands), leveraging global operations for scale and efficiency and optimized to improve TCO and reduce environmental impact (Green Computing). The award-winning portfolio of Server Building Block Solutions® allows customers to optimize for their exact workload and application by selecting from a broad family of systems built from our flexible and reusable building blocks that support a comprehensive set of form factors, processors, memory, GPUs, storage, networking, power, and cooling solutions (air-conditioned, free air cooling or liquid cooling).

Supermicro, Server Building Block Solutions, and We Keep IT Green are trademarks and/or registered trademarks of Super Micro Computer, Inc.

All other brands, names, and trademarks are the property of their respective owners.

 

View original content to download multimedia:https://www.prnewswire.com/news-releases/supermicro-delivers-direct-liquid-optimized-nvidia-blackwell-solutions-302307696.html

SOURCE Super Micro Computer, Inc.

FAQ

What new NVIDIA technology is Supermicro (SMCI) implementing in their SuperCluster?

Supermicro is implementing the NVIDIA Blackwell platform, specifically the HGX B200 8-GPU systems, with enhanced liquid cooling technology for increased GPU compute density.

What cooling innovations has Supermicro (SMCI) introduced in their new SuperCluster?

Supermicro has introduced vertical coolant distribution manifolds, efficient cold plates, and advanced hose design, along with a new in-row CDU option for large deployments.

What processor options does the new Supermicro (SMCI) NVIDIA HGX B200 system support?

The system supports dual 500W Intel Xeon 6 processors with DDR5 MRDIMMs at 8800 MT/s or AMD EPYC 9005 Series processors.