Supermicro's Rack Scale Liquid-Cooled Solutions with the Industry's Latest Accelerators Target AI and HPC Convergence

Rhea-AI Summary

Supermicro, Inc. introduces complete data center liquid-cooled solutions to address the demands of expanding AI and HPC capacities while reducing power requirements. By delivering high-performance servers equipped with GPUs and CPUs, Supermicro aims to build AI factories quickly and efficiently, reducing data center power consumption by up to 40%. The company continues to innovate in bringing the latest technology, including total liquid cooling solutions, to AI and HPC customers.

Positive

• Supermicro's liquid-cooled solutions enable the construction of AI factories at unprecedented speeds while reducing data center power consumption by up to 40%.

• The company's high-performance servers allow for petaflops of AI computing power in a dense form factor, supporting the latest GPUs and accelerators in the market.

• Supermicro's rack-scale liquid-cooled solutions help reduce the total cost of ownership (TCO) in data centers and facilitate denser AI and HPC computing.

Negative

• Potential risks associated with liquid-cooled solutions, such as maintenance complexity and higher upfront costs, could impact adoption rates.

• Despite the efficiency gains, there may be challenges in retrofitting existing data centers with liquid cooling infrastructure, affecting the scalability of the solution.

Complete Data Center Liquid-Cooled Solutions Enable AI Factories to be Constructed at Unprecedented Speeds Using the Latest Dense GPU Servers Equipped with the Highest-Performing CPUs and GPUs

SAN JOSE, Calif. and HAMBURG, Germany, May 13, 2024 /PRNewswire/ -- International Supercomputing Conference (ISC) -- Supermicro, Inc. (NASDAQ: SMCI), a Total IT Solution Provider for AI, Cloud, Storage, and 5G/Edge, is addressing the most demanding requirements from customers who want to expand their AI and HPC capacities while reducing data center power requirements. Supermicro delivers complete liquid-cooled solutions, including cold plates, CDUs, CDMs, and entire cooling towers. A significant reduction in the PUE of a data center is quickly realized with data center liquid-cooled servers and infrastructure, and this can reduce overall power consumption in the data center by up to 40%.

"Supermicro continues to work with our AI and HPC customers to bring the latest technology, including total liquid cooling solutions, into their data centers," said Charles Liang, president and CEO of Supermicro. "Our complete liquid cooling solutions can handle up to 100 kW per rack, which reduces the TCO in data centers and allows for denser AI and HPC computing. Our building block architecture allows us to bring the latest GPUs and accelerators to market, and with our trusted suppliers, we continue to bring new rack-scale solutions to the market that ship to customers with a reduced time to delivery."

Supermicro application-optimized high-performance servers are designed to accommodate the most performant CPUs and GPUs for simulation, data analytics, and machine learning. The Supermicro 4U 8-GPU liquid-cooled server is in a class by itself, delivering petaflops of AI computing power in a dense form factor with the NVIDIA H100/H200 HGX GPUs. Supermicro will soon ship liquid-cooled Supermicro X14 SuperBlade in 8U and 6U configurations, the rackmount X14 Hyper, and the Supermicro X14 BigTwin. Several HPC-optimized server platforms will support the Intel Xeon 6900 with P-cores in a compact, multi-node form factor.

Learn more about how Supermicro Rack Scale Integration Services enable you to reduce costs and optimize your data center: https://www.supermicro.com/en/solutions/rack-integration 

In addition, Supermicro continues its leadership shipping the broadest portfolio of liquid cooled MGX Products in the industry.. Supermicro also confirms its support for delivering the latest accelerators from Intel with its new Intel® Gaudi® 3 accelerator and AMD's MI300X accelerators. With up to 120 nodes per rack with the Supermicro SuperBlade®, large-scale HPC applications can be executed in just a few racks. Supermicro will display a wide range of servers at the International Supercomputing Conference, including Supermicro X14 systems incorporating the Intel® Xeon® 6 processors.

Supermicro will also showcase and demonstrate a wide range of solutions designed specifically for HPC and AI environments at ISC 2024. The new 4U 8-GPU liquid-cooled servers with NVIDIA HGX H100 and H200 GPUs highlight the Supermicro lineup. These servers and others will support the NVIDIA B200 HGX GPUs when available. New systems with high-end GPUs accelerate AI training and HPC simulation by bringing more data closer to the GPU than previous generations by using high-speed HBM3 memory. With the incredible density of the 4U liquid-cooled servers, a single rack delivers (8 servers x 8 GPUs x 1979 Tflops FP16 (with sparsity) = 126+ petaflops.  The Supermicro SYS-421GE-TNHR2-LCC can use dual 4th or 5th Gen Intel Xeon processors, and the AS -4125GS-TNHR2-LCC is available with dual 4th Gen AMD EPYC™ CPUs.

The new AS -8125GS-TNMR2 server gives users access to 8 AMD Instinct™ MI300X accelerators. This system also includes dual AMD EPYC™ 9004 Series Processors with up to 128 cores/256 threads and up to 6TB memory. Each AMD Instinct MI300X accelerator contains 192GB of HBM3 memory per GPU, all connected with an AMD Universal Base Board (UBB 2.0). Moreover, the new AS -2145GH-TNMR-LCC and AS -4145GH-TNMR APU servers are targeted to accelerate HPC workloads with the MI300A APU. Each APU combines high-performance AMD CPU, GPU, and HBM3 memory for 912 AMD CDNA™ 3 GPU compute units, 96 "Zen 4" cores, and 512GB of unified HBM3 memory in a single system.

At ISC 2024, a Supermicro 8U server with the Intel Gaudi 3 AI Accelerator will be shown. This new system is designed for AI training & Inferencing and can be directly networked with a traditional Ethernet fabric. Twenty-four 200 gigabit (Gb) Ethernet ports are integrated into every Intel Gaudi 3 accelerator, providing flexible and open-standard networking. In addition, 128GB of HBM2e high-speed memory is included. The Intel Gaudi 3 accelerator is designed to scale up and scale out efficiently from a single node to thousands to meet the expansive requirements of GenAI models. Supermicro's Petascale storage systems, which are critical for large-scale HPC and AI workloads, will also be displayed.

The Supermicro SuperCloud Composer will be demonstrated for the data center management software, showing how, from a single console, an entire data center can be monitored and managed, including the status of all liquid-cooled servers.

Learn more about Supermicro's presence at ISC 2024 at: https://app.swapcard.com/event/isc-high-performance-2024/exhibitor/RXhoaWJpdG9yXzE1NjYyODE=?

About Super Micro Computer, Inc.

Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in San Jose, California, Supermicro is committed to delivering first to market innovation for Enterprise, Cloud, AI, and 5G Telco/Edge IT Infrastructure. We are a Total IT Solutions manufacturer with server, AI, storage, IoT, switch systems, software, and support services. Supermicro's motherboard, power, and chassis design expertise further enable our development and production, enabling next generation innovation from cloud to edge for our global customers. Our products are designed and manufactured in-house (in the US, Taiwan, and the Netherlands), leveraging global operations for scale and efficiency and optimized to improve TCO and reduce environmental impact (Green Computing). The award-winning portfolio of Server Building Block Solutions® allows customers to optimize for their exact workload and application by selecting from a broad family of systems built from our flexible and reusable building blocks that support a comprehensive set of form factors, processors, memory, GPUs, storage, networking, power, and cooling solutions (air-conditioned, free air cooling or liquid cooling).

Supermicro, Server Building Block Solutions, and We Keep IT Green are trademarks and/or registered trademarks of Super Micro Computer, Inc.

All other brands, names, and trademarks are the property of their respective owners.

SMCI-F

View original content to download multimedia:https://www.prnewswire.com/news-releases/supermicros-rack-scale-liquid-cooled-solutions-with-the-industrys-latest-accelerators-target-ai-and-hpc-convergence-302143086.html

SOURCE Super Micro Computer, Inc.

FAQ

What is Supermicro introducing with the latest liquid-cooled solutions?

Supermicro is introducing complete liquid-cooled solutions for data centers, including cold plates, CDUs, CDMs, and entire cooling towers.

How much power consumption reduction can be achieved with Supermicro's liquid-cooled servers?

Supermicro's liquid-cooled servers can reduce overall power consumption in data centers by up to 40%.

What are the benefits of Supermicro's high-performance servers?

Supermicro's servers deliver petaflops of AI computing power in a dense form factor and support the latest GPUs and accelerators in the market.

What risks are associated with adopting liquid-cooled solutions?

Potential risks include maintenance complexity and higher upfront costs, which could impact adoption rates.

What challenges may arise in retrofitting existing data centers with liquid cooling infrastructure?

Challenges in retrofitting existing data centers with liquid cooling infrastructure may affect scalability due to the need for significant modifications.

What are the potential drawbacks of liquid-cooled solutions?

The drawbacks of liquid-cooled solutions could include maintenance complexity, higher upfront costs, and challenges in retrofitting existing data centers.