Supermicro's Liquid-Cooled SuperClusters for AI Data Centers Powered by NVIDIA GB200 NVL72 and NVIDIA HGX B200 Systems, Deliver a New Paradigm of Energy-Efficient Exascale Computing
Supermicro (NASDAQ: SMCI) is advancing the transition to liquid-cooled data centers with the NVIDIA Blackwell platform, offering enhanced energy efficiency for AI infrastructures. Key points include:
1. Sampling of NVIDIA GB200 NVL72 platform for exascale computing in a single rack, with full-scale production expected in late Q4.
2. Production-ready X14 and H14 4U liquid-cooled systems and 10U air-cooled systems for the NVIDIA HGX B200 8-GPU system.
3. Over 2000 liquid-cooled racks shipped since June 2024.
4. End-to-end liquid-cooling solution featuring advanced in-rack or in-row coolant distribution units and custom cold plates.
5. Support for NVIDIA GB200 NVL2 platform, a 2U air-cooled system for diverse workloads.
6. SuperCloud Composer software for comprehensive data center management.
Supermicro (NASDAQ: SMCI) sta promuovendo la transizione verso i data center a raffreddamento liquido con la piattaforma NVIDIA Blackwell, offrendo un'efficienza energetica migliorata per le infrastrutture AI. I punti chiave includono:
1. Campionamento della piattaforma NVIDIA GB200 NVL72 per il calcolo exascale in un unico rack, con la produzione su larga scala prevista per la fine del Q4.
2. Sistemi a raffreddamento liquido X14 e H14 4U pronti per la produzione e sistemi a raffreddamento ad aria 10U per il sistema NVIDIA HGX B200 8-GPU.
3. Oltre 2000 rack a raffreddamento liquido spediti da giugno 2024.
4. Soluzione di raffreddamento liquido end-to-end con unità di distribuzione del liquido avanzate in rack o in fila e piastre di raffreddamento personalizzate.
5. Supporto per la piattaforma NVIDIA GB200 NVL2, un sistema a raffreddamento ad aria 2U per carichi di lavoro diversi.
6. Software SuperCloud Composer per una gestione completa dei data center.
Supermicro (NASDAQ: SMCI) está avanzando en la transición hacia centros de datos refrigerados por líquido con la plataforma NVIDIA Blackwell, ofreciendo una mayor eficiencia energética para infraestructuras de IA. Los puntos clave incluyen:
1. Muestreo de la plataforma NVIDIA GB200 NVL72 para computación exascale en un solo rack, con producción a gran escala esperada para finales del Q4.
2. Sistemas refrigerados por líquido X14 y H14 4U listos para la producción y sistemas refrigerados por aire 10U para el sistema NVIDIA HGX B200 8-GPU.
3. Más de 2000 racks refrigerados por líquido enviados desde junio de 2024.
4. Solución de refrigeración líquida de extremo a extremo con unidades de distribución de refrigerante avanzadas en rack o en fila y placas frías personalizadas.
5. Soporte para la plataforma NVIDIA GB200 NVL2, un sistema refrigerado por aire 2U para diversas cargas de trabajo.
6. Software SuperCloud Composer para la gestión integral de centros de datos.
Supermicro (NASDAQ: SMCI)는 NVIDIA Blackwell 플랫폼을 통해 액체 냉각 데이터 센터로의 전환을 추진하고 있으며, AI 인프라를 위한 에너지 효율성을 높이고 있습니다. 주요 내용은 다음과 같습니다:
1. 단일 랙에서 엑사스케일 컴퓨팅을 위한 NVIDIA GB200 NVL72 플랫폼 샘플링, 본격적인 생산은 4분기 말에 예상됩니다.
2. NVIDIA HGX B200 8-GPU 시스템을 위한 생산 준비 완료된 X14 및 H14 4U 액체 냉각 시스템과 10U 공기 냉각 시스템.
3. 2024년 6월 이후 2000개 이상의 액체 냉각 랙이 배송되었습니다.
4. 랙 또는 행 내의 고급 냉매 분배 장치와 맞춤형 냉각판이 포함된 엔드 투 엔드 액체 냉각 솔루션.
5. 다양한 워크로드를 위한 2U 공기 냉각 시스템인 NVIDIA GB200 NVL2 플랫폼에 대한 지원.
6. 데이터 센터 관리를 위한 포괄적인 소프트웨어인 SuperCloud Composer.
Supermicro (NASDAQ: SMCI) fait progresser la transition vers les centres de données refroidis par liquide avec la plateforme NVIDIA Blackwell, offrant une efficacité énergétique améliorée pour les infrastructures d'IA. Les points clés incluent :
1. Échantillonnage de la plateforme NVIDIA GB200 NVL72 pour le calcul exascale dans un seul rack, avec une production à grande échelle attendue pour la fin du Q4.
2. Systèmes à refroidissement liquide X14 et H14 4U prêts à la production et systèmes à refroidissement par air 10U pour le système NVIDIA HGX B200 8-GPU.
3. Plus de 2000 racks refroidis par liquide expédiés depuis juin 2024.
4. Solution de refroidissement liquide de bout en bout avec des unités avancées de distribution de liquide en rack ou en rangée et des plaques froides personnalisées.
5. Support pour la plateforme NVIDIA GB200 NVL2, un système à refroidissement par air 2U pour divers types de charges de travail.
6. Logiciel SuperCloud Composer pour une gestion complète des centres de données.
Supermicro (NASDAQ: SMCI) führt den Übergang zu flüssigkeitsgekühlten Rechenzentren mit der NVIDIA Blackwell Plattform voran und bietet eine verbesserte Energieeffizienz für KI-Infrastrukturen. Wichtige Punkte sind:
1. Probenahme der NVIDIA GB200 NVL72 Plattform für exascale Computing in einem einzelnen Rack, mit einer vollumfänglichen Produktion, die für Ende Q4 erwartet wird.
2. Produktionsbereite X14 und H14 4U flüssigkeitsgekühlte Systeme sowie 10U luftgekühlte Systeme für das NVIDIA HGX B200 8-GPU System.
3. Seit Juni 2024 wurden über 2000 flüssigkeitsgekühlte Racks versandt.
4. End-to-End-Lösung für die Flüssigkeitskühlung mit fortschrittlichen Kühlerverteilereinheiten und maßgeschneiderten Kaltplatten.
5. Unterstützung der NVIDIA GB200 NVL2 Plattform, ein 2U luftgekühltes System für verschiedene Arbeitslasten.
6. SuperCloud Composer Software für eine umfassende Verwaltung von Rechenzentren.
- Sampling of NVIDIA GB200 NVL72 platform for exascale computing in a single rack
- Production-ready systems for NVIDIA HGX B200 8-GPU
- Over 2000 liquid-cooled racks shipped since June 2024
- End-to-end liquid-cooling solution with advanced features
- Support for NVIDIA GB200 NVL2 platform for diverse workloads
- Comprehensive data center management with SuperCloud Composer software
- None.
Insights
Supermicro's announcement of liquid-cooled SuperClusters for AI data centers powered by NVIDIA's latest GPUs is a significant development in the AI infrastructure space. The company's focus on energy-efficient exascale computing aligns with the growing demand for sustainable AI solutions.
Key points to consider:
- Supermicro has already shipped over 2000 liquid-cooled racks since June 2024, indicating strong market adoption.
- The new systems leverage NVIDIA's Blackwell platform, offering up to 15x inference and 3x training performance improvements.
- The company's end-to-end liquid-cooling solution could provide a competitive advantage in the rapidly growing AI infrastructure market.
- Supermicro's ability to deliver comprehensive solutions, including hardware, software and on-site services, positions it well to capture market share in large-scale AI deployments.
While specific financial figures are not provided, the potential for increased revenue and market share in the high-growth AI infrastructure sector is significant. Investors should monitor Supermicro's performance in this segment closely, as it could be a major driver of future growth.
Supermicro's latest offerings represent a significant leap in AI computing capabilities and energy efficiency. The NVIDIA GB200 NVL72 platform delivers exascale AI computing in a single rack, which is a remarkable achievement in computational density.
Technical highlights include:
- 72 NVIDIA Blackwell GPUs and 32 NVIDIA Grace CPUs in a single rack
- NVIDIA NVLink Switch system enabling 130 TB/s of total GPU communication
- Support for up to 64x 1000W NVIDIA Blackwell GPUs and 16x 500W CPUs in a 48U rack
- Advanced liquid-cooling solutions with custom cold plates and in-rack coolant distribution units
The integration of SuperCloud Composer software for managing liquid-cooled systems adds value by optimizing operational costs and system integrity. Supermicro's adoption of cutting-edge networking technologies, including 800Gb/s networking, further enhances the overall system performance.
These advancements position Supermicro as a leader in high-performance, energy-efficient AI infrastructure solutions, potentially attracting customers looking to deploy large-scale AI systems while minimizing energy consumption and operational costs.
Supermicro's End-to-End Liquid-Cooled Solutions Propel Industry's Transition to Sustainable AI Data Centers with the NVIDIA Blackwell Platform
"We're driving the future of sustainable AI computing, and our liquid-cooled AI solutions are rapidly being adopted by some of the most ambitious AI Infrastructure projects in the world with over 2000 liquid-cooled racks shipped since June 2024," said Charles Liang, president and CEO of Supermicro. "Supermicro's end-to-end liquid-cooling solution, with the NVIDIA Blackwell platform, unlocks the computational power, cost-effectiveness, and energy-efficiency of the next generation of GPUs, such as those that are part of the NVIDIA GB200 NVL72, an exascale computer contained in a single rack. Supermicro's extensive experience in deploying liquid-cooled AI infrastructure, along with comprehensive on-site services, management software, and global manufacturing capacity, provides customers a distinct advantage in transforming data centers with the most powerful and sustainable AI solutions."
https://www.supermicro.com/en/solutions/ai-supercluster
Supermicro's liquid-cooled SuperClusters for NVIDIA GB200 NVL72 platform-based systems feature the new advanced in-rack or in-row coolant distribution units (CDUs), and custom cold plates designed for the compute tray housing two NVIDIA GB200 Grace Blackwell Superchips in a 1U form factor. Supermicro's NVIDIA GB200 NVL72 delivers exascale AI computing capabilities in a single rack with Supermicro's end-to-end liquid-cooling solution. The rack solution incorporates 72 NVIDIA Blackwell GPUs and 32 NVIDIA Grace CPUs, interconnected by NVIDIA's fifth generation NVLink network. The NVIDIA NVLink Switch system facilitates 130 terabytes per second (TB/s) of total GPU communication with extremely low latency, enhancing performance for AI and high-performance computing (HPC) workloads. In addition, Supermicro supports recently announced NVIDIA GB200 NVL2 platform, 2U air-cooled system featuring tightly coupled two NVIDIA Blackwell GPUs and two NVIDIA Grace CPUs that is suited for easy deployment with diverse workloads such as large LLM inference, RAG, data processing, and HPC applications.
Supermicro's leading 4U liquid-cooled systems and the new 10U air-cooled systems now support the NVIDIA HGX B200 8-GPU system and are ready for production. The newly developed cold plates and the 250kW capacity in-rack coolant distribution unit maximize the performance and efficiency of the 8-GPU systems, providing 64x 1000W NVIDIA Blackwell GPUs and 16x 500W CPUs in a single 48U rack. Up to 4 of the new 10U air-cooled systems can be installed and fully integrated in a rack, the same density as the previous generation, while providing up to 15x inference and 3x training performance.
SuperCloud Composer software, Supermicro's comprehensive data center management platform, provides powerful tools to monitor vital information on liquid-cooled systems and racks, coolant distribution units, and cooling towers, including pressure, humidity, pump and valve conditions, and more. SuperCloud Composer's Liquid Cooling Consult Module (LCCM) optimizes the operational cost and manages the integrity of liquid-cooled data centers.
Scaling the infrastructure for multi-trillion parameter AI models, Supermicro is at the forefront of adopting networking innovations for both InfiniBand and Ethernet, including NVIDIA BlueField®-3 SuperNICs and NVIDIA ConnectX®-7 at 400Gb/s, NVIDIA ConnectX®-8, Spectrum™-4, and NVIDIA Quantum-3 to enable 800Gb/s networking for the NVIDIA Blackwell platform. The NVIDIA Spectrum-X™ Ethernet with Supermicro's 4U liquid-cooled and 8U air-cooled NVIDIA HGX H100 and H200 system clusters now powers one of the largest AI deployments to date.
From proof-of-concept (PoC) to full-scale deployment, Supermicro is a one-stop shop, providing all necessary technologies, liquid-cooling, networking solutions, and onsite installation services. Supermicro delivers a comprehensive, in-house-designed liquid-cooling ecosystem, encompassing custom-designed cold plates optimized for various GPUs, CPUs, and memory modules, along with multiple CDU form factors and capacity, manifolds, hoses, connectors, cooling towers, and monitoring and management software. This end-to-end solution seamlessly integrates into rack-level configurations, significantly boosting system efficiency, mitigating thermal throttling, and simultaneously reducing both the Total Cost of Ownership (TCO) and environmental impact of data center operations for the era of AI.
Supermicro at 2024 OCP Global Summit
- New X14 4U liquid-cooled system with NVIDIA HGX B200 8-GPU system
- Supermicro's SuperCluster NVIDIA GB200 NVL72 Platform 4
- H13 4U liquid-cooled system with NVIDIA HGX H200 8-GPU system
- X14 JBOF system
- X14 1U CloudDC with OCP DC-MHS design
Learn more at OCP Global Summit Booth #21,
About Super Micro Computer, Inc.
Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in
Supermicro, Server Building Block Solutions, and We Keep IT Green are trademarks and/or registered trademarks of Super Micro Computer, Inc.
All other brands, names, and trademarks are the property of their respective owners.
View original content to download multimedia:https://www.prnewswire.com/news-releases/supermicros-liquid-cooled-superclusters-for-ai-data-centers-powered-by-nvidia-gb200-nvl72-and-nvidia-hgx-b200-systems-deliver-a-new-paradigm-of-energy-efficient-exascale-computing-302276685.html
SOURCE Super Micro Computer, Inc.
FAQ
When will Supermicro's NVIDIA GB200 NVL72 platform be available for full-scale production?
How many liquid-cooled racks has Supermicro (SMCI) shipped since June 2024?
What is the performance improvement of Supermicro's new 10U air-cooled systems for NVIDIA HGX B200?
What software does Supermicro (SMCI) use for managing liquid-cooled data centers?
