Supermicro Previews New Max Performance Intel-based X14 Servers for AI, HPC, and Critical Enterprise Workloads

Rhea-AI Summary

Supermicro is previewing new X14 server platforms designed for AI, HPC, and critical enterprise workloads. These systems feature significant upgrades, including support for 256 performance cores in a single node, MRDIMMs at 8800MT/s, and compatibility with next-generation GPUs. The new platforms offer unprecedented performance and advanced features, with Supermicro ready to deliver high-performance solutions at rack-scale with comprehensive direct-to-chip liquid cooling and total rack integration services. The company has a global manufacturing capacity of up to 5,000 racks per month, including 1,350 liquid-cooled racks.

Positive

• Introduction of new X14 server platforms with significant performance upgrades
• Support for 256 performance cores in a single node
• Compatibility with next-generation SXM, OAM, and PCIe GPUs
• Global manufacturing capacity of up to 5,000 racks per month
• Comprehensive direct-to-chip liquid cooling solutions
• New 10U and multi-node form factors for increased GPU and CPU densities
• Upgraded memory performance with 12 memory channels per CPU and MRDIMMs up to 8800MT/s
• Expanded product portfolio with more than ten new systems

Negative

• None.

Insights

Tech Expert

Supermicro's preview of their new X14 servers represents a significant leap in high-performance computing technology. The support for up to 256 performance cores in a single node is a game-changer for compute-intensive tasks. This, coupled with MRDIMM support at 8800MT/s, could drastically reduce processing times for AI training and complex data analytics.

The compatibility with next-generation SXM, OAM and PCIe GPUs positions these servers at the forefront of AI acceleration. The direct-to-chip liquid cooling is particularly noteworthy, as it allows for higher power densities and improved energy efficiency. This could translate to substantial cost savings for data centers running AI workloads at scale.

However, the true impact will depend on real-world performance benchmarks and pricing, which are yet to be revealed. Potential adopters should also consider the integration challenges with existing infrastructure and the learning curve for new technologies like CXL 2.0.

Financial Analyst

Supermicro's strategic move to preview these advanced servers could significantly boost its market position. The company's ability to deliver 5,000 racks per month, including 1,350 liquid-cooled racks, demonstrates impressive manufacturing capacity. This scalability could translate into substantial revenue growth, especially if demand for AI infrastructure continues to surge.

The Early Ship Program and JumpStart remote testing initiatives are smart moves to capture early adopters and potentially lock in large orders. However, investors should watch for the capital expenditure required to ramp up production and any potential supply chain constraints for cutting-edge components.

While the news is positive, the financial impact remains speculative until we see concrete orders and revenue figures. The company's ability to maintain margins while delivering these advanced systems will be important for profitability.

Market Research Analyst

Supermicro's new X14 servers are poised to capitalize on the booming AI and HPC markets. The workload-specific categories (GPU-optimized, high compute-density multi-nodes and Hyper rackmounts) demonstrate a nuanced understanding of diverse market needs. This targeted approach could help Supermicro capture market share across various segments.

The compatibility with both Intel Xeon 6900 series processors with P-cores and E-cores offers flexibility that could appeal to a wide range of customers, from those prioritizing performance to those focused on energy efficiency. This adaptability could be a key differentiator in a competitive market.

However, the success of these servers will depend on how they stack up against offerings from major competitors like Dell, HPE and Lenovo. Supermicro will need to leverage its agility and customization capabilities to stand out in a market where brand loyalty and established relationships play significant roles.

A Complete Architecture Upgrade that Includes New Performance-Optimized CPUs, Next-Generation GPU support, Upgraded Memory MRDIMMs, 400GbE Networking, New Storage Options Including E1.S and E3.S drives, and Direct-to-Chip Liquid Cooling, based on the Upcoming Intel® Xeon® 6900 Series Processors with P-Cores (formerly codenamed Granite Rapids-AP) Supporting Demanding Workloads

SAN JOSE, Calif., Aug. 28, 2024 /PRNewswire/ -- Supermicro, Inc. (NASDAQ: SMCI) a Total IT Solution Provider for AI/ML, HPC, Cloud, Storage, and 5G/Edge, is previewing new, completely re-designed X14 server platforms which will leverage next-generation technologies to maximize performance for compute-intensive workloads and applications. Building on the success of Supermicro's efficiency-optimized X14 servers that launched in June 2024, the new systems feature significant upgrades across the board, supporting a never-before-seen 256 performance cores (P-cores) in a single node, memory support up for MRDIMMs at 8800MT/s, and compatibility with next-generation SXM, OAM, and PCIe GPUs. This combination can drastically accelerate AI and compute as well as significantly reduce the time and cost of large-scale AI training, high-performance computing, and complex data analytics tasks. Approved customers can secure early access to complete, full-production systems via Supermicro's Early Ship Program or for remote testing with Supermicro JumpStart.

"We continue to add to our already comprehensive Data Center Building Block solutions with these new platforms, which will offer unprecedented performance, and new advanced features," said Charles Liang, president and CEO of Supermicro. "Supermicro is ready to deliver these high-performance solutions at rack-scale with the industry's most comprehensive direct-to-chip liquid cooled, total rack integration services, and a global manufacturing capacity of up to 5,000 racks per month including 1,350 liquid cooled racks. With our worldwide manufacturing capabilities, we can deliver fully optimized solutions which accelerate our time-to-delivery like never before, while also reducing TCO."

Click here for more information.

These new X14 systems feature completely re-designed architectures including new 10U and multi-node form factors to enable support for next-generation GPUs and higher CPU densities, updated memory slot configurations with 12 memory channels per CPU and new MRDIMMs which provide up to 37% better memory performance compared to DDR5-6400 DIMMS. In addition, upgraded storage interfaces will support higher drive densities, and more systems with liquid cooling integrated directly into the server architecture.

The new additions to the Supermicro X14 family comprise more than ten new systems, several of which are completely new architectures in three distinct, workload-specific categories:

• GPU-optimized platforms designed for pure performance and enhanced thermal capacity to support the highest-wattage GPUs. System architectures have been built from the ground up for large-scale AI training, LLMs, generative AI, 3D media, and virtualization applications.
• High compute-density multi-nodes including SuperBlade® and the all-new FlexTwin™, which leverage direct-to-chip liquid cooling to significantly increase the number of performance cores in a standard rack compared to previous generations of systems.
• Market-proven Hyper rackmounts combine single or dual socket architectures with flexible I/O and storage configurations in traditional form factors to help enterprises and data centers scale up and out as their workloads evolve.

Supermicro X14 performance-optimized systems will support the soon-to-be-released Intel® Xeon® 6900 series processors with P-cores and will also offer socket compatibility to support Intel Xeon 6900 series processors with E-cores in Q1'25. This designed-in feature allows workload-optimized systems for either performance-per-core or performance-per-watt.

"The new Intel Xeon 6900 series processors with P-cores are our most powerful ever, with more cores and exceptional memory bandwidth & I/O to achieve new degrees of performance for AI and compute-intensive workloads," said Ryan Tabrah, VP and GM of Xeon 6 at Intel. "Our continued partnership with Supermicro will result in some of the industry's most powerful systems that are ready to meet the ever-heightening demands of modern AI and high-performance computing."

When configured with Intel Xeon 6900 series processors with P-cores, Supermicro systems support new FP16 instructions on the built-in Intel® AMX accelerator to further enhance AI workload performance. These systems include 12 memory channels per CPU with support for both DDR5-6400 and MRDIMMs up to 8800MT/s, CXL 2.0, and feature more extensive support for high-density, industry-standard EDSFF E1.S and E3.S NVMe drives.

Supermicro Liquid Cooling Solutions

Complementing this expanded X14 product portfolio are Supermicro's rack-scale integration and liquid cooling capabilities. With an industry-leading global manufacturing capacity, extensive rack-scale integration and testing facilities, and a comprehensive suite of management software solutions, Supermicro designs, builds, tests, validates, and delivers complete solutions at any scale in a matter of weeks.

In addition, Supermicro offers a complete in-house developed liquid cooling solution including cold plates for CPUs, GPUs and memory, Cooling Distribution Units, Cooling Distribution Manifolds, hoses, connectors, and cooling towers. Liquid cooling can be easily included in rack-level integrations to further increase system efficiency, reduce instances of thermal throttling, and lower both the TCO and Total Cost to Environment (TCE) of data center deployments.

Upcoming Supermicro X14 performance-optimized systems include:

GPU-optimized – The highest performance Supermicro X14 systems designed for large-scale AI training, large language models (LLMs), generative AI and HPC, and supporting eight of the latest-generation SXM5 and SXM6 GPUs. These systems are available in air-cooled or liquid-cooled configurations.

PCIe GPU – Designed for maximum GPU flexibility, supporting up to 10 double-width PCIe 5.0 accelerator cards in a thermally-optimized 5U chassis. These servers are ideal for media, collaborative design, simulation, cloud gaming, and virtualization workloads.

Intel® Gaudi® 3 AI Accelerators – Supermicro also plans to deliver the industry's first AI server based on the Intel Gaudi 3 accelerator hosted by Intel Xeon 6 processors. The system is expected to increase efficiency and lower the cost of large-scale AI model training and AI inferencing. The system features eight Intel Gaudi 3 accelerators on an OAM universal baseboard, six integrated OSFP ports for cost-effective scale-out networking, and an open platform designed to use a community-based, open-source software stack, requiring no software licensing costs.

SuperBlade® - Supermicro's X14 6U high-performance, density-optimized, and energy-efficient SuperBlade maximizes rack density, with up to 100 servers and 200 GPUs per rack. Optimized for AI, HPC, and other compute-intensive workloads, each node features air cooling or direct-to-chip liquid cooling to maximize efficiency and achieve the lowest PUE with the best TCO, as well as connectivity up to four integrated Ethernet switches with 100G uplinks and front I/O supporting a range of flexible networking options up to 400G InfiniBand or 400G Ethernet per node.

FlexTwin™ - The new Supermicro X14 FlexTwin architecture is designed to provide maximum compute power and density in a multi-node configuration with up to 24,576 performance cores in a 48U rack. Optimized for HPC and other compute-intensive workloads, each node features direct-to-chip liquid cooling only to maximize efficiency and reduce instances of CPU thermal throttling, as well as HPC Low Latency front and rear I/O supporting a range of flexible networking options up to 400G per node.

Hyper - X14 Hyper is Supermicro's flagship rackmount platform designed to deliver the highest performance for demanding AI, HPC, and enterprise applications, with single or dual socket configurations supporting double-width PCIe GPUs for maximum workload acceleration. Both air cooling and direct-to-chip liquid cooling models are available to facilitate the support of top-bin CPUs without thermal limitations and reduce data center cooling costs while also increasing efficiency.

About Super Micro Computer, Inc.

Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in San Jose, California, Supermicro is committed to delivering first to market innovation for Enterprise, Cloud, AI, and 5G Telco/Edge IT Infrastructure. We are a Total IT Solutions provider with server, AI, storage, IoT, switch systems, software, and support services. Supermicro's motherboard, power, and chassis design expertise further enable our development and production, enabling next generation innovation from cloud to edge for our global customers. Our products are designed and manufactured in-house (in the US, Taiwan, and the Netherlands), leveraging global operations for scale and efficiency and optimized to improve TCO and reduce environmental impact (Green Computing). The award-winning portfolio of Server Building Block Solutions® allows customers to optimize for their exact workload and application by selecting from a broad family of systems built from our flexible and reusable building blocks that support a comprehensive set of form factors, processors, memory, GPUs, storage, networking, power, and cooling solutions (air-conditioned, free air cooling or liquid cooling).

Supermicro, Server Building Block Solutions, and We Keep IT Green are trademarks and/or registered trademarks of Super Micro Computer, Inc.

All other brands, names, and trademarks are the property of their respective owners.

 

View original content to download multimedia:https://www.prnewswire.com/news-releases/supermicro-previews-new-max-performance-intel-based-x14-servers-for-ai-hpc-and-critical-enterprise-workloads-302232388.html

SOURCE Super Micro Computer, Inc.

FAQ

What are the key features of Supermicro's new X14 server platforms for AI and HPC workloads?

Supermicro's new X14 server platforms feature support for 256 performance cores in a single node, MRDIMMs at 8800MT/s, compatibility with next-generation GPUs, and direct-to-chip liquid cooling options. They are designed to maximize performance for compute-intensive workloads and applications.

How many racks can Supermicro (SMCI) manufacture per month globally?

Supermicro (SMCI) has a global manufacturing capacity of up to 5,000 racks per month, including 1,350 liquid-cooled racks.

What processor series will Supermicro's X14 performance-optimized systems support?

Supermicro's X14 performance-optimized systems will support the upcoming Intel Xeon 6900 series processors with P-cores, and will also offer socket compatibility to support Intel Xeon 6900 series processors with E-cores in Q1'25.

What are the main categories of Supermicro's new X14 systems announced in August 2024?

Supermicro's new X14 systems are categorized into three main groups: GPU-optimized platforms, high compute-density multi-nodes (including SuperBlade and FlexTwin), and market-proven Hyper rackmounts.