Supermicro Introduces New Versatile System Design for AI Delivering Optimization and Flexibility at the Edge

Rhea-AI Summary

Supermicro (SMCI) has introduced a new 3U server system optimized for AI inferencing at the network edge. The SYS-322GB-NR supports up to 18 GPUs and features dual Intel® Xeon® 6900 series processors with P-cores. This versatile system can accommodate up to 10 double-width GPUs in air-cooled environments, offering 256 cores for edge data centers.

Key features include:

• Up to 20 PCIe 5.0 expansion slots
• 6TB of RDIMM memory
• 14 E1.S or 6 U.2 NVMe drives

The system is designed for applications requiring minimal latency and on-premises LLM-based solutions. Supermicro will showcase this and other AI-optimized systems at MWC Las Vegas, October 8-10, booth #518.

Positive

• Introduction of a new high-density 3U server optimized for AI inferencing at the edge
• Support for up to 18 GPUs and dual Intel Xeon 6900 series processors
• Versatile system design accommodating various GPU configurations and expansion options
• Showcase of new AI-optimized systems at MWC Las Vegas, potentially increasing market visibility

Negative

• None.

Insights

Tech Expert

Supermicro's new 3U Edge AI system, the SYS-322GB-NR, represents a significant advancement in edge computing for AI applications. Key features include:

• Support for up to 18 GPUs in a single system
• Dual Intel® Xeon® 6900 series processors with P-cores
• Up to 20 PCIe 5.0 expansion slots
• Up to 6TB of RDIMM memory
• Support for up to 14 E1.S or 6 U.2 NVMe drives

This system is designed to address the growing demand for edge AI inferencing, particularly for large language models (LLMs). Its high-density design and thermal efficiency allow for deployment in traditional air-cooled environments, making it suitable for edge data centers. The versatility of this system enables its use in various industries, from manufacturing to large-scale control rooms, potentially expanding Supermicro's market reach in the rapidly growing AI infrastructure sector.

Market Research Analyst

Supermicro's new Edge AI system launch is strategically timed to capitalize on the exponential growth in the AI market. This product addresses several key trends:

• Increasing demand for on-premises AI inferencing
• Need for low-latency processing at the edge
• Versatility in GPU and expansion card support
• Focus on thermal efficiency for diverse deployment scenarios

The system's ability to support up to 18 GPUs positions Supermicro competitively in the high-performance edge computing market. With the global edge AI hardware market projected to grow significantly, this product launch could potentially boost Supermicro's market share and revenue in the coming years. Investors should note that success will depend on adoption rates and Supermicro's ability to differentiate from competitors in this rapidly evolving space.

New 3U Server Supports up to 18 GPUs and Features Dual Intel® Xeon® 6900 series processors with P-cores

SAN JOSE, Calif., Oct. 8, 2024 /PRNewswire/ -- Super Micro Computer, Inc. (SMCI), a Total IT Solution Provider for AI, Cloud, Storage, and 5G/Edge, announces the launch of a new, versatile, high-density infrastructure platform optimized for AI inferencing at the network edge. As companies seek to embrace complex large language models (LLM) in their daily operations, there is a need for new hardware capable of inferencing high volumes of data in edge locations with minimal latency. Supermicro's innovative system combines versatility, performance, and thermal efficiency to deliver up to 10 double-width GPUs in a single system capable of running in traditional air-cooled environments.

"Owing to the system's optimized thermal design, Supermicro can deliver all this performance in a high-density 3U 20 PCIe system with 256 cores that can be deployed in edge data centers," said Charles Liang, president and CEO of Supermicro. "As the AI market is growing exponentially, customers need a powerful, versatile solution to inference data to run LLM-based applications on-premises, close to where the data is generated. Our new 3U Edge AI system enables them to run innovative solutions with minimal latency."

For more information, please visit https://www.supermicro.com/en/solutions/edge-ai

The new SYS-322GB-NR includes two powerful Intel® Xeon® 6900 processors with P-cores, 8800 MT/s MRDIMM and up to 20 PCIe 5.0 expansion slots. This Supermicro system supports a variety of single or double-width GPUs, or to use some of the expansion slots for high-performance I/O or other add-on cards. Additionally, the server features up to 6TB of RDIMM memory and up to 14 E1.S or 6 U.2 NVMe drives.

One example use case that this system delivers is in the manufacturing industry, where Supermicro's new system can be deployed on-site at an automated production environment to process data feeds from cameras and sensors without having to transfer the data to a remote location. This capability reduces networking requirements and improves response times. Another environment where the SYS-322GB-NR will excel is large-scale control rooms, where the AI accelerator cards can be partially replaced by multi-display cards to support up to 64 independent displays.

Supermicro at Mobile World Congress (MWC) Las Vegas

The SYS-322GB-NR will be on display at Supermicro's booth #518 during MWC Las Vegas, October 8-10. Additionally, Supermicro will display systems that incorporate NVIDIA, AMD and Intel Xeon 6 processors, including X14 family edge and telco systems such as:

SYS-222HE-FTN - the Hyper-E brings data center performance to the telco edge with a dual Intel Xeon 6 processor in a 2U, short-depth form factor with front I/O access

SYS-212B-FN2T - a 2U short-depth system for AI in telco and edge deployments, featuring a single Intel Xeon 6700 series processor with E-cores and GPU support

SYS-E403-14B-FRN2T- a box PC sized, wall-mountable edge device capable of bringing the Intel Xeon 6700 series processor with E-cores and GPU support to remote environments

AS -1115S-FDWTRT - a 1U NEBS compliant system providing Telco performance for ORAN, Core and managed services. This system utilizes the AMD EPYC 8004 Series processor and support of up to 1 single-width GPU accelerator for heavy workloads.

In addition to showcasing Supermicro hardware systems, in partnership with NVIDIA, we will jointly demonstrate inferencing and AI solutions for on-premise and Edge applications including Enterprise AI, Retail, Telco Edge and Financial Services. We will demonstrate key generative AI solutions that include NVIDIA NIM, NVIDIA NeMo, NVIDIA Metropolis, remote management, security, and networking. For Telecom, Supermicro and NVIDIA will be demonstrating a live AI RAN solution using NVIDIA and Supermicro solutions showcasing performance, management and AI use cases.

Also, on display at MWC Las Vegas is the new a joint solution from Supermicro and Intel which combines the ruggedized IP65 Outdoor Edge system with a built-in AI Network Accelerator and Intel® Data Center GPU Flex 170. This solution enables fast and cost-effective deployment of multiple private 5G networks as well as Edge AI applications in a single device. The networks can be used and exploited by different users, offering a scalable solution for dense environments such as industrial and campus sites, venues and smart cities.

 About Super Micro Computer, Inc.

Supermicro (NASDAQ: SMCI) is a global leader in Application-Optimized Total IT Solutions. Founded and operating in San Jose, California, Supermicro is committed to delivering first to market innovation for Enterprise, Cloud, AI, and 5G Telco/Edge IT Infrastructure. We are a Total IT Solutions provider with server, AI, storage, IoT, switch systems, software, and support services. Supermicro's motherboard, power, and chassis design expertise further enable our development and production, enabling next generation innovation from cloud to edge for our global customers. Our products are designed and manufactured in-house (in the US, Taiwan, and the Netherlands), leveraging global operations for scale and efficiency and optimized to improve TCO and reduce environmental impact (Green Computing). The award-winning portfolio of Server Building Block Solutions® allows customers to optimize for their exact workload and application by selecting from a broad family of systems built from our flexible and reusable building blocks that support a comprehensive set of form factors, processors, memory, GPUs, storage, networking, power, and cooling solutions (air-conditioned, free air cooling or liquid cooling).

Supermicro, Server Building Block Solutions, and We Keep IT Green are trademarks and/or registered trademarks of Super Micro Computer, Inc.

All other brands, names, and trademarks are the property of their respective owners.

 

View original content to download multimedia:https://www.prnewswire.com/news-releases/supermicro-introduces-new-versatile-system-design-for-ai-delivering-optimization-and-flexibility-at-the-edge-302269769.html

SOURCE Super Micro Computer, Inc.

FAQ

What are the key features of Supermicro's new SYS-322GB-NR server?

The SYS-322GB-NR server supports up to 18 GPUs, features dual Intel Xeon 6900 series processors with P-cores, offers up to 20 PCIe 5.0 expansion slots, 6TB of RDIMM memory, and can accommodate up to 14 E1.S or 6 U.2 NVMe drives.

How many GPUs can Supermicro's new 3U server support in air-cooled environments?

Supermicro's new 3U server can support up to 10 double-width GPUs in traditional air-cooled environments.

Where will Supermicro (SMCI) showcase its new AI-optimized systems?

Supermicro will showcase its new AI-optimized systems, including the SYS-322GB-NR, at MWC Las Vegas, October 8-10, at booth #518.

What is the main application focus of Supermicro's new edge AI system?

The main application focus of Supermicro's new edge AI system is AI inferencing at the network edge, designed for running LLM-based applications on-premises with minimal latency.