Oracle Offers First Zettascale Cloud Computing Cluster

Rhea-AI Summary

Oracle has announced the first zettascale cloud computing clusters powered by NVIDIA Blackwell GPUs. Oracle Cloud Infrastructure (OCI) is now taking orders for the largest AI supercomputer in the cloud, offering up to 131,072 NVIDIA Blackwell GPUs with a peak performance of 2.4 zettaFLOPS. This surpasses other hyperscalers by more than six times in GPU count.

OCI Superclusters are available with NVIDIA H100, H200, or Blackwell GPUs, offering various performance levels. The clusters include OCI Compute Bare Metal, ultra-low latency networking, and HPC storage options. Customers like WideLabs and Zoom are already leveraging OCI's AI infrastructure for large language models and AI assistants, respectively, benefiting from its performance, security, and sovereignty controls.

Positive

• OCI offers the largest AI supercomputer in the cloud with up to 131,072 NVIDIA Blackwell GPUs
• Peak performance of 2.4 zettaFLOPS, surpassing other hyperscalers by more than six times in GPU count
• Flexible options with NVIDIA H100, H200, or Blackwell GPUs for various performance needs
• Partnerships with major companies like Zoom for AI infrastructure
• OCI's data and AI sovereignty capabilities support local data storage and AI requirements

Negative

• NVIDIA Blackwell GPUs won't be available until the first half of 2025
• Significant investment required for such high-performance computing infrastructure

Tech Expert

Oracle's announcement of the world's first zettascale cloud computing cluster is a game-changer in the AI and cloud computing landscape. The ability to offer up to 131,072 NVIDIA Blackwell GPUs with 2.4 zettaFLOPS of peak performance is unprecedented. This massive computing power will enable customers to build, train and deploy AI models at a scale previously unimaginable.

The flexibility of Oracle's distributed cloud allows customers to deploy these services while maintaining data and AI sovereignty, a important factor for many organizations and countries. The scalability options, from H100 to H200 and eventually Blackwell GPUs, provide a clear upgrade path for customers as their AI needs grow.

This move positions Oracle as a formidable competitor in the cloud AI space, potentially disrupting the market dominance of other major players. It's a bold step that could attract high-performance computing customers and large-scale AI projects to Oracle's platform.

Financial Analyst

Oracle's investment in zettascale computing represents a significant strategic move to capture a larger share of the rapidly growing AI and cloud computing market. This initiative positions Oracle to compete more effectively with industry leaders like AWS, Google Cloud and Microsoft Azure in the high-performance computing segment.

The partnership with NVIDIA and the ability to offer cutting-edge GPU technology could lead to increased revenue streams from AI-focused customers. However, investors should consider the substantial capital expenditure required for such infrastructure and its impact on short-term profitability.

The focus on data sovereignty and flexible deployment options addresses growing regulatory concerns and could be a key differentiator, potentially opening up new markets and government contracts. Overall, this move aligns with the growing demand for AI services and could drive long-term growth for Oracle in the cloud sector.

Market Research Analyst

Oracle's zettascale computing offering addresses a critical market need for high-performance AI infrastructure. The timing is strategic, aligning with the explosive growth in generative AI and large language models that require immense computing power.

The case studies of WideLabs and Zoom highlight the diverse applications of this technology, from healthcare to business communication. This demonstrates the broad market appeal of Oracle's offering across various sectors.

The emphasis on data sovereignty is particularly noteworthy, as it caters to the increasing global concerns about data control and localization. This feature could be a significant differentiator in markets with strict data regulations, potentially giving Oracle an edge in securing government and enterprise contracts in these regions.

Overall, this move positions Oracle to capture a larger share of the rapidly expanding AI infrastructure market, which is expected to see continued growth in the coming years.

New AI supercomputer, the largest in the cloud, to deliver up to 131,072 NVIDIA GPUs to enable customers to build, train, and inference AI at scale

LAS VEGAS, Sept. 11, 2024 /PRNewswire/ -- Oracle CloudWorld -- Oracle today announced the first zettascale cloud computing clusters accelerated by the NVIDIA Blackwell platform. Oracle Cloud Infrastructure (OCI) is now taking orders for the largest AI supercomputer in the cloud – available with up to 131,072 NVIDIA Blackwell GPUs.

"We have one of the broadest AI infrastructure offerings and are supporting customers that are running some of the most demanding AI workloads in the cloud," said Mahesh Thiagarajan, executive vice president, Oracle Cloud Infrastructure. "With Oracle's distributed cloud, customers have the flexibility to deploy cloud and AI services wherever they choose while preserving the highest levels of data and AI sovereignty."

World's first Zettascale computing cluster
OCI is now taking orders for the largest AI supercomputer in the cloud – available with up to 131,072 NVIDIA Blackwell GPUs – delivering an unprecedented 2.4 zettaFLOPS of peak performance. The maximum scale of OCI Supercluster offers more than three times as many GPUs as the Frontier supercomputer and more than six times that of other hyperscalers. OCI Supercluster includes OCI Compute Bare Metal, ultra-low latency RoCEv2 with ConnectX-7 NICs and ConnectX-8 SuperNICs or NVIDIA Quantum-2 InfiniBand-based networks, and a choice of HPC storage.

OCI Superclusters are orderable with OCI Compute powered by either NVIDIA H100 or H200 Tensor Core GPUs or NVIDIA Blackwell GPUs. OCI Superclusters with H100 GPUs can scale up to 16,384 GPUs with up to 65 ExaFLOPS of performance and 13Pb/s of aggregated network throughput. OCI Superclusters with H200 GPUs will scale to 65,536 GPUs with up to 260 ExaFLOPS of performance and 52Pb/s of aggregated network throughput and will be available later this year. OCI Superclusters with NVIDIA GB200 NVL72 liquid-cooled bare-metal instances will use NVLink and NVLink Switch to enable up to 72 Blackwell GPUs to communicate with each other at an aggregate bandwidth of 129.6 TB/s in a single NVLink domain. NVIDIA Blackwell GPUs, available in the first half of 2025, with fifth-generation NVLink, NVLink Switch, and cluster networking will enable seamless GPU-GPU communication in a single cluster.

"As businesses, researchers and nations race to innovate using AI, access to powerful computing clusters and AI software is critical," said Ian Buck, vice president of Hyperscale and High Performance Computing, NVIDIA. "NVIDIA's full-stack AI computing platform on Oracle's broadly distributed cloud will deliver AI compute capabilities at unprecedented scale to advance AI efforts globally and help organizations everywhere accelerate research, development and deployment."

Customers such as WideLabs and Zoom are leveraging OCI's high-performing AI infrastructure with powerful security and sovereignty controls.

WideLabs trains one of the largest Portuguese LLMs on OCI
WideLabs, an applied AI startup in Brazil, is training one of Brazil's largest LLMs, Amazonia IA,  on OCI. They developed bAIgrapher, an application that uses its LLM to generate biographical content based on data collected from patients with Alzheimer's disease to help them preserve important memories.

WideLabs uses the Oracle Cloud São Paulo Region to run its AI workloads, ensuring that sensitive data remains within country borders. This enables WideLabs to adhere to Brazilian AI sovereignty requirements by being able to control where its AI technology is deployed and operated. WideLabs uses OCI AI infrastructure with NVIDIA H100 GPUs to train its LLMs, as well as Oracle Kubernetes Engine to provision, manage, and operate GPU-accelerated containers across an OCI Supercluster consisting of OCI Compute connected with OCI's RMDA-based cluster networking.

"OCI AI infrastructure offers us the most efficiency for training and running our LLMs," said Nelson Leoni, CEO, WideLabs. "OCI's scale and flexibility is invaluable as we continue to innovate in the healthcare space and other key sectors."

Zoom uses OCI's sovereignty capabilities for its generative AI assistant
Zoom a leading AI-first collaboration platform, is using OCI to provide inference for Zoom AI Companion, the company's AI personal assistant available at no additional cost. Zoom AI Companion helps users draft emails and chat messages, summarize meetings and chat threads, generate ideas during brainstorms with colleagues, and more. OCI's data and AI sovereignty capabilities will help Zoom keep customer data locally in region and support AI sovereignty requirements in Saudi Arabia, where OCI's solution is being rolled out initially.

"Zoom AI Companion is revolutionizing the way organizations work, with cutting-edge generative AI capabilities available at no additional cost with customers' paid accounts," said Bo Yan, head of AI, Zoom. "By harnessing OCI's AI inference capabilities, Zoom is able to deliver accurate results at low latency, empowering users to collaborate seamlessly, communicate effortlessly, and boost productivity, efficiency, and potential like never before."

Additional Resources

• Learn more about OCI Supercluster
• Read more about Oracle's sovereign AI approach
• Learn more about NVIDIA and Oracle expanding access to accelerated computing

About Oracle
Oracle offers integrated suites of applications plus secure, autonomous infrastructure in the Oracle Cloud. For more information about Oracle (NYSE: ORCL), please visit us at oracle.com.

About Oracle CloudWorld
CloudWorld is where our customers and partners can see the latest innovations in cloud technology, discover methods for getting the most business value from AI today, and explore ways to increase productivity and efficiency through automation. You'll learn from experts and your peers who build and use the applications, cloud infrastructure, databases, developer tools, and AI services that help solve complex business challenges in every industry. Join us to develop new skills and see new capabilities in action. Register now at oracle.com/cloudworld or follow the news and conversation at oracle.com/news and linkedin.com/company/oracle/

Future Product Disclaimer
The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, timing, and pricing of any features or functionality described for Oracle's products may change and remains at the sole discretion of Oracle Corporation.

Forward-Looking Statements Disclaimer
Statements in this article relating to Oracle's future plans, expectations, beliefs, and intentions are "forward-looking statements" and are subject to material risks and uncertainties. Many factors could affect Oracle's current expectations and actual results, and could cause actual results to differ materially. A discussion of such factors and other risks that affect Oracle's business is contained in Oracle's Securities and Exchange Commission (SEC) filings, including Oracle's most recent reports on Form 10-K and Form 10-Q under the heading "Risk Factors." These filings are available on the SEC's website or on Oracle's website at oracle.com/investor. All information in this article is current as of September 11, 2024 and Oracle undertakes no duty to update any statement in light of new information or future events.

Many of the products and features described herein remain in various stages and will be offered on a when-and-if-available basis. The statements above are not intended to be, and should not be interpreted as a commitment, promise, or legal obligation, and the development, release, and timing of any features or functionalities described for our products is subject to change and remains at the sole discretion of NVIDIA. NVIDIA will have no liability for failure to deliver or delay in the delivery of any of the products, features or functions set forth herein.

Trademarks
Oracle, Java, MySQL and NetSuite are registered trademarks of Oracle Corporation. NetSuite was the first cloud company—ushering in the new era of cloud computing.

Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability and specifications are subject to change without notice.

View original content to download multimedia:https://www.prnewswire.com/news-releases/oracle-offers-first-zettascale-cloud-computing-cluster-302244535.html

SOURCE Oracle

FAQ

What is the peak performance of Oracle's new zettascale cloud computing cluster (ORCL)?

Oracle's new zettascale cloud computing cluster offers a peak performance of 2.4 zettaFLOPS with up to 131,072 NVIDIA Blackwell GPUs.

When will NVIDIA Blackwell GPUs be available on Oracle Cloud Infrastructure (ORCL)?

NVIDIA Blackwell GPUs will be available on Oracle Cloud Infrastructure (OCI) in the first half of 2025.

How does Oracle's AI supercomputer compare to other hyperscalers (ORCL)?

Oracle's AI supercomputer offers more than six times the number of GPUs compared to other hyperscalers, with up to 131,072 NVIDIA Blackwell GPUs.

What companies are already using Oracle's AI infrastructure (ORCL)?

Companies like WideLabs and Zoom are already using Oracle's AI infrastructure for large language models and AI assistants, respectively.