NVIDIA Releases Major Omniverse Upgrade With Generative AI and OpenUSD

Rhea-AI Summary

NVIDIA has announced a major release of its Omniverse platform, offering new applications and services for developers and industrial enterprises. The update includes advancements to Omniverse Kit, the engine for developing native OpenUSD applications, as well as improvements to spatial-computing capabilities and audio-to-face technology. NVIDIA has also expanded its collaboration with Adobe and announced new connections to OpenUSD, allowing for enhanced design processes and interoperability. The latest release is now available in beta.

Positive

• NVIDIA announces major release of Omniverse platform with new applications and services for developers and industrial enterprises
• Advancements to Omniverse Kit and spatial-computing capabilities
• Expanded collaboration with Adobe and new connections to OpenUSD

Negative

• None.

New Platform Updates, Connections to Adobe Firefly, OpenUSD to RealityKit, Ada-Generation Systems Accelerate Interoperable 3D Workflows and Industrial Digitalization

LOS ANGELES, Aug. 08, 2023 (GLOBE NEWSWIRE) -- SIGGRAPH—NVIDIA today announced a major release of its NVIDIA Omniverse™ platform, offering new foundation applications and services for developers and industrial enterprises to optimize and enhance their 3D pipelines with the OpenUSD framework and generative AI.

The update to Omniverse, an OpenUSD-native software platform for connecting, describing and simulating across 3D tools and applications, accelerates the creation of virtual worlds and advanced workflows for industrial digitalization. Cesium, Convai, Move AI, SideFX Houdini and Wonder Dynamics are now connected to Omniverse via OpenUSD.

Key highlights from the platform update include advancements to Omniverse Kit — the engine for developing native OpenUSD applications and extensions — as well as to the NVIDIA Omniverse Audio2Face™ foundation app and spatial-computing capabilities.

“Industrial enterprises are racing to digitalize their workflows, increasing the demand for OpenUSD-enabled, connected, interoperable, 3D software ecosystems,” said Rev Lebaredian, vice president of Omniverse and simulation technology at NVIDIA. “The latest Omniverse update lets developers tap generative AI through OpenUSD to enhance their tools, and it allows enterprises to build larger, more complex world-scale simulations as digital testing grounds for their industrial applications.”

Key Improvements
Updates to Omniverse Kit include:

• New modular app building — A new Omniverse Kit Extension Registry, a central repository for accessing, sharing and managing Omniverse extensions, lets developers easily turn functionality on and off in their application, making it easier than ever to build custom apps from over 600 core Omniverse extensions provided by NVIDIA.
• New developer templates and resources — New application and experience templates provide developers getting started with OpenUSD and Omniverse a major headstart with minimal coding.
• Boosted efficiency and user experience — New rendering optimizations take full advantage of the NVIDIA Ada Lovelace architecture enhancements in NVIDIA RTX™ GPUs with DLSS 3 technology fully integrated into the Omniverse RTX Renderer, and a new AI denoiser enables real-time 4K path tracing of massive industrial scenes.
• Native RTX-powered spatial integration — New extended-reality (XR) developer tools let users build spatial-computing options natively into their Omniverse-based applications, giving users the flexibility to experience their 3D projects and virtual worlds however they like.

These platform updates are showcased in Omniverse foundation applications, which are fully customizable reference applications that creators, enterprises and developers can copy, extend or enhance. Upgraded applications include:

• Omniverse USD Composer — Lets 3D users assemble large-scale, OpenUSD-based scenes.
• Omniverse Audio2Face — Provides access to generative AI application programming interfaces that create realistic facial animations and gestures from only an audio file, and now includes multilingual support and a new female base model.

OpenUSD Expands Omniverse Ecosystem
NVIDIA also announced a broad range of frameworks, resources and services for developers and companies to accelerate the adoption of Universal Scene Description, known as OpenUSD.

In addition, the company announced new Omniverse Cloud APIs, built by NVIDIA, for developers to more seamlessly implement and deploy OpenUSD pipelines and applications. For example, ChatUSD is a large language model copilot for developers that can answer USD knowledge questions or generate Python-USD code scripts.

New Omniverse connections enabled by OpenUSD are now available, opening more opportunities for industrial enterprises to break data silos in their complex production pipelines.

Expanding their collaboration across Adobe Substance 3D, generative AI and OpenUSD initiatives, Adobe and NVIDIA announced plans to make Adobe Firefly — Adobe’s family of creative generative AI models — available as APIs in Omniverse, enabling developers and creators to enhance their design processes.

Wonder Dynamics is connected to Omniverse with new OpenUSD export support through its AI platform Wonder Studio, which automatically animates, lights and composes computer-generated characters into live-action scenes. New OpenUSD export support will enable artists to generate and export a complete 3D scene — all from a single camera video.

Luma AI’s reality-capture models in USDZ format can be readily imported to Omniverse. Tools from avatar company Convai and character-engine company Inworld AI are connected to Omniverse. With AI tools like Convai, creators can add characters in their digital twin environments that can provide relevant information about the environment and objects, be a tour guide or be a virtual robot. Move AI enables single-camera motion capture with the Move One app, which can be used to generate 3D character animations that can then be exported to OpenUSD and used in Omniverse.

Omniverse users can now build content, experiences and applications that are compatible with other OpenUSD-based spatial computing platforms such as ARKit and RealityKit. Plus, new support for the Khronos Group’s OpenXR open standard expands Omniverse use to more headsets from manufacturers such as HTC VIVE, Magic Leap and Varjo.

Users of SideFX Houdini can also now load Houdini Digital Assets directly into the Omniverse viewport, making Houdini-based connected workflows more seamless. The Cesium extension for Omniverse, called Cesium for Omniverse, enables 3D Tiles, an open standard for streaming massive geospatial datasets in virtual worlds, including those supported by OpenUSD. CGI.Backgrounds now has several ultra-high-definition HDRi maps available in USD Composer. The Cadence DataCenter Design Software™, now available via Omniverse, helps users see computational fluid dynamics simulations in the complete context of their digital twin. With the Cadence data center extension, users can plan, test and validate design and operational considerations before implementing them. And the Blackshark.AI world digital twin platform is now connected to Omniverse.

Customers Using Omniverse for Digitalization
Customers are using Omniverse for tasks ranging from simulating robots to training AI models and improving animation.

Boston Dynamics AI Institute is using Omniverse to simulate robots and their interactions to enable the design of novel robotics and control systems. Continental, one of the leading companies in automotive and industrialization of autonomous systems, is using Omniverse in its mobile robots business to generate physically accurate synthetic data at scale to train computer-vision AI models and perform system-integration testing.

Volvo Cars has transitioned its digital twin to be OpenUSD-based, using Omniverse to create immersive visualizations to help customers make online purchasing decisions.

Marks Design, a brand design and experience agency, is using Omniverse and OpenUSD to streamline collaboration and improve its animation, visualization and rendering workflows.

New Omniverse Systems and Partners
NVIDIA is collaborating with global systems manufacturers to bring RTX workstations optimally configured for Omniverse to millions of designers, architects and engineers. The new systems feature up to four NVIDIA RTX 6000 Ada Generation GPUs, bundled with NVIDIA Omniverse Enterprise software, to accelerate OpenUSD world-building, generative AI-enhanced collaborative design and other industrial digitalization applications.

Omniverse users can also take advantage of the new NVIDIA L40S GPU, a powerful, universal data center GPU that accelerates the most graphics-intensive workloads.

Availability
The latest Omniverse release is now available in beta to download for free and coming soon to Omniverse Enterprise.

Learn more about NVIDIA Omniverse and watch NVIDIA CEO Jensen Huang’s SIGGRAPH keynote address on demand.

About NVIDIA
Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling industrial digitalization across markets. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry. More information at https://nvidianews.nvidia.com/.

For further information, contact:
Kasia Johnston
NVIDIA Corporation
+1-415-813-8859
kasiaj@nvidia.com

Certain statements in this press release, including, but not limited to, statements as to: the benefits, impact, performance, features and availability of our products, services and technologies, including NVIDIA Omniverse, Omniverse Kit, NVIDIA Omniverse Audio2Face, NVIDIA Ada Lovelace, NVIDIA RTX GPUs, Omniverse USD Composer, Omniverse Cloud APIs, and NVIDIA L40S GPU; industrial enterprises racing to digitalize their workflows, increasing the demand for OpenUSD-enabled, connected, interoperable, 3D software ecosystems; the impact of NVIDIA’s Omniverse collaborations with third parties; and customers using Omniverse are forward-looking statements that are subject to risks and uncertainties that could cause results to be materially different than expectations. Important factors that could cause actual results to differ materially include: global economic conditions; our reliance on third parties to manufacture, assemble, package and test our products; the impact of technological development and competition; development of new products and technologies or enhancements to our existing product and technologies; market acceptance of our products or our partners' products; design, manufacturing or software defects; changes in consumer preferences or demands; changes in industry standards and interfaces; unexpected loss of performance of our products or technologies when integrated into systems; as well as other factors detailed from time to time in the most recent reports NVIDIA files with the Securities and Exchange Commission, or SEC, including, but not limited to, its annual report on Form 10-K and quarterly reports on Form 10-Q. Copies of reports filed with the SEC are posted on the company's website and are available from NVIDIA without charge. These forward-looking statements are not guarantees of future performance and speak only as of the date hereof, and, except as required by law, NVIDIA disclaims any obligation to update these forward-looking statements to reflect future events or circumstances.

© 2023 NVIDIA Corporation. All rights reserved. NVIDIA, the NVIDIA logo, NVIDIA Omniverse, NVIDIA Omniverse Audio2Face, and NVIDIA RTX are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability, and specifications are subject to change without notice.

A photo accompanying this announcement is available at https://www.globenewswire.com/NewsRoom/AttachmentNg/d5f1b7bb-3109-4c9b-bd99-f0abb73c30d9

FAQ

What is the latest release of NVIDIA Omniverse?

The latest release of NVIDIA Omniverse includes new applications and services for developers and industrial enterprises.

What are the key improvements in Omniverse Kit?

The key improvements in Omniverse Kit include new modular app building, developer templates and resources, boosted efficiency and user experience, and native RTX-powered spatial integration.

What is the collaboration between NVIDIA and Adobe?

NVIDIA and Adobe have expanded their collaboration to make Adobe Firefly available as APIs in Omniverse, enabling enhanced design processes.

What are the new connections enabled by OpenUSD?

The new connections enabled by OpenUSD include Adobe Substance 3D, Wonder Dynamics, Convai, Inworld AI, and more.

Is the latest release of Omniverse available for download?

Yes, the latest release of Omniverse is now available in beta for free download.