NVIDIA Announces Generative AI Models and NIM Microservices for OpenUSD Language, Geometry, Physics and Materials
NVIDIA has announced major advancements to Universal Scene Description (OpenUSD), expanding its adoption in robotics, industrial design, and engineering. The company introduced NVIDIA NIM microservices for AI models that can generate OpenUSD language, code, and apply materials to 3D objects. These services aim to accelerate digital twin development and enhance 3D workflows.
Key offerings include:
- USD Code NIM microservice for generating OpenUSD-Python code
- USD Search NIM microservice for searching OpenUSD libraries
- USD Validate NIM microservice for file compatibility checks
- New USD connectors for robotics data formats
- Tools for streaming OpenUSD scenes to Apple Vision Pro
NVIDIA is collaborating with Siemens to integrate OpenUSD pipelines with Simcenter simulation technologies. The company also released the OpenUSD Exchange SDK for developers to build custom USD data connectors.
NVIDIA ha annunciato importanti sviluppi per Universal Scene Description (OpenUSD), ampliando la sua adozione nella robotica, nel design industriale e nell'ingegneria. L'azienda ha introdotto i microservizi NVIDIA NIM per modelli di intelligenza artificiale in grado di generare linguaggio OpenUSD, codice e applicare materiali a oggetti 3D. Questi servizi mirano ad accelerare lo sviluppo di gemelli digitali e migliorare i flussi di lavoro 3D.
Le principali offerte includono:
- Microservizio USD Code NIM per generare codice OpenUSD-Python
- Microservizio USD Search NIM per cercare librerie OpenUSD
- Microservizio USD Validate NIM per controlli di compatibilità dei file
- Nuovi connettori USD per formati di dati robotici
- Strumenti per streaming di scene OpenUSD su Apple Vision Pro
NVIDIA sta collaborando con Siemens per integrare i pipeline OpenUSD con le tecnologie di simulazione Simcenter. L'azienda ha anche rilasciato l'SDK OpenUSD Exchange per gli sviluppatori per costruire connettori di dati USD personalizzati.
NVIDIA ha anunciado importantes avances en Universal Scene Description (OpenUSD), aumentando su adopción en robótica, diseño industrial e ingeniería. La compañía presentó microservicios NVIDIA NIM para modelos de IA que pueden generar lenguaje OpenUSD, código y aplicar materiales a objetos 3D. Estos servicios tienen como objetivo acelerar el desarrollo de gemelos digitales y mejorar los flujos de trabajo 3D.
Las ofertas clave incluyen:
- Microservicio USD Code NIM para la generación de código OpenUSD-Python
- Microservicio USD Search NIM para buscar bibliotecas OpenUSD
- Microservicio USD Validate NIM para comprobaciones de compatibilidad de archivos
- Nuevos conectores USD para formatos de datos robóticos
- Herramientas para transmitir escenas OpenUSD a Apple Vision Pro
NVIDIA está colaborando con Siemens para integrar los pipelines de OpenUSD con las tecnologías de simulación Simcenter. La compañía también lanzó el SDK OpenUSD Exchange para que los desarrolladores puedan construir conectores de datos USD personalizados.
NVIDIA는 Universal Scene Description (OpenUSD)에 대한 주요 발전을 발표하며 로봇 공학, 산업 디자인 및 엔지니어링에서의 채택을 확대했습니다. 이 회사는 AI 모델을 위한 NVIDIA NIM 마이크로서비스를 도입하여 OpenUSD 언어, 코드 생성을 지원하고 3D 객체에 소재를 적용할 수 있습니다. 이 서비스는 디지털 트윈 개발을 가속화하고 3D 워크플로우를 향상시키기 위해 설계되었습니다.
주요 서비스로는:
- OpenUSD-Python 코드를 생성하기 위한 USD Code NIM 마이크로서비스
- OpenUSD 라이브러리를 검색하기 위한 USD Search NIM 마이크로서비스
- 파일 호환성 검사를 위한 USD Validate NIM 마이크로서비스
- 로봇 데이터 형식을 위한 새로운 USD 커넥터
- Apple Vision Pro에 OpenUSD 장면을 스트리밍하기 위한 도구
NVIDIA는 Siemens와 협력하여 Simcenter 시뮬레이션 기술과 OpenUSD 파이프라인을 통합하고 있습니다. 또한, 개발자가 맞춤형 USD 데이터 커넥터를 구축할 수 있도록 OpenUSD Exchange SDK를 출시했습니다.
NVIDIA a annoncé des avancées majeures concernant Universal Scene Description (OpenUSD), élargissant son adoption dans la robotique, le design industriel et l'ingénierie. L'entreprise a présenté des microservices NVIDIA NIM pour des modèles d'IA capables de générer du langage OpenUSD, du code et d'appliquer des matériaux à des objets 3D. Ces services visent à accélérer le développement des jumeaux numériques et à améliorer les workflows 3D.
Les principales offres comprennent :
- Microservice USD Code NIM pour générer du code OpenUSD-Python
- Microservice USD Search NIM pour rechercher des bibliothèques OpenUSD
- Microservice USD Validate NIM pour des vérifications de compatibilité des fichiers
- Nouveaux connecteurs USD pour des formats de données robotiques
- Outils pour le streaming de scènes OpenUSD vers Apple Vision Pro
NVIDIA collabore avec Siemens pour intégrer les pipelines OpenUSD avec les technologies de simulation Simcenter. L'entreprise a également publié l'SDK OpenUSD Exchange pour permettre aux développeurs de créer des connecteurs de données USD personnalisés.
NVIDIA hat bedeutende Fortschritte bei Universal Scene Description (OpenUSD) angekündigt und dessen Einsatz in der Robotik, im Industriedesign und im Ingenieurwesen ausgeweitet. Das Unternehmen stellte NVIDIA NIM-Microservices für KI-Modelle vor, die OpenUSD-Sprache, -Code generieren und Materialien auf 3D-Objekte anwenden können. Diese Dienste zielen darauf ab, die Entwicklung digitaler Zwillinge zu beschleunigen und die 3D-Workflows zu verbessern.
Zu den wichtigsten Angeboten gehören:
- USD Code NIM-Microservice zur Generierung von OpenUSD-Python-Code
- USD Search NIM-Microservice zur Durchsuchung von OpenUSD-Bibliotheken
- USD Validate NIM-Microservice zur Überprüfung der Dateikompatibilität
- Neue USD-Connectoren für roboterspezifische Datenformate
- Tools zum Streaming von OpenUSD-Szenen zu Apple Vision Pro
NVIDIA arbeitet mit Siemens zusammen, um OpenUSD-Pipelines mit Simcenter-Simulationstechnologien zu integrieren. Das Unternehmen hat auch das OpenUSD Exchange SDK veröffentlicht, damit Entwickler benutzerdefinierte USD-Daten-Connectoren erstellen können.
- Introduction of NVIDIA NIM microservices for AI models to generate OpenUSD language and code
- Expansion of OpenUSD adoption to robotics, industrial design, and engineering sectors
- Collaboration with Siemens to integrate OpenUSD pipelines with Simcenter simulation technologies
- Release of OpenUSD Exchange SDK for custom USD data connector development
- New tools for streaming OpenUSD scenes to Apple Vision Pro
- None.
NVIDIA's announcement of generative AI models and NIM microservices for OpenUSD marks a significant leap in 3D data interchange and virtual world development. This move is highly impactful for NVIDIA's position in the AI and graphics industry.
The introduction of USD Code, USD Search and USD Validate NIM microservices in preview, along with upcoming services like USD Layout and USD SmartMaterial, demonstrates NVIDIA's commitment to expanding OpenUSD's capabilities. These tools will likely accelerate adoption across industries, particularly in manufacturing, automotive and robotics sectors.
The collaboration with Siemens to integrate OpenUSD pipelines with Simcenter portfolio is a strategic move, potentially opening up new revenue streams in industrial automation. Additionally, the new connector from Unified Robotics Description Format to OpenUSD could significantly boost NVIDIA's presence in the robotics market.
The ability to stream OpenUSD scenes to Apple Vision Pro via NVIDIA Graphics Delivery Network is a smart cross-platform play, potentially increasing NVIDIA's reach in the burgeoning AR/VR market.
Overall, this announcement positions NVIDIA as a key player in the future of 3D content creation and industrial digital twins, which could drive long-term growth and maintain its competitive edge in the AI and graphics processing market.
NVIDIA's latest announcements regarding OpenUSD and generative AI models have significant financial implications. While specific revenue projections aren't provided, the potential market impact is substantial.
The expansion into industrial sectors like manufacturing, automotive and robotics through OpenUSD enhancements could diversify NVIDIA's revenue streams. The company's GPU technology is already dominant in these areas and this software push could lead to increased hardware sales and potential licensing revenues.
Collaborations with industry giants like Foxconn and WPP demonstrate the real-world applicability and demand for NVIDIA's technology. Foxconn's use of NIM microservices for digital twin creation could pave the way for large-scale adoption in the manufacturing sector, potentially leading to significant contracts.
The partnership with Siemens, a leader in industrial automation, is particularly noteworthy. Integration of OpenUSD with Siemens' Simcenter portfolio could open up new market opportunities in industrial simulation, a high-value sector.
NVIDIA's involvement in the Alliance for OpenUSD (AOUSD) alongside tech giants like Apple, Adobe and Autodesk positions the company at the forefront of 3D content standards. This could lead to long-term market dominance and recurring revenue from related products and services.
While the financial impact may not be immediate, these developments strengthen NVIDIA's long-term growth prospects and could contribute to maintaining its high valuation in the stock market.
NVIDIA's announcement signals a significant shift in the 3D content creation and industrial simulation markets. The introduction of generative AI models for OpenUSD development could revolutionize how industries approach digital twin creation and virtual world building.
The market for digital twins is projected to grow from
The collaboration with Siemens is particularly noteworthy, as it opens up opportunities in the industrial automation software market, valued at
NVIDIA's expansion into robotics through the new USD connector could also prove lucrative, with the global robotics market projected to grow from
The company's ability to stream OpenUSD scenes to Apple Vision Pro demonstrates foresight in tapping into the AR/VR market, expected to reach
These moves collectively strengthen NVIDIA's position across multiple high-growth markets, potentially driving significant revenue growth and market share expansion in the coming years.
New Services Accelerate Universal Scene Description-Based Workflows and Development of Industrial Digital Twins and Robotics
DENVER, July 29, 2024 (GLOBE NEWSWIRE) -- SIGGRAPH—NVIDIA today announced major advancements to Universal Scene Description, or OpenUSD, that will expand adoption of the universal 3D data interchange framework to robotics, industrial design and engineering, and accelerate developers’ abilities to build highly accurate virtual worlds for the next evolution of AI.
Through new OpenUSD-based generative AI and NVIDIA-accelerated development frameworks built on the NVIDIA Omniverse™ platform, more industries can now develop applications for visualizing industrial design and engineering projects, and for simulating environments to build the next wave of physical AI and robots.
The new offerings include NVIDIA NIM™ microservices for AI models that can generate OpenUSD language to answer user queries, generate OpenUSD Python code, apply materials to 3D objects, and understand 3D space and physics to help accelerate digital twin development. In addition, new USD connectors to robotics and industrial simulation data formats and developer tools let users stream massive, fully NVIDIA RTX™ ray-traced datasets to Apple Vision Pro.
“The generative AI boom for heavy industries is here,” said Rev Lebaredian, vice president of Omniverse and simulation technology at NVIDIA. “Until recently, digital worlds have been primarily used by creative industries; now, with the enhancements and accessibility NVIDIA NIM microservices are bringing to OpenUSD, industries of all kinds can build physically based virtual worlds and digital twins to drive innovation while preparing for the next wave of AI: robotics.”
Generative AI Comes to USD With NVIDIA NIM
The world’s first generative AI models for OpenUSD development, developed by NVIDIA, will be available as NVIDIA NIM microservices. The models enable developers to incorporate generative AI copilots and agents into USD workflows, broadening the possibilities in 3D worlds and helping speed the adoption of USD across a new range of industrial sectors, like manufacturing, automotive and robotics.
The microservices available in preview are:
- USD Code NIM microservice — answers general knowledge OpenUSD questions and automatically generates OpenUSD-Python code based on text prompts that can then be inputted into an OpenUSD viewing app, such as usdview from Pixar, or an NVIDIA Omniverse Kit-based application to visualize the corresponding 3D data.
- USD Search NIM microservice — enables developers to search through massive libraries of OpenUSD, 3D and image data using natural language or image inputs.
- USD Validate NIM microservice — checks the compatibility of uploaded files against OpenUSD release versions and generates a fully RTX-rendered, path-traced image, powered by NVIDIA Omniverse Cloud APIs, or application programming interfaces.
Newly announced microservices that will be available soon are:
- USD Layout NIM microservice — enables users to assemble OpenUSD-based scenes from a series of text prompts based on spatial intelligence.
- USD SmartMaterial NIM microservice — predicts and applies a realistic material to a computer-aided design object.
- fVDB Mesh Generation NIM microservice — generates an OpenUSD-based mesh, rendered by Omniverse Cloud APIs, from point-cloud data.
- fVDB Physics Super-Res NIM microservice — performs AI super resolution on a frame or sequence of frames to generate an OpenUSD-based, high-resolution physics simulation.
- fVDB NeRF-XL NIM microservice — generates large-scale neural radiance fields in OpenUSD using Omniverse Cloud APIs.
Foxconn, a global manufacturing leader with more than 170 factories worldwide, is already benefiting from NVIDIA’s computing platform, using NIM microservices and Omniverse to create a digital twin of a factory under development.
“Digital twins will help us accelerate the next wave of industrial manufacturing and autonomous machines,” said Zhe Shi, chief digital officer and head of the Smart Manufacturing platform at Foxconn. “NVIDIA Omniverse and the new NIM microservices will democratize the ability to develop digital twins and help our teams build physically based virtual factories faster than ever.”
WPP, a world leader in marketing and communications services company, is an early adopter of USD Search and USD Code NIM microservices, implementing them in its generative AI-enabled content creation pipeline, built on NVIDIA Omniverse, for customers such as The Coca-Cola Company.
“The beauty of the innovation is how compatible it is with the way we work, and that it leverages open standards — accelerating not only future work, but allowing us to continue to build on and extend the usefulness of all our previous investments in standards like OpenUSD,” said Stephan Pretorius, chief technology officer at WPP. “Using NVIDIA NIM microservices with NVIDIA Omniverse has made it possible for us to launch innovative new production tools with companies like The Coca-Cola Company at unprecedented speed.”
USD Connectors Bring Generative AI to More Industries
A series of new USD connectors for robotics data formats and streaming to Apple Vision Pro opens the portals of OpenUSD interoperability and advanced authoring to more industries.
NVIDIA and Siemens, a global leader in industrial automation and software, are extending their collaboration to facilitate more industrial workloads using OpenUSD. Siemens will integrate OpenUSD pipelines with its Simcenter portfolio of simulation technologies to support evidence-based decision-making and collaboration among key stakeholders.
This integration enables high-fidelity, real-time, photorealistic visualization of complex simulation data, providing deeper insights into a product’s performance within its real-world operating environment. The work will build on Siemens’ efforts to incorporate Omniverse into its Teamcenter Product Lifecycle Management portfolio.
NVIDIA also released a connector from Unified Robotics Description Format to OpenUSD, letting roboticists seamlessly bring their robot data across applications, including for design, simulation and reinforcement learning.
To further advance OpenUSD ecosystem expansion, NVIDIA announced the OpenUSD Exchange software development kit, enabling developers to build their own robust OpenUSD data connectors.
New developer tools and APIs to stream large-scale OpenUSD scenes from an application built on the Omniverse platform to Apple Vision Pro via the NVIDIA Graphics Delivery Network are now available in early access.
“OpenUSD is revolutionizing the way we create and interact with 3D content,” said Steve May, chief technology officer of Pixar and chairman of the Alliance for OpenUSD (AOUSD). “Now, with these new services and APIs for OpenUSD built by NVIDIA, we expect to see accelerated growth and adoption of USD, paving the way for new users and industries to more easily engage with our ecosystem.”
OpenUSD Ecosystem Momentum
Last year, NVIDIA cofounded the AOUSD along with Pixar, Adobe, Apple and Autodesk. Through AOUSD, NVIDIA and other collaborators have announced a new OpenUSD release, progress on an OpenUSD core specification and new members.
Availability
The USD Search, USD Code and USD Validate NIM microservices are available in preview on the NVIDIA API catalog. The OpenUSD to URDF connector is now available with NVIDIA Isaac Sim™.
Developers can get started integrating generative AI into OpenUSD workflows with new Omniverse developer tools and a reference workflow for building a generative AI-enabled synthetic data pipeline with OpenUSD.
Learn more about the latest in generative AI and accelerated computing by tuning in to NVIDIA founder and CEO Jensen Huang’s fireside chats at SIGGRAPH, the premier computer graphics conference, running through Aug. 1 in Denver.
About NVIDIA
NVIDIA (NASDAQ: NVDA) is the world leader in accelerated computing.
For further information, contact:
Janette Ciborowski
Corporate Communications
NVIDIA Corporation
+1-734-330-8817
jciborowski@nvidia.com
Certain statements in this press release including, but not limited to, statements as to: the benefits, impact, performance, features, and availability of NVIDIA’s products and technologies, including NVIDIA Omniverse, NVIDIA NIM microservices, NVIDIA RTX, USD Code NIM, USD Search NIM, USD Validate NIM, NVIDIA Omniverse Cloud APIs, USD Layout NIM, USD SmartMaterial NIM, fVDB Mesh Generation NIM, fVDB Physics Super-Res NIM, fVDB NeRF-XL NIM and NVIDIA Graphics Delivery Network; third parties using or adopting NVIDIA products, technologies and platforms, and the benefits and impacts thereof; our collaboration with third parties and the benefits and impacts thereof; with the enhancements and accessibility NVIDIA NIM microservices bringing to OpenUSD, industries of all kinds being able to build physically based virtual worlds and digital twins to drive innovation while preparing for robotics, the next wave of AI; and the impact of OpenUSD are forward-looking statements that are subject to risks and uncertainties that could cause results to be materially different than expectations. Important factors that could cause actual results to differ materially include: global economic conditions; our reliance on third parties to manufacture, assemble, package and test our products; the impact of technological development and competition; development of new products and technologies or enhancements to our existing product and technologies; market acceptance of our products or our partners' products; design, manufacturing or software defects; changes in consumer preferences or demands; changes in industry standards and interfaces; unexpected loss of performance of our products or technologies when integrated into systems; as well as other factors detailed from time to time in the most recent reports NVIDIA files with the Securities and Exchange Commission, or SEC, including, but not limited to, its annual report on Form 10-K and quarterly reports on Form 10-Q. Copies of reports filed with the SEC are posted on the company's website and are available from NVIDIA without charge. These forward-looking statements are not guarantees of future performance and speak only as of the date hereof, and, except as required by law, NVIDIA disclaims any obligation to update these forward-looking statements to reflect future events or circumstances.
Many of the products and features described herein remain in various stages and will be offered on a when-and-if-available basis. The statements above are not intended to be, and should not be interpreted as a commitment, promise, or legal obligation, and the development, release, and timing of any features or functionalities described for our products is subject to change and remains at the sole discretion of NVIDIA. NVIDIA will have no liability for failure to deliver or delay in the delivery of any of the products, features or functions set forth herein.
© 2024 NVIDIA Corporation. All rights reserved. NVIDIA, the NVIDIA logo, NVIDIA NIM, NVIDIA Omniverse and NVIDIA RTX are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability and specifications are subject to change without notice.
A photo accompanying this announcement is available at https://www.globenewswire.com/NewsRoom/AttachmentNg/31900737-5b1a-4c74-afcd-a668fd63cee7
FAQ
What are the new NVIDIA NIM microservices for OpenUSD announced on July 29, 2024?
How is NVIDIA (NVDA) expanding the adoption of OpenUSD in industrial sectors?
What is the OpenUSD Exchange SDK announced by NVIDIA on July 29, 2024?
How is NVIDIA (NVDA) collaborating with Siemens for OpenUSD integration?
