NVIDIA Launches AI Foundation Models for RTX AI PCs
NVIDIA has announced foundation models for RTX AI PCs, introducing NVIDIA NIM microservices and AI Blueprints. The new GeForce RTX 50 Series GPUs feature up to 3,352 trillion operations per second of AI performance and 32GB of VRAM, with FP4 compute support that doubles AI inference performance compared to previous generations.
The company will release NIM microservices for RTX AI PCs from developers including Black Forest Labs, Meta, Mistral, and Stability AI. These services support various AI applications including language models, image generation, and computer vision. NVIDIA also unveiled Project R2X, a vision-enabled PC avatar, and introduced AI Blueprints for tasks like podcast creation from PDFs and 3D-guided image generation.
NIM microservices and AI Blueprints will be available from February, initially supporting GeForce RTX 50 Series, RTX 4090 and 4080, and RTX 6000 and 5000 professional GPUs. Major PC manufacturers including Acer, ASUS, Dell, and others will offer NIM-ready RTX AI PCs.
NVIDIA ha annunciato modelli fondamentali per PC RTX AI, presentando NVIDIA NIM microservizi e AI Blueprints. Le nuove GPU GeForce RTX 50 Series offrono fino a 3.352 trilioni di operazioni al secondo di prestazioni AI e 32GB di VRAM, con supporto per il calcolo FP4 che raddoppia le performance di inferenza AI rispetto alle generazioni precedenti.
L'azienda rilascerà microservizi NIM per PC RTX AI da sviluppatori come Black Forest Labs, Meta, Mistral e Stability AI. Questi servizi supportano varie applicazioni AI tra cui modelli linguistici, generazione di immagini e visione artificiale. NVIDIA ha anche svelato il Progetto R2X, un avatar per PC abilitato alla visione, e ha introdotto AI Blueprints per compiti come la creazione di podcast da PDF e generazione di immagini 3D guidate.
I microservizi NIM e gli AI Blueprints saranno disponibili da febbraio, inizialmente supportando le GeForce RTX 50 Series, RTX 4090 e 4080, e le GPU professionali RTX 6000 e 5000. I principali produttori di PC, tra cui Acer, ASUS, Dell e altri, offriranno PC RTX AI pronti per NIM.
NVIDIA ha anunciado modelos fundamentales para PCs RTX AI, presentando NVIDIA NIM microservicios y AI Blueprints. Las nuevas GPU GeForce RTX 50 Series cuentan con hasta 3.352 billones de operaciones por segundo de rendimiento AI y 32GB de VRAM, con soporte de cómputo FP4 que duplica el rendimiento de inferencia AI en comparación con generaciones anteriores.
La compañía lanzará microservicios NIM para PCs RTX AI de desarrolladores como Black Forest Labs, Meta, Mistral y Stability AI. Estos servicios respaldan diversas aplicaciones de IA, incluidos modelos de lenguaje, generación de imágenes y visión por computadora. NVIDIA también reveló el Proyecto R2X, un avatar de PC habilitado para visión, e introdujo AI Blueprints para tareas como la creación de podcasts a partir de PDFs y generación de imágenes en 3D guiadas.
Los microservicios NIM y los AI Blueprints estarán disponibles a partir de febrero, apoyando inicialmente las GeForce RTX 50 Series, RTX 4090 y 4080, y las GPU profesionales RTX 6000 y 5000. Principales fabricantes de PC, incluidos Acer, ASUS, Dell y otros, ofrecerán PCs RTX AI listos para NIM.
NVIDIA는 RTX AI PC를 위한 기본 모델을 발표하며, NVIDIA NIM 마이크로서비스와 AI Blueprints를 소개했습니다. 새로운 GeForce RTX 50 시리즈 GPU는 최대 3,352 조 작업을 초당 처리할 수 있는 AI 성능과 함께 32GB VRAM을 제공하며, FP4 계산 지원을 통해 이전 세대 대비 AI 추론 성능이 두 배로 향상되었습니다.
이 회사는 Black Forest Labs, Meta, Mistral, Stability AI와 같은 개발자들의 RTX AI PC를 위한 NIM 마이크로서비스를 출시할 예정입니다. 이 서비스는 언어 모델, 이미지 생성, 컴퓨터 비전 등 다양한 AI 응용 프로그램을 지원합니다. NVIDIA는 또한 시각 기능이 포함된 PC 아바타인 R2X 프로젝트를 공개하고 PDF에서 팟캐스트 생성 및 3D 가이드를 통한 이미지 생성을 위한 AI Blueprints를 도입했습니다.
NIM 마이크로서비스와 AI Blueprints는 2월부터 사용할 수 있으며, 초기에는 GeForce RTX 50 시리즈, RTX 4090 및 4080, 그리고 RTX 6000 및 5000 전문 GPU를 지원합니다. Acer, ASUS, Dell 등을 포함한 주요 PC 제조업체들이 NIM 준비가 완료된 RTX AI PC를 제공할 것입니다.
NVIDIA a annoncé des modèles fondamentaux pour les PC RTX AI, présentant les NVIDIA NIM microservices et AI Blueprints. Les nouvelles GPU GeForce RTX 50 Series atteignent jusqu'à 3 352 trillions d'opérations par seconde de performance AI et 32 Go de VRAM, avec un support de calcul FP4 qui double les performances d'inférence AI par rapport aux générations précédentes.
La société lancera des microservices NIM pour les PC RTX AI développés par des entreprises telles que Black Forest Labs, Meta, Mistral et Stability AI. Ces services prennent en charge diverses applications AI, notamment les modèles linguistiques, la génération d'images et la vision par ordinateur. NVIDIA a également dévoilé le Project R2X, un avatar PC avec capacités de vision, et a présenté les AI Blueprints pour des tâches telles que la création de podcasts à partir de fichiers PDF et la génération d'images 3D guidées.
Les microservices NIM et les AI Blueprints seront disponibles à partir de février, en prenant en charge initialement les GeForce RTX 50 Series, RTX 4090 et 4080, ainsi que les GPU professionnels RTX 6000 et 5000. Les principaux fabricants de PC, y compris Acer, ASUS, Dell et d'autres, proposeront des PC RTX AI prêts pour NIM.
NVIDIA hat grundlegende Modelle für RTX AI-PCs angekündigt und NVIDIA NIM Mikroservices sowie AI Blueprints vorgestellt. Die neuen GeForce RTX 50 Series GPUs bieten bis zu 3,352 Billionen Operationen pro Sekunde an AI-Leistung und 32GB VRAM, mit FP4-Compute-Unterstützung, die die AI-Inferenzleistung im Vergleich zu früheren Generationen verdoppelt.
Das Unternehmen wird NIM-Mikroservices für RTX AI-PCs von Entwicklern wie Black Forest Labs, Meta, Mistral und Stability AI bereitstellen. Diese Dienste unterstützen verschiedene AI-Anwendungen, darunter Sprachmodelle, Bildgenerierung und Computer Vision. NVIDIA stellte auch das Projekt R2X vor, einen visionfähigen PC-Avatar, und führte AI Blueprints für Aufgaben wie die Erstellung von Podcasts aus PDFs und die 3D-gesteuerte Bildgenerierung ein.
NIM-Mikroservices und AI Blueprints werden ab Februar verfügbar sein, zunächst für die GeForce RTX 50 Series, RTX 4090 und 4080 sowie die professionellen GPUs RTX 6000 und 5000. Große PC-Hersteller, darunter Acer, ASUS, Dell und andere, werden NIM-fähige RTX AI-PCs anbieten.
- New RTX 50 Series GPUs deliver 3,352 trillion operations per second of AI performance
- FP4 compute support doubles AI inference performance vs previous generation
- Partnerships with major AI model developers (Meta, Mistral, Stability AI)
- Wide adoption from major PC manufacturers for NIM-ready RTX AI PCs
- initial hardware support for NIM microservices
- Requires Windows Subsystem for Linux (WSL) for operation
Insights
NVIDIA's launch of NIM microservices represents a paradigm shift in consumer AI computing. The new RTX 50 Series GPUs' FP4 compute capability and 32GB VRAM configuration marks a 2x improvement in AI inference performance, enabling complex AI models to run locally with smaller memory footprints. This positions NVIDIA to dominate the emerging AI PC market.
The strategic integration with Windows 11 and major PC manufacturers ensures widespread adoption, while partnerships with model developers like Meta and Mistral create a robust AI ecosystem. The 3,352 trillion operations per second processing capability is particularly impressive, as it brings data center-level AI performance to consumer devices.
Project R2X's neural rendering and Audio2Face-3D technology demonstrates NVIDIA's commitment to pushing AI visualization boundaries, while maintaining compatibility with major AI services like GPT4 and Grok indicates strong ecosystem integration potential.
This product launch strengthens NVIDIA's competitive moat in the AI hardware market. By creating an end-to-end ecosystem from hardware to software services, NVIDIA is effectively raising barriers to entry for competitors while increasing customer lock-in. The partnership with major PC manufacturers ensures broad market penetration and positions NVIDIA to capture significant market share in the emerging AI PC segment.
The timing is particularly strategic, coinciding with growing demand for local AI processing capabilities. The inclusion of industry-standard frameworks and compatibility with popular AI development tools suggests strong potential for developer adoption, which historically has been a key driver of NVIDIA's success.
This launch could significantly impact NVIDIA's revenue streams by creating new monetization opportunities through NIM microservices and expanding their GPU market share. The partnership with every major PC manufacturer suggests potential for substantial unit sales growth. The ability to run complex AI models locally addresses privacy concerns and could accelerate enterprise adoption.
The comprehensive ecosystem approach, combining hardware, software and services, positions NVIDIA to capture value across the entire AI computing stack. This vertical integration strategy has historically yielded higher margins and more sustainable revenue streams compared to pure hardware sales.
NVIDIA NIM Microservices and AI Blueprints Help Developers and Enthusiasts Build AI Agents and Creative Workflows on PC
LAS VEGAS, Jan. 06, 2025 (GLOBE NEWSWIRE) -- CES -- NVIDIA today announced foundation models running locally on NVIDIA RTX™ AI PCs that supercharge digital humans, content creation, productivity and development.
These models — offered as NVIDIA NIM™ microservices — are accelerated by new GeForce RTX™ 50 Series GPUs, which feature up to 3,352 trillion operations per second of AI performance and 32GB of VRAM. Built on the NVIDIA Blackwell architecture, RTX 50 Series are the first consumer GPUs to add support for FP4 compute, boosting AI inference performance by 2x and enabling generative AI models to run locally in a smaller memory footprint, compared with previous-generation hardware.
GeForce™ has long been a vital platform for AI developers. The first GPU-accelerated deep learning network, AlexNet, was trained on the GeForce GTX™ 580 in 2012 — and last year, over
Now, with generative AI and RTX AI PCs, anyone can be a developer. A new wave of low-code and no-code tools, such as AnythingLLM, ComfyUI, Langflow and LM Studio, enable enthusiasts to use AI models in complex workflows via simple graphical user interfaces.
NIM microservices connected to these GUIs will make it effortless to access and deploy the latest generative AI models. NVIDIA AI Blueprints, built on NIM microservices, provide easy-to-use, preconfigured reference workflows for digital humans, content creation and more.
To meet the growing demand from AI developers and enthusiasts, every top PC manufacturer and system builder is launching NIM-ready RTX AI PCs with GeForce RTX 50 Series GPUs.
“AI is advancing at light speed, from perception AI to generative AI and now agentic AI,” said Jensen Huang, founder and CEO of NVIDIA. “NIM microservices and AI Blueprints give PC developers and enthusiasts the building blocks to explore the magic of AI.”
Making AI NIMble
Foundation models — neural networks trained on immense amounts of raw data — are the building blocks for generative AI.
NVIDIA will release a pipeline of NIM microservices for RTX AI PCs from top model developers such as Black Forest Labs, Meta, Mistral and Stability AI. Use cases span large language models (LLMs), vision language models, image generation, speech, embedding models for retrieval-augmented generation (RAG), PDF extraction and computer vision.
“GeForce RTX 50 Series GPUs with FP4 compute will unlock a massive range of models that can run on PC, which were previously limited to large data centers,” said Robin Rombach, CEO of Black Forest Labs. “Making FLUX an NVIDIA NIM microservice increases the rate at which AI can be deployed and experienced by more users, while delivering incredible performance.”
NVIDIA today also announced the Llama Nemotron family of open models that provide high accuracy on a wide range of agentic tasks. The Llama Nemotron Nano model will be offered as a NIM microservice for RTX AI PCs and workstations, and excels at agentic AI tasks like instruction following, function calling, chat, coding and math.
NIM microservices include the key components for running AI on PCs and are optimized for deployment across NVIDIA GPUs — whether in RTX PCs and workstations or in the cloud.
Developers and enthusiasts will be able to quickly download, set up and run these NIM microservices on Windows 11 PCs with Windows Subsystem for Linux (WSL).
“AI is driving Windows 11 PC innovation at a rapid rate, and Windows Subsystem for Linux (WSL) offers a great cross-platform environment for AI development on Windows 11 alongside Windows Copilot Runtime,” said Pavan Davuluri, corporate vice president of Windows at Microsoft. “NVIDIA NIM microservices, optimized for Windows PCs, give developers and enthusiasts ready-to-integrate AI models for their Windows apps, further accelerating deployment of AI capabilities to Windows users.”
The NIM microservices, running on RTX AI PCs, will be compatible with top AI development and agent frameworks, including AI Toolkit for VSCode, AnythingLLM, ComfyUI, CrewAI, Flowise AI, LangChain, Langflow and LM Studio. Developers can connect applications and workflows built on these frameworks to AI models running NIM microservices through industry-standard endpoints, enabling them to use the latest technology with a unified interface across the cloud, data centers, workstations and PCs.
Enthusiasts will also be able to experience a range of NIM microservices using an upcoming release of the NVIDIA ChatRTX tech demo.
Putting a Face on Agentic AI
To demonstrate how enthusiasts and developers can use NIM to build AI agents and assistants, NVIDIA today previewed Project R2X, a vision-enabled PC avatar that can put information at a user’s fingertips, assist with desktop apps and video conference calls, read and summarize documents, and more.
The avatar is rendered using NVIDIA RTX Neural Faces, a new generative AI algorithm that augments traditional rasterization with entirely generated pixels. The face is then animated by a new diffusion-based NVIDIA Audio2Face™-3D model that improves lip and tongue movement. R2X can be connected to cloud AI services such as OpenAI’s GPT4o and xAI’s Grok, and NIM microservices and AI Blueprints, such as PDF retrievers or alternative LLMs, via developer frameworks such as CrewAI, Flowise AI and Langflow. Sign up for Project R2X updates.
AI Blueprints Coming to PC
NIM microservices are also available to PC users through AI Blueprints — reference AI workflows that can run locally on RTX PCs. With these blueprints, developers can create podcasts from PDF documents, generate stunning images guided by 3D scenes and more.
The blueprint for PDF to podcast extracts text, images and tables from a PDF to create a podcast script that can be edited by users. It can also generate a full audio recording from the script using voices available in the blueprint or based on a user’s voice sample. In addition, users can have a real-time conversation with the AI podcast host to learn more about specific topics.
The blueprint uses NIM microservices like Mistral-Nemo-12B-Instruct for language, NVIDIA Riva for text-to-speech and automatic speech recognition, and the NeMo Retriever collection of microservices for PDF extraction.
The AI Blueprint for 3D-guided generative AI gives artists finer control over image generation. While AI can generate amazing images from simple text prompts, controlling image composition using only words can be challenging. With this blueprint, creators can use simple 3D objects laid out in a 3D renderer like Blender to guide AI image generation. The artist can create 3D assets by hand or generate them using AI, place them in the scene and set the 3D viewport camera. Then, a prepackaged workflow powered by the FLUX NIM microservice will use the current composition to generate high-quality images that match the 3D scene.
NVIDIA NIM microservices and AI Blueprints will be available starting in February with initial hardware support for GeForce RTX 50 Series, GeForce RTX 4090 and 4080, and NVIDIA RTX 6000 and 5000 professional GPUs. Additional GPUs will be supported in the future.
NIM-ready RTX AI PCs will be available from Acer, ASUS, Dell, GIGABYTE, HP, Lenovo, MSI, Razer and Samsung, and from local system builders Corsair, Falcon Northwest, LDLC, Maingear, Mifcon, Origin PC, PCS and Scan.
Learn more about how NIM microservices, AI Blueprints and NIM-ready RTX AI PCs are accelerating generative AI by joining NVIDIA at CES.
About NVIDIA
NVIDIA (NASDAQ: NVDA) is the world leader in accelerated computing.
For further information, contact:
Jordan Dodge
NVIDIA Corporation
+1-408-566-6792
jdodge@nvidia.com
Certain statements in this press release including, but not limited to, statements as to: the benefits, impact, performance, and availability of our products, services, and technologies, including NVIDIA RTX AI PCs, GeForce RTX 50 Series GPUs, NVIDIA Blackwell architecture, GeForce GTX 580, Project R2X, NVIDIA ACE and NIM microservices, NVIDIA AI Blueprints, NVIDIA Grace Blackwell platform, Llama Nemotron, NVIDIA ChatRTX, NVIDIA RTX Neural Faces, NVIDIA Audio2Face-3D model, Mistral-Nemo-12B-Instruct for language, NVIDIA Riva, NeMo Retriever, FLUX NIM microservice, GeForce RTX 4090 and 4080, and NVIDIA RTX 6000 and 5000 professional GPUs third parties using or adopting NVIDIA’s products and technologies, and the benefits and impact thereof; and AI advancing at light speed, from perception AI to generative AI and now agentic AI are forward-looking statements that are subject to risks and uncertainties that could cause results to be materially different than expectations. Important factors that could cause actual results to differ materially include: global economic conditions; our reliance on third parties to manufacture, assemble, package and test our products; the impact of technological development and competition; development of new products and technologies or enhancements to our existing product and technologies; market acceptance of our products or our partners' products; design, manufacturing or software defects; changes in consumer preferences or demands; changes in industry standards and interfaces; unexpected loss of performance of our products or technologies when integrated into systems; as well as other factors detailed from time to time in the most recent reports NVIDIA files with the Securities and Exchange Commission, or SEC, including, but not limited to, its annual report on Form 10-K and quarterly reports on Form 10-Q. Copies of reports filed with the SEC are posted on the company's website and are available from NVIDIA without charge. These forward-looking statements are not guarantees of future performance and speak only as of the date hereof, and, except as required by law, NVIDIA disclaims any obligation to update these forward-looking statements to reflect future events or circumstances.
Many of the products and features described herein remain in various stages and will be offered on a when-and-if-available basis. The statements above are not intended to be, and should not be interpreted as a commitment, promise, or legal obligation, and the development, release, and timing of any features or functionalities described for our products is subject to change and remains at the sole discretion of NVIDIA. NVIDIA will have no liability for failure to deliver or delay in the delivery of any of the products, features, or functions set forth herein.
© 2025 NVIDIA Corporation. All rights reserved. NVIDIA, the NVIDIA logo, NVIDIA, the NVIDIA logo, Audio2Face, GeForce, GeForce GTX, GeForce RTX, NVIDIA NIM and NVIDIA RTX are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated. Features, pricing, availability and specifications are subject to change without notice.
A photo accompanying this announcement is available at https://www.globenewswire.com/NewsRoom/AttachmentNg/f27d7e96-dcae-467b-a5e5-adfdff0fd67d
FAQ
When will NVIDIA NIM microservices and AI Blueprints be available for RTX AI PCs?
What performance improvements do the new RTX 50 Series GPUs offer for AI tasks?
Which GPU models will support NVIDIA NIM microservices initially?
What companies are partnering with NVIDIA for NIM microservices?
What features does Project R2X offer for RTX AI PC users?
