Cerence AI and MediaTek Partner to Introduce Multi-Modal Language Models Running on the Edge, Built on NVIDIA
Cerence Inc. (NASDAQ: CRNC) has announced a strategic partnership with MediaTek and expanded collaboration with NVIDIA to enhance CaLLM™ Edge, their embedded small language model for automotive experiences. The partnership, unveiled at Auto Shanghai 2025, introduces multi-modal capabilities powered by NVIDIA AI Enterprise software.
The collaboration integrates MediaTek's Dimensity Auto Cockpit chipsets with NVIDIA's GPU, AI, and graphics technologies. Key innovations include enhanced in-car intelligence for contextual awareness, exterior environment recognition, and smart guardrailing features optimized for NVIDIA DRIVE AGX. The system enables real-time processing at the edge, reducing cloud bandwidth requirements and costs for OEMs while creating new subscription-based revenue opportunities.
The solution will be demonstrated at Auto Shanghai, showcasing Cerence xUI running on NVIDIA DRIVE AGX in a production-ready automotive reference design that enables personalized interaction for both drivers and passengers.
Cerence Inc. (NASDAQ: CRNC) ha annunciato una partnership strategica con MediaTek e un ampliamento della collaborazione con NVIDIA per potenziare CaLLM™ Edge, il loro modello linguistico di piccole dimensioni integrato per esperienze automotive. La partnership, presentata all'Auto Shanghai 2025, introduce capacità multimodali supportate dal software NVIDIA AI Enterprise.
La collaborazione integra i chipset Dimensity Auto Cockpit di MediaTek con le tecnologie GPU, AI e grafiche di NVIDIA. Le innovazioni principali includono un'intelligenza potenziata a bordo veicolo per la consapevolezza contestuale, il riconoscimento dell'ambiente esterno e funzionalità di smart guardrailing ottimizzate per NVIDIA DRIVE AGX. Il sistema consente l'elaborazione in tempo reale al bordo, riducendo la necessità di banda cloud e i costi per gli OEM, creando al contempo nuove opportunità di ricavi basati su abbonamenti.
La soluzione sarà dimostrata ad Auto Shanghai, mostrando Cerence xUI in esecuzione su NVIDIA DRIVE AGX in un design di riferimento automotive pronto per la produzione, che permette un'interazione personalizzata sia per conducenti che per passeggeri.
Cerence Inc. (NASDAQ: CRNC) ha anunciado una alianza estratégica con MediaTek y una colaboración ampliada con NVIDIA para mejorar CaLLM™ Edge, su modelo de lenguaje pequeño integrado para experiencias automotrices. La asociación, revelada en Auto Shanghai 2025, presenta capacidades multimodales impulsadas por el software NVIDIA AI Enterprise.
La colaboración integra los chipsets Dimensity Auto Cockpit de MediaTek con las tecnologías de GPU, IA y gráficos de NVIDIA. Las innovaciones clave incluyen una inteligencia mejorada dentro del vehículo para la conciencia contextual, reconocimiento del entorno exterior y funciones inteligentes de guardarraíl optimizadas para NVIDIA DRIVE AGX. El sistema permite el procesamiento en tiempo real en el borde, reduciendo los requisitos de ancho de banda en la nube y costos para los OEM, a la vez que crea nuevas oportunidades de ingresos basados en suscripciones.
La solución se demostrará en Auto Shanghai, mostrando Cerence xUI funcionando en NVIDIA DRIVE AGX en un diseño de referencia automotriz listo para producción que permite una interacción personalizada tanto para conductores como para pasajeros.
Cerence Inc. (NASDAQ: CRNC)는 MediaTek과 전략적 파트너십을 발표했으며, NVIDIA와의 협력을 확장하여 자동차 경험을 위한 임베디드 소형 언어 모델인 CaLLM™ Edge를 강화했습니다. 이번 파트너십은 Auto Shanghai 2025에서 공개되었으며, NVIDIA AI Enterprise 소프트웨어가 지원하는 멀티모달 기능을 도입합니다.
이번 협력은 MediaTek의 Dimensity Auto Cockpit 칩셋과 NVIDIA의 GPU, AI, 그래픽 기술을 통합합니다. 주요 혁신으로는 상황 인식을 위한 차량 내 지능 향상, 외부 환경 인식, NVIDIA DRIVE AGX에 최적화된 스마트 가드레일 기능이 포함됩니다. 이 시스템은 엣지에서 실시간 처리를 가능하게 하여 클라우드 대역폭 요구와 OEM 비용을 줄이고, 구독 기반의 새로운 수익 기회를 창출합니다.
이 솔루션은 Auto Shanghai에서 시연될 예정이며, 생산 준비가 완료된 자동차 참조 설계에서 NVIDIA DRIVE AGX 위에 실행되는 Cerence xUI를 통해 운전자와 승객 모두에게 개인화된 상호작용을 제공합니다.
Cerence Inc. (NASDAQ : CRNC) a annoncé un partenariat stratégique avec MediaTek ainsi qu’une collaboration élargie avec NVIDIA pour améliorer CaLLM™ Edge, leur modèle linguistique embarqué de petite taille pour les expériences automobiles. Ce partenariat, dévoilé à Auto Shanghai 2025, introduit des capacités multimodales propulsées par le logiciel NVIDIA AI Enterprise.
La collaboration intègre les chipsets Dimensity Auto Cockpit de MediaTek avec les technologies GPU, IA et graphiques de NVIDIA. Les innovations clés comprennent une intelligence embarquée améliorée pour la conscience contextuelle, la reconnaissance de l’environnement extérieur et des fonctionnalités de garde-fous intelligents optimisées pour NVIDIA DRIVE AGX. Le système permet un traitement en temps réel en périphérie, réduisant les besoins en bande passante cloud et les coûts pour les constructeurs, tout en créant de nouvelles opportunités de revenus basées sur l’abonnement.
La solution sera présentée à Auto Shanghai, mettant en avant Cerence xUI fonctionnant sur NVIDIA DRIVE AGX dans un design de référence automobile prêt pour la production, offrant une interaction personnalisée tant pour les conducteurs que pour les passagers.
Cerence Inc. (NASDAQ: CRNC) hat eine strategische Partnerschaft mit MediaTek angekündigt und die Zusammenarbeit mit NVIDIA erweitert, um CaLLM™ Edge, ihr eingebettetes kleines Sprachmodell für Automotive-Erlebnisse, zu verbessern. Die Partnerschaft, vorgestellt auf der Auto Shanghai 2025, bringt multimodale Fähigkeiten, die durch die NVIDIA AI Enterprise Software unterstützt werden.
Die Zusammenarbeit integriert MediaTeks Dimensity Auto Cockpit-Chipsätze mit NVIDIAs GPU-, KI- und Grafiktechnologien. Zu den wichtigsten Innovationen gehören verbesserte Fahrzeugintelligenz für kontextuelles Bewusstsein, Erkennung der Außenumgebung und intelligente Schutzvorrichtungen, optimiert für NVIDIA DRIVE AGX. Das System ermöglicht Echtzeitverarbeitung am Edge, reduziert die Cloud-Bandbreitenanforderungen und Kosten für OEMs und schafft gleichzeitig neue abonnementbasierte Einnahmemöglichkeiten.
Die Lösung wird auf der Auto Shanghai demonstriert und zeigt Cerence xUI, das auf NVIDIA DRIVE AGX in einem produktionsbereiten Automotive-Referenzdesign läuft, das personalisierte Interaktionen für Fahrer und Passagiere ermöglicht.
- Partnership with major tech players MediaTek and NVIDIA strengthens market position
- Edge processing reduces cloud bandwidth costs for OEMs
- New revenue potential through subscription-based services
- Production-ready solution demonstrates commercial viability
- None.
Insights
Cerence's new multi-modal AI partnership with MediaTek and NVIDIA strengthens its market position and offers significant revenue potential through edge-based processing.
This partnership represents a significant technological advancement for Cerence's CaLLM Edge product, transforming it from a pure language model to a multi-modal system capable of processing visual inputs alongside voice commands. By leveraging MediaTek's Dimensity Auto Cockpit chipsets and NVIDIA's AI technology, Cerence has created an edge-computing solution that reduces cloud dependency while enhancing contextual awareness.
The technical innovations are substantial and address key automotive industry pain points. The system's ability to distinguish between conversations meant for the assistant versus other passengers solves a persistent problem in voice-based car interfaces. Meanwhile, the exterior awareness capabilities enable interpretation of road signs and landmarks—functionality that previously required constant cloud connectivity.
What's technically impressive is the implementation of smart guardrailing at the edge using NVIDIA NeMo Guardrails, ensuring safety-critical functions operate reliably even without connectivity. This edge-focused architecture delivers three key technical advantages:
- Reduced latency for critical interactions
- Lower bandwidth requirements and associated costs
- Enhanced privacy through localized processing
For automakers, the system architecture creates opportunities for tiered subscription services—basic functions can operate on-device while premium features might leverage cloud capabilities, potentially generating recurring revenue streams. The production-ready reference design being demonstrated suggests this isn't merely conceptual but implementation-ready technology.
Cerence's partnership with tech giants MediaTek and NVIDIA creates significant competitive advantage and opens new revenue opportunities in the automotive AI market.
This three-way partnership significantly strengthens Cerence's competitive positioning in the automotive AI market. By aligning with MediaTek and NVIDIA—both industry heavyweights—Cerence gains valuable distribution channels and technological credibility that smaller competitors cannot match. This strategic alliance represents Cerence's most significant business development since becoming independent.
The business model implications are particularly noteworthy. The article explicitly mentions enabling "new subscription-based services and revenue streams for OEMs," which translates to expanded monetization opportunities for Cerence. The company is cleverly positioning itself as both a technology provider and a potential revenue-sharing partner for automakers.
Market timing is excellent. As vehicles become increasingly software-defined, the demand for sophisticated AI assistants that can process multiple input types (voice, vision, sensor data) is growing rapidly. Cerence is addressing this trend with a solution that provides contextual awareness both inside and outside the vehicle.
From a differentiation standpoint, Cerence's approach strikes an intelligent balance between edge and cloud computing. While competitors often emphasize either cloud capabilities or on-device processing, Cerence's hybrid approach offers automakers flexibility while addressing cost concerns through reduced cloud bandwidth requirements.
The debut at Auto Shanghai 2025—one of the world's largest automotive exhibitions—ensures maximum visibility with global OEMs, particularly in the strategically important Chinese market where automotive AI adoption is accelerating rapidly.
Multi-modal models with smart guardrailing at the edge enable more seamless and safer in-car interactions, unlocking powerful capabilities that go far beyond pure infotainment
SHANGHAI and BURLINGTON, Mass., April 23, 2025 (GLOBE NEWSWIRE) -- Just ahead of Auto Shanghai 2025, Cerence Inc. (NASDAQ: CRNC) (“Cerence AI”), a global leader pioneering conversational AI-powered user experiences, today announced a new partnership with MediaTek and expanded collaboration with NVIDIA to deliver the next generation of CaLLM™ Edge, its embedded small language model (SLM) purpose-built for automotive user experiences. With new multi-modal capabilities powered by NVIDIA AI Enterprise software, CaLLM Edge will now make in-car interactions smarter, more perceptive, more human, far safer and more secure than ever. This multi-modal edge SLM is seamlessly integrated into Cerence xUI™, the company’s hybrid cloud/embedded agentic AI platform, and will be showcased for the first time at Auto Shanghai 2025.
Today’s announcement stems from an ongoing collaboration between MediaTek and NVIDIA, with MediaTek’s automotive-grade Dimensity Auto Cockpit chipsets integrating NVIDIA’s GPU, AI, and graphics technologies. Now, the companies have teamed with Cerence AI on a multi-modal edge solution that delivers top performance and cost efficiency for automakers and unlocks powerful new features for drivers and passengers. Leveraging MediaTek’s automotive cockpit solution and optimized first on NVIDIA DRIVE AGX, CaLLM Edge’s advanced multi-modal capabilities are fine-tuned for in-vehicle deployment and high efficiency via a dual processing platform, delivering a new level of contextual awareness – both inside and outside the vehicle.
Auto Shanghai marks the first public demonstration of Cerence xUI running on NVIDIA DRIVE AGX, integrated into a production-ready automotive reference design that replicates a real car’s multi-seat environment, enabling seamless, personalized interaction for drivers and passengers alike. Key innovations include:
- Increased intelligence inside the car – Imagine your car knows when you’re talking to it – and when you’re not. You could ask for recommendations for Italian restaurants, then ask your passenger: “What about the second one?” – and the assistant knows to wait to jump back into the conversation. Plus, the assistant can take direction from driver and passengers at the same time – for example, “Open my window,” followed by “Same for me.” Or, imagine your car can keep an eye on your pet while you run a short errand, or, while you’re driving, answer questions about how your toddler is doing in the back seat.
- Additional context from outside the car – Imagine an assistant that provides information about not only what is inside the vehicle, but also in the world outside. For example, it can explain or translate road signs, identify roadside buildings, and even offer details about something interesting spotted on a billboard. Cerence xUI can leverage car sensor data and both interior and exterior camera feeds in combination with the CaLLM Edge multi-modal SLM, enabling streaming input on the edge – all of which will be shown for the first time at Auto Shanghai.
- Smart guardrailing on the edge – Cerence AI has developed automotive guardrails optimized for NVIDIA DRIVE AGX, helping ensure Cerence-powered systems can safely and reliably handle the nuances of brand-specific in-car interaction, even in conditions with limited connectivity. As part of its comprehensive hybrid architecture, Cerence AI will be delivering this embedded guardrail with NVIDIA NeMo Guardrails, both to complement its cloud variant as well as help minimize distractions, prevent misuse, and ensure voice interactions stay context-aware and compliant with safety norms.
Beyond these new capabilities for drivers, CaLLM Edge also offers key benefits for automakers. The heavy lifting of the multi-modal processing happens at the edge, meaning less cloud bandwidth required and reduced costs for OEMs. In addition, enabling drivers to access information outside the car and delivering advanced, generative AI-powered features unlocks new subscription-based services and revenue streams for OEMs.
“As we continue to push the limits of our CaLLM family of cloud and embedded language models, we continue to improve our ability to meet the needs of a wide variety of automakers and their specific infotainment platforms,” said Nils Schanz, EVP, Product & Technology, Cerence AI. “By teaming with MediaTek and NVIDIA, we’ve supercharged CaLLM Edge with real-time perception and contextual awareness that redefines the in-vehicle experience.”
“The combination of Cerence’s CaLLM Edge with MediaTek Dimensity Auto platforms creates an incredible foundation for powerful multi-modal, generative AI-driven experiences in vehicles,” said Mike Chang, Corporate Vice President and General Manager of Automotive Business of MediaTek. “MediaTek Dimensity Auto supports both Cerence’s LLM and SLM on the edge, and our new C-X1 featuring dual AI engines is ideal for the task of reliably running multiple AI tasks simultaneously. This partnership is a key addition to our automotive ecosystem and will enable global automotive brands to accelerate their next-generation designs in confidence.”
“Cerence’s collaboration with MediaTek builds on the company’s work to deploy NVIDIA AI and accelerated compute to improve the overall in-vehicle experience,” said Rishi Dhall, Vice President of Automotive at NVIDIA. “The work now gives automakers greater control to customize voice experiences, and our work to integrate NVIDIA NeMo Guardrails at the edge has the power to set a new industry benchmark in the evolution of safe, scalable in-car AI.”
Cerence AI will demonstrate its offering with MediaTek and NVIDIA at Auto Shanghai, taking place April 23-May 2. Interested attendees can experience Cerence xUI in action in Hall 8.2, booth number 8BD002. The solution will also be shown at MediaTek’s booth, also in Hall 8.2, at booth number 8BE006.
To learn more about Cerence AI, visit www.cerence.ai, and follow the company on LinkedIn.
About Cerence Inc.
Cerence Inc. (NASDAQ: CRNC) is a global industry leader in creating intuitive, seamless, AI-powered experiences across automotive and transportation. Leveraging decades of innovation and expertise in voice, generative AI, and large language models, Cerence powers integrated experiences that create safer, more connected, and more enjoyable journeys for drivers and passengers alike. With more than 500 million cars shipped with Cerence technology, the company partners with leading automakers, transportation OEMs, and technology companies to advance the next generation of user experiences. Cerence is headquartered in Burlington, Massachusetts, with operations globally and a worldwide team dedicated to pushing the boundaries of AI innovation. For more information, visit www.cerence.ai.
Contact Information
Kate Hickman | Tel: 339-215-4583 | Email: kate.hickman@cerence.com
FAQ
What are the key features of Cerence's new CaLLM Edge partnership with MediaTek and NVIDIA?
How does the new CRNC multi-modal edge solution benefit automakers?
What specific improvements does CaLLM Edge bring to in-car interactions?
Where and when will Cerence (CRNC) demonstrate this new technology?
