Xperi Develops World-first In-cabin Monitoring Technologies on Neuromorphic Vision Systems
Xperi Holding Corporation (NASDAQ: XPER) has launched a pioneering neuromorphic driver monitoring solution (DMS) through its DTS AutoSense team, utilizing Prophesee Metavision® - Event-Based Vision sensor. This technology enables driver-centric features such as gaze tracking and head pose detection at a remarkable frame rate of 10,000 fps, improving low light performance and enhancing safety. With an end-to-end data generation system, the solution addresses privacy concerns associated with traditional imaging sensors. Xperi's advancements in computer vision signal significant development in in-cabin monitoring technologies.
- Introduction of the world's first neuromorphic DMS enhances vehicle safety.
- High frame rate of 10,000 fps improves performance in low light conditions.
- Addresses privacy concerns associated with conventional always-on cameras.
- None.
DTS®, a global leader in next-generation audio, imaging and sensing technology, and a wholly owned subsidiary of Xperi Holding Corporation (NASDAQ: XPER) (“Xperi”), today announced a world-first neuromorphic driver monitoring solution (DMS), powered by Prophesee Metavision® - Event-Based Vision sensor.
Using the raw feed from the Metavision® - Event-Based Vision sensor, the DTS AutoSense* team developed driver-centric monitoring features such as gaze tracking, head pose, identification, and eyelid opening.
With more than 20 years of world-leading experience in neural solutions and computer vision, and with billions of products powered by their solutions, the Xperi team maps and adapts in-cabin monitoring (ICM) technologies to existing and future sensor centric trends.
“Intelligent sensing is required by the next-generation in-cabin experience. The critical path to this is a sensor fusion-focused advanced research strategy,” said Petronel Bigioi, chief technology officer, Xperi. “DTS AutoSense’s advanced research team is centered on state-of-the-art sensing solutions and neuromorphic sensing is one of the technologies that can shape the future of the industry.”
The neuromorphic sensors capture information at an equivalent frame rate of 10,000 frames per second without requiring active illumination. This enables better low light performance for driver monitoring features as well as never-before-seen capabilities such as saccadic eye movement or micro-expressions, crucial next steps in the next-generation in-cabin experiences.
Xperi relies on an end-to-end data generation and training system built to address the particular needs of the sensor. The training data set was generated based on Xperi’s extensive computer vision infrastructure, reusing ground-truth from the visible and near infrared spectrums, synthesizing a completely novel approach in neuromorphic based sensing.
“Being able to instantaneously detect the subtlest, almost imperceptible, face and eye motions can be lifesaving,” said Petronel Bigioi. “The low light powerful vision processing capabilities, fast response times and low power operation that this pioneering neuromorphic-based technology application enables makes it ideal for the safety-critical applications of driver monitoring systems, while also broadening the ability to further enhance and personalize the vehicle cabin.”
In addition to excellent low light performance and robustness to various illumination conditions, neuromorphic sensing directly addresses the privacy aspect specific to traditional imaging-based sensing (always-on cameras).
“DTS AutoSense’s innovative AI-enabled approach underscores the ability of Prophesee’s sensor solution to provide OEMs with an effective safety enhancement for vehicles of all types,” said Marc Rousseau, VP Products and Business Development at Prophesee. “We are delighted to collaborate on this first-of-its-kind technology with Xperi and its forward-thinking, high caliber team.”
*DTS AutoSense comprises a Driver Monitoring Solution (DMS) and an Occupancy Monitoring Solution (OMS), the first to be designed into passenger vehicles projected to be on the road in 2021. Working together they provide actionable insights into activity inside the vehicle, including the driver, passengers, pets and objects, to create a better, safer experience.
About Xperi Holding Corporation
Xperi invents, develops, and delivers technologies that enable extraordinary experiences. Xperi technologies, delivered via its brands (DTS, HD Radio, IMAX Enhanced, Invensas, TiVo), and by its startup, Perceive, make entertainment more entertaining, and smart devices smarter. Xperi technologies are integrated into billions of consumer devices, media platforms, and semiconductors worldwide, driving increased value for partners, customers and consumers.
Xperi, DTS, IMAX Enhanced, Invensas, HD Radio, Perceive, TiVo, DTS AutoSense, and their respective logos are trademarks or registered trademarks of affiliated companies of Xperi Holding Corporation in the United States and other countries. All other company, brand and product names may be trademarks or registered trademarks of their respective companies.
About Prophesee
Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.
Prophesee’s patented sensors and AI algorithms, introduce a new computer vision paradigm based on how the human eye and brain work. Like the human vision, it sees events: essential, motion information in the scene, not a succession of conventional images. This event-based method allows for unprecedented speed (>10 000fps equivalent), dynamic range (>120dB), data volume (10x to 1000x less) and power efficiency (<10 mW). Prophesee bio-inspired revolution opens a new path to absolute efficiency and safety in autonomous driving, IoT, mobile and Industry 4.0. www.prophesee.ai
SOURCE: Xperi Holding Corporation
XPER-P
View source version on businesswire.com: https://www.businesswire.com/news/home/20210421005249/en/
FAQ
What is the neuromorphic driver monitoring solution by Xperi?
When was the neuromorphic driver monitoring solution launched?
How does the new DMS improve low light performance?
What company is behind the neuromorphic DMS?
What are the safety features of the DTS AutoSense DMS?
