emotion3D, a provider for camera-based in-cabin analysis software, and BHTC, a supplier of climate control units and HMI systems, teamed up to offer the world’s first solution that combines HMI technology with advanced driver and occupant monitoring. The system covers all soon to be mandatory driver monitoring functionalities and offers innovative user experience features.
BHTC’s display and climate control products can be equipped with cameras that observe either the driver only or the whole in-cabin space. emotion3D’s CABIN EYE software stack is used to process the video stream provided by the cameras to derive valuable information about the driver and other occupants.
Based on this information, driver drowsiness and distraction, as well as sudden sickness warnings (conform with GSR and EuroNCAP), can be issued. In addition, the solution enables a wide range of user experience features such as personalization and gestures. The tight coupling of BHTC’s HMI products and emotion3D’s in-cabin analysis modules enables a unique, intuitive human-vehicle interaction.
emotion3D is a software provider for camera-based in-cabin analysis. With cameras installed inside the vehicle, their powerful software stack CABIN EYE analyzes all occupants’ characteristics, states and activities to enable a wide range of safety & user experience functions. The in-cabin analysis system will be at the heart of future vehicle concepts as it enables the currently most paramount factors in automotive development: ideal user experience, seamless human-vehicle interaction and optimized safety.
In the final quarter of 2021, the company also announced a collaboration with Melexis, the two companies combine DMS and HUD dynamic object alignment in a single camera. The solution combines the driver monitoring system (DMS) with high-precision 3D driver localization, to dynamically align augmented reality head-up displays (AR HUD) objects.
Melexis and emotion3D’s novel DMS covers all basic functions such as driver drowsiness and attention warning to conform to the EU’s General Safety Regulation and Euro NCAP’s testing protocols. In addition, the demonstrator provides 3D locations of the driver’s facial landmarks. These are relevant for an optimal augmented reality head-up display (AR HUD) user experience. The objects projected by the HUD require precise alignment with real-world objects, following the dynamic position changes of the driver.
The demonstrator consists of a camera built around Melexis’ MLX75027 3D ToF sensor and emotion3D’s advanced in-cabin analysis software (E3D ICMS). The software can be flexibly integrated in any automotive SoC of choice.
“Regulatory requirements make it necessary to integrate DMS into new vehicles and augmented reality head-up displays become more and more popular. Our combined system offers an exact and cost-efficient solution for automotive manufacturers”, notes Florian Seitner, CEO of emotion3D.
Gualtiero Bagnuoli, Product Marketing Manager at Melexis, comments on the benefits of ToF technology: “We combine accurate and robust 3D eye position detection for HUD with sunlight invariant eye gaze and eye openness detection for leaner DMS algorithm implementations. Use of ToF technology is key. It is very easy to get accurate depth data from the 3D ToF sensor with low processing effort. The result is that the DMS and HUD algorithms work impressively well with wide-field of view lenses and VGA resolution ToF sensors.”
Comentários