Partners Develop RGB-IR Solution for Automotive Cabin Monitoring

OmniVision Technologies and Fullhan Microelectronics have concocted a joint solution for capturing and processing high quality color (RGB) and infrared (IR) automotive interior images, day and night, with a single camera. The system combines OmniVision’s OV2778 2MP RGB-Ir image sensor with Fullhan’s FH8310 image signal processor (ISP), which provides dedicated hardware for processing the RGB-IR sensor. The result is high quality video for both machine vision in-cabin monitoring systems (IMS) and viewing applications, simultaneously, providing integrated solutions for facial recognition, the detection of objects and unattended children, remote monitoring, and recording for ride-hailing and robo taxi vehicles. 

The OV2778 image sensor is built on OmniVision’s 2.8-micron OmniBSI-2 Deep Well™ pixel technology, which delivers a 16-bit linear output from a single exposure with best in class low-light sensitivity. The FH8310 ISP has a high-performance 3D de-noise module that achieves excellent low light performance. The two devices also provide low combined power consumption, which ensures optimal image quality by reducing the heat generated from cabin-monitoring cameras that operate continuously in confined spaces. 

The FH8310 ISP also supports lens distortion correction. Additionally, it accepts Bayer and RGB-IR 4x4 pattern inputs from the 2MP OV2778 sensor. For top color imaging performance across varying lighting conditions, the OV2778 sensor integrates an RGB-IR, 4x4 pattern color filter and an external frame synchronization capability. 

This joint solution provides a small footprint, enabling designers to create the smallest possible camera modules for discrete placement inside the vehicle. The OV2778 image sensor is offered in a 6.5 mm x 5.7 mm automotive CSP and the FH8310 ISP is offered in a 7 mm x 7 mm QFN56 package. Both devices are available now, and both provide AEC-Q100 Grade 2 certification for automotive applications. For more details, visit OmniVision Technologies and Fullhan Microelectronics.