OmniVision Technologies, in collaboration with Jungo Connectivity, offers an evaluation kit that combines Jungo’s CoDriver software development kit (SDK) featuring deep-learning, machine-learning and computer-vision algorithms with OmniVision’s OV2311, a high-resolution CMOS image sensor built on the OmniPixel3-GS™ global shutter technology. This evaluation kit allegedly makes it easy for OEMs and tier-1 automotive designers to develop the next generation of driver and occupant monitoring systems.
According to the National Highway Traffic Safety Administration, 80% of car accidents are caused by distracted driving. Carmakers are constantly looking for new ways to mitigate this issue, such as enhancing their advanced driver assistance systems (ADAS) to allow for real-time monitoring, alerts and other measures. In semi-autonomous vehicles, features are being added that allow the onboard computer to seize or relinquish control of the vehicle based on the driver’s condition. In fully autonomous scenarios, the car systems will even acquire information about the passengers’ well-being, mood and overall condition.
The combination of Jungo’s SDK and OmniVision’s image sensor provides automotive designers with the tools to obtain the most complete, real-time picture of the driver’s condition—regardless of the lighting conditions. Vehicles designed using this evaluation kit will be able to accurately determine whether the driver is ready to take control in a semi-autonomous emergency scenario. If not, the vehicle can take an alternative action, such as pulling off the road and parking. In a fully autonomous experience, the sensors and software provide reliable information about the passengers’ characteristics, possessions, and emotional and medical states. OmniVision’s high-performance sensing capabilities are crucial for Jungo’s CoDriver software to perform accurate facial recognition—not only of the driver, but also of passengers as far back as the third row.
The kit’s OV2311 high-resolution, 2-megapixel, 3-micron pixel-size sensor features a high frame rate of 60 frames per second and a small optical form factor of 1/2.9 inches—all in an ultra-compact automotive chip-scale package (a-CSP™) that is Automotive Safety Integrity Level (ASIL) B and AEC-Q100 qualified. Additionally, the sensor can control an infrared LED to sync with the exposure interval to capture extremely clear images in low- or no-light conditions. The OV2311 also achieves high near-infrared quantum efficiency, which minimizes the amount of LED illumination power required in total darkness.
Version 1.5 of Jungo’s full CoDriver SDK is included in the kit, with all the APIs, computer-vision algorithms and drivers needed by automotive designers, featuring both whole-cabin and driver-only monitoring configurations. The SDK has been configured and rigorously tested to perform optimally with OmniVision’s OV2311 image sensor, in real time and using a live video stream. For more information, visit Jungo Connectivity and OmniVision Technologies.