STMicroelectronics is enhancing vehicle safety with its latest global-shutter image sensors for driver monitoring systems (DMSs).
DMSs continually watch the driver’s head movements to recognize signs of drowsiness and distraction, enabling systems in the vehicle to generate warnings that can preserve the safety of occupants. Traffic agencies estimate that about 95% of road traffic accidents result from human error, many of which could be avoided using systems such as DMSs. With almost 19,000 accident fatalities in Europe in 2020[1], recently enacted legislation will mandate DMS for all new car platforms in Europe in 2024 and for existing model platforms in 2026. With traffic fatalities twice as high in the US[2], the National Transportation Safety Board (NTSB) has recommended DMS for all semi-autonomous vehicles.
The new global-shutter sensor, VB56G4A, leverages ST’s in-house investment in manufacturing advanced 3D-stacked back-side illuminated (BSI-3D) image sensors. These are more sensitive, smaller, and more reliable than conventional front-side illuminated (FSI) sensors typically used in first-generation DMSs.
ST is supplying samples of its new sensor to lead customers now and mass production is scheduled for the beginning of 2023 for adoption in the model year 2024 vehicles.
The global-shutter sensor offers big advantages over rolling-shutter imagers. By simultaneously exposing all pixels to the image, a global-shutter sensor allows simple synchronization with NIR illumination, improving the illumination-subsystem power budget. Moreover, the new sensor achieves high Quantum Efficiency (QE), reaching 24% at 940nm near-infrared wavelength, with a linear dynamic range up to 60dB. This enables a simple low-power, non-visible LED emitter to provide adequate illumination for the sensor. Operating outside the visible spectrum also ensures consistent response in day or night driving and in bright or overcast conditions.
The sensor’s high QE, combined with a pixel size of just 2.6µm, helps optimize total power consumption and camera size. In addition, integrated automatic exposure control eases use and simplifies the application-software design by minimizing system interaction with the sensor.
The sensor also provides flexible operating modes that help optimize system features and performance. These include programmable sequences of 4-frame contexts, illumination control outputs synchronized with sensor integration periods, an input for an external frame-start signal, automatic dark calibration, dynamic defective-pixel correction, image cropping, and a mirror/flip-image readout.
External connections include eight programmable general-purpose I/O (GPIO) pins and a dual-lane MIPI CSI-2 transmitter interface operating up to 1.5 Gbps per lane. The sensor can operate at up to 88 frames per second (fps) at full resolution and the typical power consumption is 145mW at 60 fps.
