Throughout Europe 25,700 people were killed on the roads last year – an average of 70 traffic fatalities a day. Most of these accidents happened because the motorists weren’t paying attention. A new system has been designed to assist the driver and significantly reduce the number of accidents. At the 2015 International Motor Show (IAA), Leopold Kostal GmbH & Co. KG, is presenting a camera-based driver assistance system with know-how from Infineon Technologies AG.
This system detects whether the driver is showing signs of drowsiness (nodding off) or is distracted. And the car instantly responds – with a vibrating seat or a warning tone, for instance. The less attentive the driver gets, the more attentive the car gets. In order to respond quickly and accurately, the assistance and the emergency braking systems can automatically activate in advance of a potential emergency.
“For semi-autonomous or autonomous driving, the assistance system of the vehicle needs to know the state of the driver at all times,” says Frank Blaesing, Head of Innovation Management and Advanced Engineering at Kostal. “It needs to know if and how well the driver is informed about what’s happening on the road at that moment. This information is especially needed when the control over the vehicle needs to be turned back to the driver in a complex traffic situation.”
“We want to make driving safer for all road users,” says Jochen Hanebeck, who heads the Automotive division at Infineon Technologies. “Our chips help to reduce the number of serious road accidents. For us, the collaboration with Kostal is a significant contribution to assisted driving, with all its safety and comfort advantages.”
3D camera keeps watch over the eyelids
By 2018, cars with the 3D camera system from Kostal will be running off the assembly line. The optical system is only 49 by 29 millimeters (about 2 by 1 inches) in size and is embedded into the dashboard: Through the steering wheel, it “looks” front-facing at the driver’s body and head. It records the exact head position and recognizes the blink of an eye even through glasses or sunglasses.
The 3D camera uses infrared light and works even under changing light conditions or in the dark. It contains the Real3™ 3D image sensor chip from Infineon, which reliably records more than 100,000 pixels 50 times a second. For each pixel it simultaneously recognizes the distance and the brightness value. From the depth image of the distance data and the amplitude image of the brightness values, the 3D camera system then identifies 49 predetermined points in the driver’s face such as eyes, eyebrows, mouth or tip of the nose. Algorithms use this data to calculate the driver’s attentiveness. If, for example, the system detects signs of fatigue in the driver, it initiates the countermeasures.
In addition, knowledge of the exact position of the driver’s head helps to project navigation information in the windshield through head-up displays (HUDs), so that it’s right in the driver’s line of sight, seamlessly fitting into the streetscape in front of him. The driver will thus always see the navigation arrow in front of him at the same place in the road – regardless of how he holds his head.
The 6th sense: 3D vision thanks to REAL3 3D image sensor chip
The heart of the camera system is the 3D image sensor chip. It is based on the Time-of-Flight (ToF) principle, which measures the time it takes for the infrared light to go from the camera to the object and back. This time relay is directly related to the distance of the object. Compared to other 3D measurement methods, with ToF, the depth data is measured directly and doesn’t need to be determined via complex algorithms. Furthermore, at the end of their production process, 3D cameras with Real3 can be calibrated easily and permanently and only need one lens (monocular camera architecture) to be completed. Therefore, they are relatively small and impervious to vibrations in the vehicle.
Autonomous and semi-autonomous driving make extras important
Because of their high data quality, 3D ToF cameras aren’t in the vehicle just for detecting head position and blinking. They can be used for controlling infotainment systems or the air conditioning with hand movement or a body gesture. For example, the vehicle could set the airbags individually for each passenger. In addition, new assistance and safety functions outside the vehicle are possible, such as a door opening assistance that prevents you from bumping the car door against another car, wall or ceiling when parking at a commercial parking garage or at home.
Further information
With Infineon as one of its technology partners for the future of driver assistance, Kostal is presenting its 3D camera system for driver monitoring and other innovations under the motto “Mechatronics for the People!” in Hall 8 at Booth A01 at the 66th International Motor Show (IAA, September 15-27, 2015, Frankfurt on the Main, Germany).
Technical information about the REAL3 image sensor chip from Infineon is available at www.infineon.com/3d-imaging.
Kostal
www.kostal.com
Infineon Technologies AG
www.infineon.com
