IP Library Granted Patent US 9,239,380
Granted Patent B2
US 9,239,380 · App. 12/992,174 · Granted Jan 19, 2016

Driver assistance system for avoiding collisions of a vehicle with pedestrians

Inventors: Stefan Hegemann (Wangen, DE); Akitsugu Yoda (Lindau, DE); Rolf Adomat (Eriskirch, DE); Michael Darms (Lindau, DE); Raksincharoensak Pongsathorn (Tokyo, JP); Masao Nagai (Tokyo, JP); Ikuko Shimizu (Tokyo, JP)
Assignee: ADC Automotive Distance Control Systems GmbH
G01S13/867B60T7/22G01S7/415G01S13/931G06K9/00798G06K9/00805G08G1/166B60R21/0134B60R2300/8093B60W30/08G01S17/023G01S2013/936G01S2013/9321G01S2013/9346G06K2209/27
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,239,380
App. No.
12/992,174
Granted
Jan 19, 2016
Kind
B2
Abstract

A driver assistance system for avoiding collisions of a vehicle with pedestrians, the system including a camera sensor and/or a beam sensor. When an object moving at a given speed on a pedestrian crossing is detected, the object is detected as being a pedestrian with a probability that is sufficiently high to output a warning to the driver, reducing the likelihood of a potential collision.

Claims (33)

1. A driver assistance system on a vehicle for avoiding collisions of the vehicle with pedestrians, the system on the vehicle comprising:

a camera sensor, on the vehicle, for capturing images of a roadway;

a beam sensor, on the vehicle, for detecting a position of an object located on the roadway; and

a processor, on the vehicle, for:

analyzing the captured images output by the camera sensor to identify a position of a pedestrian crossing which is a designated portion of the roadway for assisting pedestrians crossing the roadway,

analyzing a detection signal output from the beam sensor to identify that the detected object is a pedestrian,

in response to identifying the position of the pedestrian crossing and identifying that the detected object is a pedestrian, merging the position data, by superimposing the position of the identified pedestrian relative to the position of the identified pedestrian crosswalk, and

in response to the superimposing performed by the merging, determining that the position of the identified pedestrian is on or near the position of the identified pedestrian crossing and outputting a warning to the driver of the vehicle, and

wherein data from at least two of the camera sensor, the beam sensor, a digital map and other vehicles driving ahead are superimposed on each other in order to determine whether an object is moving on or near a pedestrian crossing.

2. The driver assistance system according to claim 1 , wherein the camera sensor detects the pedestrian crossing.

3. The driver assistance system according to claim 2 , wherein a pedestrian crossing is detected from camera data on the basis of the cross ratio between edges of the pedestrian crossing and the periodicity of markings of the pedestrian crossing.

4. The driver assistance system according to claim 2 , wherein a pedestrian crossing is detected from camera data on the basis of a traffic sign that refers to a pedestrian crossing.

5. The driver assistance system according to claim 2 , wherein the position and the motion of objects are detected from camera data by means of an optical flow method.

6. The driver assistance system according to claim 1 , wherein a beam sensor detects a position and a motion of an object.

7. The driver assistance system according to claim 1 , wherein data from a digital map are used for determining a position of a pedestrian crossing a path of the vehicle.

8. The driver assistance system according to claim 1 , wherein a position of a pedestrian crossing in a direction of traffic is transmitted by other vehicles driving ahead by means of car-to-car communication.

9. The driver assistance system according to claim 1 , wherein additional pedestrians are directly classified from the camera data.

10. The driver assistance system according to claim 1 , wherein a speed of the vehicle is reduced automatically when it is above a predetermined threshold value when the vehicle is approaching a zebra crossing.

11. The driver assistance system according to claim 1 , wherein an emergency braking is carried out when the driver does not react to a warning.

12. A device for a driver assistance system on a vehicle comprising:

a camera sensor, on the vehicle, for capturing images of a roadway;

a beam sensor on the vehicle, for detecting a position of an object located on the roadway; and

a processor, on the vehicle, for:

analyzing the captured images output by the camera sensor to identify a position of a pedestrian crossing which is a designated portion of the roadway for assisting pedestrians crossing the roadway,

analyzing a detection signal output from the beam sensor to identify that the detected object is a pedestrian,

in response to identifying the position of the pedestrian crossing and identifying that the detected object is a pedestrian, merging the position data, by superimposing the position of the identified pedestrian relative to the position of the identified pedestrian crosswalk, and

in response to the superimposing performed by the merging, determining that the position of the identified pedestrian is on or near the position of the identified pedestrian crossing and is moving at a given speed and outputting a warning to the driver to prevent a potential collision between the vehicle and the detected object, and

wherein data from at least two of the camera sensor, the beam sensor, a digital map and other vehicles driving ahead are superimposed on each other in order to determine whether an object is moving on or near a pedestrian crossing.

13. The driver assistance system according to claim 1 , wherein the processor:

outputs a first internal vehicle warning to the driver of the vehicle in response to identifying the pedestrian crossing, and

outputs a second internal vehicle warning to the driver of the vehicle that is different than the first warning in response to determining that the detected object is a pedestrian located on the identified pedestrian crossing.

14. The driver assistance system according to claim 1 , wherein the processor:

determines that a danger exists when it is determined from the sensor data that the object is moving on or near the pedestrian crossing at a speed characteristic of a pedestrian.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2011
From: HEGEMANN, STEFAN; YODA, AKITSUGU; ADOMAT, ROLF; DARMS, MICHAEL; PONGSATHORN, RAKSINCHAROENSAK; NAGAI, MASAO; SHIMIZU, IKUKO
To: ADC AUTOMOTIVE DISTANCE CONTROL SYSTEMS GMBH
Reel/Frame 025786/0696 →
Priority Claims (2)
DE 10 2008 024 707 · May 21, 2008 · national
EP 08015394 · Sep 1, 2008 · regional
Continuity (1)
Related Publication 20110184617A1 · Jul 28, 2011