IP Library › Granted Patent US 11,167,736
Granted Patent B2
US 11,167,736 · App. 15/833,409 · Granted Nov 9, 2021

Posture information based pedestrian detection and pedestrian collision prevention apparatus and method

Inventors: Yoon Soo Kim (Gyeonggi-do, KR); Seung Wook Park (Gyeonggi-do, KR); Min Byeong Lee (Gyeonggi-do, KR); Ho Choul Jung (Gyeonggi-do, KR); In Yong Jung (Gyeonggi-do, KR)
Assignees: Hyundai Motor Company; Kia Motors Corporation
B60T7/22B60Q1/44B60Q9/008B60W30/09B60W30/0953B60W30/0956G06K9/00342G06K9/00362G06K9/00805G06K9/3233G08G1/166B60T2201/024B60T2210/32B60T2250/04B60T2270/30B60W2050/143B60W2050/146B60W2420/42B60W2520/10B60W2554/00B60W2555/20B60W2710/182B60W2720/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,167,736
App. No.
15/833,409
Granted
Nov 9, 2021
Kind
B2
Abstract

An apparatus for operating a pedestrian detection and collision mitigation system (PDCMS) of a vehicle is provided. The apparatus includes a front detection sensor that detects a pedestrian in a driving lane of the vehicle and a distance and a relative speed between the pedestrian and the vehicle. A vehicle sensor detects a vehicle speed and a controller executes the PDCMS function based on information detected by the front detection sensor and the vehicle sensor. A warning unit then outputs a notification to a driver regarding a collision of the pedestrian with the vehicle.

Claims (33)

1. An apparatus for operating a pedestrian detection and collision mitigation system (PDCMS) of a vehicle, comprising:

a front detection sensor configured to detect a pedestrian in a driving lane of the vehicle and a distance and a relative speed between the pedestrian and the vehicle;

a vehicle sensor configured to detect a speed of the vehicle;

a controller configured to execute the PDCMS function based on information detected by the front detection sensor and the vehicle sensor; and

a warning unit operated by the controller to provide a notification to a driver regarding a collision of the pedestrian with the vehicle,

wherein the front detection sensor includes:

an image input unit configured to acquire an image of an area at a front of the vehicle;

a region of interest (ROI) setting unit configured to set a ROI that corresponds to a size of an object in the image;

a candidate extraction unit configured to extract a pedestrian candidate based on a movement of the object in the set ROI; and

a pedestrian determination unit configured to compare the extracted pedestrian candidate with a posture of a sample pedestrian in a database to identify whether the extracted pedestrian candidate corresponds to the pedestrian, and

wherein the controller is further configured to activate the PDCMS function, if an absolute value of an initial speed of the pedestrian at a boundary of the driving lane and an initial speed of the vehicle are both within a predefined range condition in which the PDCMS function is activated at the time of determining whether the PDCMS function is activated.

2. The apparatus of claim 1 , wherein the PDCMS function includes an activation of the warning unit operation and an activation of a brake operation.

3. The apparatus of claim 2 , wherein the PDCMS function further includes an operation of a rear brake lamp.

4. The apparatus of claim 2 , wherein the PDCMS function further includes an operation of an electrical stability control (ESC).

5. The apparatus of claim 1 , wherein the pedestrian determination unit includes the database for storing, as the posture of the sample pedestrian, information associated with at least one of front, back, left, and right portions, an upper left half of a body, and an upper right half of a body of the sample pedestrian.

6. The apparatus of claim 5 , wherein the pedestrian determination unit is configured to compare the extracted pedestrian candidate with front, back, left, and right portions, an upper left half of a body, or an upper right half of a body of the sample pedestrian in the database in a cascading manner.

7. The apparatus of claim 1 , wherein the front detection sensor further includes a pedestrian tracking unit configured to track the pedestrian identified by the pedestrian determination unit.

8. The apparatus of claim 7 , wherein the pedestrian tracking unit is configured to track the pedestrian based on a number of feature points of the pedestrian in the set ROI.

9. The apparatus of claim 1 , wherein the controller is configured to activate operation of a brake to reduce the speed of the vehicle to at least a predetermined speed or less from a time when the operation of the brake is activated to a time when the collision of the pedestrian with the vehicle occurs.

10. The apparatus of claim 1 , wherein the controller is configured to permit a driver to operate a brake for a maximum possible deceleration even after starting the activation of the operation of the brake.

11. The apparatus of claim 1 , wherein the controller is configured to operate the warning unit to inform the driver that the PDCMS function is in an available state.

12. The apparatus of claim 1 , wherein the warning unit includes a display unit configured to visually inform the driver regarding the collision of the pedestrian with the vehicle or a speaker unit configured to audibly inform the driver regarding the collision of the pedestrian with the vehicle.

13. A method for operating a pedestrian detection and collision mitigation system (PDCMS) of a vehicle, comprising:

acquiring, by a controller, an image of an area in a front of a vehicle;

setting, by the controller, a region of interest (ROI) that corresponds to a size of an object in the image;

extracting, by the controller, a pedestrian candidate based on a movement of the object in the set ROI;

comparing, by the controller, the extracted pedestrian candidate with a posture of a sample pedestrian in a database to identify whether the extracted pedestrian candidate corresponds to a pedestrian in a driving lane of the vehicle;

detecting, by the controller, pedestrian information including a distance and a relative speed between the pedestrian and the vehicle;

detecting, by the controller, vehicle information including a speed of the vehicle; and

executing, by the controller, a PDCMS function based on the pedestrian information and the vehicle information,

wherein the executing of the PDCMS function comprises:

activating the PDCMS function, if an absolute value of an initial speed of the pedestrian at a boundary of the driving lane and an initial speed of the vehicle are both within a predefined range condition in which the PDCMS function is activated at the time of determining whether the PDCMS function is activated.

14. The method of claim 13 , wherein the PDCMS function includes an activation of an operation of a warning unit operated to provide a notification to a driver regarding a collision of the pedestrian with the vehicle and an activation of an operation of a brake regardless of whether the driver operates the brake.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2017
From: KIM, YOON SOO; PARK, SEUNG WOOK; LEE, MIN BYEONG; JUNG, HO CHOUL; JUNG, IN YONG
To: HYUNDAI MOTOR COMPANY; KIA MOTORS CORPORATION
Reel/Frame 044316/0930 →
Priority Claims (1)
KR 10-2016-0184296 · Dec 30, 2016 · national
Continuity (1)
Related Publication 20180186349A1 · Jul 5, 2018
Cited By (1)
US 12,319,279