IP Library Granted Patent US 11,208,098
Granted Patent B2
US 11,208,098 · App. 16/512,887 · Granted Dec 28, 2021

Camera system for intelligent driver assistance system, and driver assistance system and method

Inventors: In Hyuk Song (Anyang-Si, KR); Dai Chang Ro (Seongnam-Si, KR); Sang Yeob Lee (Seongnam-Si, KR); Won Sik Jung (Yongin-Si, KR); Ji Yong Lee (Seongnam-Si, KR); Jae Kyeong Kim (Seoul, KR); Sang Kyun Sim (Anyang-Si, KR); Kyung Geun Jeon (Yongin-Si, KR); Kwan Sun You (Yongin-Si, KR)
Assignee: Mando Corporation
B60W30/09B60R11/04B60W10/18B60W10/20B60W30/0956B60W30/18163B60W40/02B60W40/105G02B7/02G06K9/00798G08G1/166G08G1/167H04N5/2251B60W2420/42B60W2420/52B60W2554/4041B60W2554/801
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,208,098
App. No.
16/512,887
Granted
Dec 28, 2021
Kind
B2
Abstract

An advanced driving assistance system (ADAS) provides collision avoidance control for a host vehicle. The system can include one or more sensors mounted to the host vehicle and configured to sense a driving lane in which the host vehicle is traveling and to sense an external vehicle partially engaged in the driving lane. A controller controls steering, braking, or acceleration of the host vehicle on the basis of sensing information received from the sensor. The controller determines the external vehicle partially engaged in the driving lane as a target vehicle having at least a part thereof overlapping with a lane mark of the driving lane, and performs longitudinal braking or acceleration control or lateral steering control on the host vehicle based on lateral and longitudinal positional relationships between the host vehicle and the target vehicle.

Claims (77)

1. A control system for a vehicle, the control system comprising:

at least one sensor disposed at the vehicle so as to have a field of view exterior of the vehicle, the at least one sensor configured to capture at least one of image data or radar data;

a monitoring device configured to sense a direction of viewing of a driver of the vehicle;

a controller comprising a processor; and

a memory storing therein an algorithm which, when executed by the controller, causes the controller to:

process the at least one of the image data or the radar data,

based on processing of the at least one of the image data or the radar data, identify at least one of another vehicle, a pedestrian or a lane marker present in the field of view,

based on the processing of the at least one of the image data or the radar data, identify an intersection present in the field of view,

in response to the identifying of the intersection, control at least one of a brake, a steering or a warning device, and

in response to the direction of viewing of the driver being a first direction, control the at least one sensor to sense at least one of the another vehicle or the pedestrian in a second direction.

2. The control system according to claim 1 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

based on the processing of the at least one of the image data or the radar data, identify a center left-turn lane, and

in response to the identifying of the center left-turn lane, control the at least one of the brake, the steering or the warning device.

3. The control system according to claim 2 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

based on the processing of the at least one of the image data or the radar data, identify whether the another vehicle is present on the center left-turn lane, and

in response to the another vehicle being present on the center left-turn lane, control the at least one of the brake, the steering or the warning device.

4. The control system according to claim 1 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

based on whether the vehicle is steered while the vehicle is stopped in front of the intersection, control the at least one of the brake, the steering or the warning device.

5. The control system according to claim 4 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

in response to the vehicle being stopped in front of the intersection and being steered, control the warning device to warn to a driver of a first collision risk, and

in response to the vehicle entering the intersection and being steered, control the warning device to warn to the driver of a second collision risk.

6. The control system according to claim 4 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

in response to the vehicle being expected to collide with the another vehicle after the warning of the second collision risk, control the at least one of the brake or the steering to avoid the another vehicle.

7. The control system according to claim 1 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

based on the processing of the at least one of the image data or the radar data, determine a longitudinal time-to-collision (TTC) and a lateral TTC between the vehicle on the intersection and the another vehicle on the intersection,

based on the longitudinal TTC and the lateral TTC, control the at least one of the brake, the steering or the warning device.

8. The control system according to claim 7 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

in response to a difference between the longitudinal TTC and the lateral TTC being below a reference value, control at least one of the brake, the steering or the warning device.

9. The control system according to claim 1 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

based on the processing of the at least one of the image data or the radar data, identify a traffic light of the intersection and determine a traffic signal of the traffic light,

in response to determining a stop signal of the traffic light, identify another vehicle approaching to the vehicle based on the processing of the at least one of the image data or the radar data, and

in response to the identifying of the another vehicle approaching to the vehicle, control the at least one of the brake, the steering or the warning device.

10. The control system according to claim 1 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

based on the processing of the at least one of the image data or the radar data, determine a first time-to-collision (TTC) between the vehicle on the intersection and the another vehicle on the intersection at a first time point and a second TTC at a second time point, and

in response to the second TTC being below the first TTC, control the at least one of the brake, the steering or the warning device.

11. The control system according to claim 1 , further comprising:

a communication circuitry;

wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

based on the processing of the at least one of the image data or the radar data, identify whether the vehicle is going to collide with the another vehicle, and

in response to the vehicle being going to collide with the another vehicle, generate a control signal for controlling the at least one of the brake, the steering or the warning device and transmit the control signal to the another vehicle through the communication circuitry, and

based on a receiving signal received from the another vehicle through the communication circuitry, control the at least one of the brake, the steering or the warning device.

12. The control system according to claim 1 , wherein the memory storing therein the algorithm which, when executed by the controller, further causes the controller to:

in response to non-identifying of the intersection, control the at least one sensor to extend a sensing area in a longitudinal direction of the vehicle; and

in response to the identifying of the intersection, control the at least one sensor to extend the sensing area in a lateral direction of the vehicle.

13. A method controlling a vehicle, the method comprising:

capturing, by at least one sensor disposed at the vehicle and having a field of view exterior of the vehicle, at least one of image data or radar data;

processing the at least one of the image data or the radar data;

identifying at least one of another vehicle, a pedestrian or a lane marker present in the field of view, based on processing of the at least one of the image data or the radar data;

sensing, by a monitoring device, a direction of viewing of a driver of the vehicle; and

identifying an intersection present in the field of view, based on the processing of the at least one of the image data or the radar data;

in response to the identifying of the intersection, controlling at least one of a brake, a steering or a warning device; and

in response to the direction of viewing of the driver being a first direction, controlling the at least one sensor to sense at least one of the another vehicle or the pedestrian in a second direction.

14. The method according to claim 13 , further comprising:

identifying a center left-turn lane, based on the processing of the at least one of the image data or the radar data;

identifying whether the another vehicle is present on the center left-turn lane, based on the processing of the at least one of the image data or the radar data; and

in response to the another vehicle being present on the center left-turn lane, controlling at least one of the brake, the steering or the warning device.

15. The method according to claim 13 , further comprising:

controlling the warning device to warn to a driver of a first collision risk, in response to the vehicle being stopped in front of the intersection and being steered;

controlling the warning device to warn to the driver of a second collision risk, in response to the vehicle entering the intersection and being steered; and

in response to the vehicle being expected to collide with the another vehicle after the warning of the second collision risk, controlling the at least one of the brake or the steering to avoid the another vehicle.

16. The method according to claim 13 , further comprising:

determining a longitudinal time-to-collision (TTC) and a lateral TTC between the vehicle on the intersection and the another vehicle on the intersection, based on the processing of the at least one of the image data or the radar data; and

in response to a difference between the longitudinal TTC and the lateral TTC being below a reference value, controlling the at least one of the brake, the steering or the warning device.

17. The method according to claim 13 , further comprising:

identifying a traffic light of the intersection and determine a traffic signal of the traffic light, based on the processing of the at least one of the image data or the radar data;

in response to determining a stop signal of the traffic light, identifying a first vehicle approaching to the vehicle based on the processing of the at least one of the image data or the radar data; and

in response to the identifying of the first vehicle approaching to the vehicle, controlling the at least one of the brake, the steering or the warning device.

18. The method according to claim 13 , further comprising:

determining a first time-to-collision (TTC) between the vehicle on the intersection and the another vehicle on the intersection at a first time point and a second TTC at a second time point, based on the processing of the at least one of the image data or the radar data; and

in response to the second TTC being below the first TTC, controlling the at least one of the brake, the steering or the warning device.

19. The method according to claim 13 , further comprising:

identifying whether the vehicle is going to collide with the another vehicle, based on the processing of the at least one of the image data or the radar data;

in response to the vehicle being going to collide with the another vehicle, generating a control signal for controlling the at least one of the brake, the steering or the warning device and transmitting the control signal to the another vehicle through the communication circuitry; and

controlling the at least one of the brake, the steering or the warning device, based on a receiving signal received from the another vehicle.

20. The method according to claim 13 , further comprising:

in response to non identifying of the intersection, controlling the at least one sensor to extend a sensing area in a longitudinal direction of the vehicle; and

in response to the identifying of the intersection, controlling the at least one sensor to extend the sensing area in a lateral direction of the vehicle.

Assignments (3)
MERGER Recorded Aug 15, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 061148/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2021
From: MANDO CORPORATION
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 058598/0480 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2019
From: SONG, IN HYUK; RO, DAI CHANG; LEE, SANG YEOB; JUNG, WON SIK; LEE, JI YONG; KIM, JAE KYEONG; SIM, SANG KYUN; JEON, KYUNG GEUN; YOU, KWAN SUN
To: MANDO CORPORATION
Reel/Frame 050784/0520 →
Priority Claims (12)
KR 10-2017-0009172 · Jan 19, 2017 · national
KR 10-2017-0009173 · Jan 19, 2017 · national
KR 10-2017-0009174 · Jan 19, 2017 · national
KR 10-2017-0009175 · Jan 19, 2017 · national
KR 10-2017-0009176 · Jan 19, 2017 · national
KR 10-2017-0009209 · Jan 19, 2017 · national
KR 10-2017-0009210 · Jan 19, 2017 · national
KR 10-2017-0009211 · Jan 19, 2017 · national
KR 10-2017-0009212 · Jan 19, 2017 · national
KR 10-2017-0009213 · Jan 19, 2017 · national
KR 10-2017-0009214 · Jan 19, 2017 · national
KR 10-2017-0009215 · Jan 19, 2017 · national
Continuity (3)
Continuation 16218170 · Dec 12, 2018
Continuation PCTKR2018000826 · Jan 18, 2018
Related Publication 20190337510A1 · Nov 7, 2019