IP Library Patent Application 16595744
Patent Application
App. No. 16/595,744

APPARATUS, METHOD AND SYSTEM OF CONTROLLING DRIVING OF VEHICLE

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/595,744
Abstract

The disclosure provides an apparatus, method and system for assisting driving of a vehicle including an image sensor disposed in the vehicle to have a field of view of the front of the vehicle, configured to capture image data, a radar disposed in the vehicle to have a detecting area the outside of the vehicle, configured to capture detecting data to detect an object around the vehicle, and a controller including at least one processor configured to process the image data captured by the image sensor and the detecting data captured by the radar. The controller may obtain state information of vehicle traffic lights based on processing of the image data, in response to a right turn operation is detected at an intersection, and may control the vehicle to turn right after pausing or decelerating at a predetermined speed based on the state information of the vehicle traffic lights, information about another vehicle of a left lane detected based on processing of the detecting data, and state information of crosswalk traffic lights received from an external device. According to the disclosure it is possible to perform a right turn more safely at the intersection.

Claims (50)

1 . An apparatus for assisting driving of a vehicle comprising:

an image sensor disposed in the vehicle to have a field of view of the front of the vehicle, configured to capture image data;

a radar disposed in the vehicle to have a detecting area the outside of the vehicle, configured to capture detecting data to detect an object around the vehicle; and

a controller including at least one processor configured to process the image data captured by the image sensor and the detecting data captured by the radar,

wherein the controller is configured to:

obtain state information of vehicle traffic lights based on processing of the image data, in response to a right turn operation is detected at an intersection; and

control the vehicle to turn right after pausing or decelerating at a predetermined speed based on the state information of the vehicle traffic lights, information about another vehicle of a left lane detected based on processing of the detecting data, and state information of crosswalk traffic lights received from an external device.

2 . The apparatus according to claim 1 , wherein the controller is configured to detect the right turn operation, in response to a driving lane of the vehicle detected based on the processing of the image data is a right turn lane and a right indicator of the vehicle is turned on.

3 . The apparatus according to claim 1 , wherein the controller is configured to control the vehicle to decelerate at the predetermined speed and turn right in response to the vehicle traffic lights is green.

4 . The apparatus according to claim 3 , wherein the controller is configured to control the vehicle to pause in response to a pedestrian is detected based on the processing of the image data at a right turn.

5 . The apparatus according to claim 1 , wherein the controller is configured to control the vehicle to pause in response to the vehicle traffic lights is red or yellow.

6 . The apparatus according to claim 5 , wherein the controller is configured to control the vehicle to maintain a stop state in response to the crosswalk traffic lights of a crosswalk positioned before entering the intersection is green.

7 . The apparatus according to claim 5 , wherein the controller is configured to:

control the vehicle to maintain a stop state in response to a pedestrian is detected based on the processing of the image data, when the crosswalk traffic lights of a crosswalk positioned before entering the intersection is red; and

control the vehicle to turn right at the predetermined speed in response to the pedestrian is not detected.

8 . The apparatus according to claim 7 , wherein the controller is configured to control the vehicle to turn right at the predetermined speed while outputting an alert for an appearance of the pedestrian from a left side, in response to the pedestrian is not detected while a left area of an image corresponding to the image data is covered by the another vehicle.

9 . The apparatus according to claim 7 , wherein the controller is configured to receive information about whether the pedestrian is detected in a front image of the another vehicle from the another vehicle, in response to a left area of an image corresponding to the image data is covered by the another vehicle.

10 . A method for assisting driving of a vehicle comprising:

obtaining image data through a camera disposed in the vehicle to have a field of view of the outside of the vehicle;

obtaining detecting data through a radar disposed in the vehicle to have a detecting area of the outside of the vehicle;

detecting a right turn operation at an intersection;

obtaining state information of vehicle traffic lights based on processing of the image data;

obtaining information about another vehicle of a left lane detected based on processing of the detecting data;

receiving state information of crosswalk traffic lights from a communication device of the outside of the vehicle; and

controlling the vehicle to turn right after pausing or decelerating at a predetermined speed based on the state information of the vehicle traffic lights, the information about the another vehicle, and the state information of the crosswalk traffic lights.

11 . The method according to claim 10 , wherein the detecting of the right turn operation at the intersection comprises:

detecting the right turn operation, in response to a driving lane of the vehicle detected based on the processing of the image data is a right turn lane and a right indicator of the vehicle is turned on.

12 . The method according to claim 10 , wherein the controlling of the vehicle comprises:

controlling the vehicle to decelerate at the predetermined speed and turn right in response to the vehicle traffic lights is green.

13 . The method according to claim 12 , wherein the controlling of the vehicle comprises:

controlling the vehicle to pause in response to a pedestrian is detected based on the processing of the image data at a right turn.

14 . The method according to claim 10 , wherein the controlling of the vehicle comprises:

controlling the vehicle to pause in response to the vehicle traffic lights is red or yellow.

15 . The method according to claim 14 , wherein the controlling of the vehicle comprises:

controlling the vehicle to maintain a stop state in response to the crosswalk traffic lights of a crosswalk positioned before entering the intersection is green.

16 . The method according to claim 14 , wherein the controlling of the vehicle comprises:

controlling the vehicle to maintain a stop state in response to a pedestrian is detected based on the processing of the image data, when the crosswalk traffic lights of a crosswalk positioned before entering the intersection is red; and

controlling the vehicle to turn right at the predetermined speed in response to the pedestrian is not detected.

17 . The method according to claim 16 , wherein the controlling of the vehicle comprises:

controlling the vehicle to turn right at the predetermined speed while outputting an alert for an appearance of the pedestrian from a left side, in response to the pedestrian is not detected while a left area of an image corresponding to the image data is covered by the another vehicle.

18 . The method according to claim 16 , further comprising:

receiving information about whether the pedestrian is detected in a front image of the another vehicle from the another vehicle, in response to a left area of an image corresponding to the image data is covered by the another vehicle.

19 . An apparatus for assisting driving of a vehicle comprising:

an image sensor disposed in the vehicle to have a field of view of the front of the vehicle, configured to capture image data;

a radar disposed in the vehicle to have a detecting area the outside of the vehicle, configured to capture detecting data to detect an object around the vehicle; and

a domain control unit (DCU) configured to process the image data captured by the image sensor and the detecting data captured by the radar, and to control at least one driver assistance system provided in the vehicle,

wherein the DCU is configured to:

obtain state information of vehicle traffic lights based on processing of the image data, in response to a right turn operation is detected at an intersection based on at least one of the image data and the detecting data; and

control the vehicle to turn right after pausing or decelerating at a predetermined speed based on the state information of the vehicle traffic lights, information about another vehicle of a left lane detected through the radar, and state information of crosswalk traffic lights received from an external device.

20 . The apparatus according to claim 19 , wherein the DCU is configured to control the vehicle to decelerate at the predetermined speed and turn right in response to the vehicle traffic lights is green.

Assignments (3)
MERGER Recorded Aug 15, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 061148/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2021
From: MANDO CORPORATION
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 058598/0480 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2019
From: KIM, NAYOUNG
To: MANDO CORPORATION
Reel/Frame 050664/0842 →