IP Library Granted Patent US 11,260,864
Granted Patent B2
US 11,260,864 · App. 16/595,813 · Granted Mar 1, 2022

Path generation apparatus at intersection, and method and apparatus for controlling vehicle at intersection

Inventor: Sangkyun Sim (Anyang-si, KR)
Assignee: Mando Mobility Solutions Corporation
B60W30/18154B60W40/072G05D1/0088G05D1/0246G05D1/0274B60W2520/06G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,260,864
App. No.
16/595,813
Granted
Mar 1, 2022
Kind
B2
Abstract

Provided is a vehicle path generating apparatus at an intersection and an apparatus and method for controlling a vehicle at an intersection that are capable of providing safe autonomous driving at an intersection by calculating the accurate position of an intersection point, which is a cut position of a lane or a crossing position of lanes, in an intersection area using map information and/or image information, precisely calculating a vehicle movement path in the intersection on the basis of the calculated position of the intersection point, and automatically controlling a travel of the vehicle according to the calculated vehicle travel path.

Claims (55)

1. An apparatus for controlling a vehicle, the apparatus comprising:

an image sensor disposed on a vehicle to have a field of view of an exterior of the vehicle and configured to capture image data;

a map storage configured to store map information of a surrounding of the vehicle; and

a controller comprising a processor for processing the image data captured by the image sensor,

wherein the controller is configured to:

identify an intersection area based on at least part of the processing of the image data captured by the image sensor,

determine intersection point information about a plurality of intersection points in the intersection area based on at least part of the processing of the image data captured by the image sensor,

determine a vehicle travel path in the intersection area using the determined intersection point information and control travel of the vehicle based on the determined vehicle travel path,

determine a virtual left curve and a virtual right curve, wherein the virtual left curve connects a left side intersection point of a travel lane of the vehicle to a left side intersection point of one lane of a left turn travel path, a straightforward travel path or a right turn travel path which is determined based on turn signal operation information of the vehicle, and the virtual right curve connects a right side intersection point of the travel lane to a right side intersection point of one lane of the left turn travel path, the straightforward travel path, or the right turn travel path which is determined based on turn signal operation information of the vehicle, and

model the virtual left curve and the virtual right curve as a three-dimensional equation having lateral offset information of the vehicle immediately before entering the intersection, heading angle information of the vehicle with respect to the lane, and a curvature of the vehicle travel path at the intersection.

2. The apparatus of claim 1 , wherein the controller is configured to:

identify an intersection area based on at least one of the map information or image sensor information,

determine positions and a number of a plurality of intersection points based on a lane continuing characteristic and a lane crossing characteristic in the intersection area, and

determine the vehicle travel path in the intersection area based on the determined positions and the number of the intersection points.

3. The apparatus of claim 2 , wherein the lane continuing characteristic comprises information about a lane cut position in which a lane is cut by a predetermined length or more in the intersection area, the lane crossing characteristic comprises information about a lane crossing position in which two lanes cross each other, and the controller is configured to determine the lane cut position and the lane crossing position to be the intersection points.

4. The apparatus of claim 3 , wherein the controller is configured to determine a number of available travel lanes at the intersection and a shape of the intersection based on at least one of information about a number of lanes sensed in the intersection area and information about a type of a signal lamp.

5. The apparatus of claim 1 , wherein the controller is configured to, among the intersection points:

set positions of a 1-1 intersection point and a 1-2 intersection point corresponding to a left side intersection point and a right side intersection point of a travel lane on which the vehicle travels as a first reference position;

set one of positions of a 2-1 intersection point and a 2-2 intersection point corresponding to a left side intersection point and a right side intersection point of a left side distant lane located on a left distant side of the travel lane relative to the vehicle, a position of a 3-1 intersection point corresponding to a left side intersection point of a right side near lane located on a right near side of the travel lane relative to the vehicle, and positions of a 4-1 intersection point and a 4-2 intersection point corresponding to a left side intersection point and a right side intersection point of an opposite lane of the travel lane as a second reference position; and

generate vehicle travel path information passing through the first reference position and the second reference position.

6. The apparatus of claim 5 , wherein the vehicle travel path information comprises left turn travel path information comprising a 1-1 curve having a predetermined first radius of curvature and passing through the 1-1 intersection point and the 2-1 intersection point and a 1-2 curve having a predetermined second radius of curvature and passing through the 1-2 intersection point and the 2-2 intersection point.

7. The apparatus of claim 6 , wherein the first radius of curvature is a first distance between the 1-1 intersection point and the 2-1 intersection point, and the second radius of curvature is a second distance between the 1-2 intersection point and the 2-2 intersection point.

8. An apparatus for controlling a vehicle, the apparatus comprising:

an image sensor disposed on a vehicle to have a field of view of an exterior of the vehicle and configured to capture image data;

a non-image sensor disposed on the vehicle and configured to capture sensing data to sense one of objects around the vehicle;

a vehicle dynamics sensor disposed on the vehicle and configured to sense information related to travel of a vehicle; and

an integrated controller configured to process at least one of image data captured by the image sensor and sensing data captured by the non-image sensor,

wherein the integrated controller is configured to, based on at least part of the processing of the image data captured by the image sensor (i) identify an intersection area, (ii) determine intersection point information comprising positions and a number of a plurality of intersection points based on a lane continuing characteristic and a lane crossing characteristic in the intersection area, (iii) determine one or more vehicle travel path in the intersection area using the determined intersection point information, and iv) control travel of the vehicle based on the determined vehicle travel path,

wherein the integrated controller is further configured to:

determine a virtual left curve and a virtual right curve, wherein the virtual left curve connects a left side intersection point of a travel lane of the vehicle to a left side intersection point of one lane of a left turn travel path, a straightforward travel path or a right turn travel path which is determined based on turn signal operation information of the vehicle, and the virtual right curve connects a right side intersection point of the travel lane to a right side intersection point of one lane of the left turn travel path, the straightforward travel path, or the right turn travel path which is determined based on turn signal operation information of the vehicle, and

models the virtual left curve and the virtual right curve as a three-dimensional equation having lateral offset information of the vehicle immediately before entering the intersection, heading angle information of the vehicle with respect to the lane, and a curvature of the vehicle travel path at the intersection.

9. An apparatus for calculating a path of a vehicle, the apparatus comprising:

an intersection identifying unit configured to identify an intersection area using at least part of image data from an image sensor disposed on a vehicle to have a field of view of an exterior of the vehicle and configured to capture image data;

an intersection point information calculating unit configured to calculate positions and a number of a plurality of intersection points, based on a lane continuing characteristic and a lane crossing characteristic in the intersection area; and

a travel path calculating unit configured to calculate one or more vehicle travel paths in the intersection area based on the positions and the number of the intersection points,

wherein the travel path calculating unit is configured to:

determine a virtual left curve and a virtual right curve, wherein the virtual left curve connects a left side intersection point of a travel lane of the vehicle to a left side intersection point of one of a left turn travel path, a straightforward travel path or a right turn travel path which is determined based on turn signal operation information of the vehicle, and the virtual right curve connects a right side intersection point of the travel lane to a right side intersection point of one of the left turn travel path, the straightforward travel path, or the right turn travel path which is determined based on turn signal operation information of the vehicle, and

models the virtual left curve and the virtual right curve as a three-dimensional equation having lateral offset information of the vehicle immediately before entering the intersection, heading angle information of the vehicle with respect to the lane, and a curvature of the vehicle travel path at the intersection.

10. The apparatus of claim 9 , wherein the lane continuing characteristic comprises information about a lane cut position in which a lane is cut by a predetermined length or more in the intersection area, the lane crossing characteristic comprises information about a lane crossing position in which two lanes cross each other, and the intersection point information calculating unit determines the lane cut position and the lane crossing position as the intersection points.

11. A method of controlling a vehicle, the method comprising:

identifying an intersection area based on at least one of map information and image data captured by an image sensor;

determining positions and a number of a plurality of intersection points based on a lane continuing characteristic and a lane crossing characteristic in the intersection area;

determining a vehicle travel path in the intersection area based on the positions and the number of the intersection points; and

controlling travel of the vehicle based on the determined vehicle travel path,

wherein the method further comprises:

determining a virtual left curve and a virtual right curve, wherein the virtual left curve connects a left side intersection point of a travel lane of the vehicle to a left side intersection point of one of a left turn travel path, a straightforward travel path or a right turn travel path which is determined based on turn signal operation information of the vehicle, and the virtual right curve connects a right side intersection point of the travel lane to a right side intersection point of one of the left turn travel path, the straightforward travel path, or the right turn travel path which is determined based on turn signal operation information of the vehicle, and

modeling the virtual left curve and the virtual right curve as a three-dimensional equation having lateral offset information of the vehicle immediately before entering the intersection, heading angle information of the vehicle with respect to the lane, and a curvature of the vehicle travel path at the intersection.

12. The method of claim 11 , wherein the lane continuing characteristic comprises information about a lane cut position in which a lane is cut by a predetermined length or more in the intersection area, the lane crossing characteristic comprises information about a lane crossing position in which two lanes cross each other, and the determining positions and a number of the plurality of intersection points comprises determining the lane cut position and the lane crossing position to be the intersection point.

13. The method of claim 12 , further comprising determining a number of available travel lanes at the intersection and a shape of the intersection based on at least one of information about a number of lanes sensed in the intersection area and information about a type of a signal lamp.

14. The method of claim 13 , wherein the determining the vehicle travel path in the intersection area comprises, among the intersection points:

setting positions of a 1-1 intersection point and a 1-2 intersection point corresponding to a left side intersection point and a right side intersection point of a travel lane on which the vehicle travels as a first reference position;

setting one of positions of a 2-1 intersection point and a 2-2 intersection point corresponding to a left side intersection point and a right side intersection point of a left side distant lane located on a left distant side of the travel lane relative to the vehicle, a position of a 3-1 intersection point corresponding to a left side intersection point of a right side near lane located on a right near side of the travel lane relative to the vehicle, and positions of a 4-1 intersection point and a 4-2 intersection point corresponding to a left side intersection point and a right side intersection point of an opposite lane of the travel lane as a second reference position; and

generating vehicle travel path information passing through the first reference position and the second reference position.

15. The method of claim 14 , wherein the vehicle travel path information comprises left turn travel path information comprising a 1-1 curve having a predetermined first radius of curvature and passing through the 1-1 intersection point and the 2-1 intersection point and a 1-2 curve having a predetermined second radius of curvature and passing through the 1-2 intersection point and the 2-2 intersection point.

16. The method of claim 15 , wherein the first radius of curvature is a first distance between the 1-1 intersection point and the 2-1 intersection point, and the second radius of curvature is a second distance between the 1-2 intersection point and the 2-2 intersection point.

Assignments (4)
MERGER Recorded Aug 15, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 061148/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2021
From: MANDO CORPORATION
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 058598/0480 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2019
From: BAE, JUNGNAM
To: HYUNDAI MOTOR COMPANY; KIA MOTORS CORPORATION
Reel/Frame 051041/0313 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2019
From: SIM, SANGKYUN
To: MANDO CORPORATION
Reel/Frame 050657/0861 →