IP Library Granted Patent US 11,673,543
Granted Patent B2
US 11,673,543 · App. 16/654,146 · Granted Jun 13, 2023

Vehicle control system and vehicle control method

Inventors: Hyeong Min Woo (Seongnam-si, KR); Jae Suk Kim (Yongin-si, KR)
Assignee: HL KLEMOVE CORP.
B60W30/06G05D1/0016G05D1/0088G05D1/0246B60W2420/42G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,673,543
App. No.
16/654,146
Granted
Jun 13, 2023
Kind
B2
Abstract

Provided are a vehicle control system and a vehicle control method, the vehicle control system including one or more image sensors disposed on a vehicle to have a field of view of an outside of the vehicle and configured to capture image data, a processor configured to process the image data captured by the image sensor, and a controller configured to set a travelling route from an alighting infrastructure to a parking infrastructure based at least in part on processing of the image data, and control the vehicle stopped in the alighting infrastructure to travel along the travelling route and to be parked in the parking infrastructure.

Claims (102)

1. A vehicle control system comprising:

one or more image sensors disposed on a vehicle to have a field of view of an outside the vehicle and configured to capture image data;

a processor configured to process the image data captured by the image sensor; and

a controller configured to set a travelling route from an alighting infrastructure to a parking infrastructure based at least in part on processing of the image data, and control the vehicle stopped in the alighting infrastructure to travel along the travelling route and to be parked in the parking infrastructure,

wherein the alighting infrastructure is defined at previously stored alighting infrastructure information,

wherein the controller is configured to:

determine position coordinates of the vehicle and a stop type of the vehicle in the alighting infrastructure based on a result of the processing of the image data and the alighting infrastructure information;

extract position coordinates of the parking infrastructure based on previously stored parking infrastructure information;

set the travelling route using the position coordinates of the vehicle and the position coordinates of the parking infrastructure; and

determine an initial behavior for a start of a stopped vehicle based on the stop type of the vehicle,

wherein the alighting infrastructure information includes

a plurality of grid lines for detecting a first component and a second component of coordinates in the alighting infrastructure, and

a size and a shape of the alighting infrastructure, and

wherein the controller is configured to:

compare the result of processing of the image data with the plurality of grid lines;

extract a first distance between the vehicle and the alighting infrastructure corresponding to the first component and a second distance between the vehicle and the alighting infrastructure corresponding to the second component among distances resulting from processing the image data; and

determine the position coordinates of the vehicle and the stop type of the vehicle in the alighting infrastructure using the first distance, the second distance, and the size and shape of the alighting infrastructure.

2. The vehicle control system of claim 1 ,

wherein the image sensor is provided in one or more units thereof on each of a front part, a rear part, and a lateral part of the vehicle to have a respective field of view of a front side, a rear side, and a lateral side of the vehicle,

wherein the controller is configured to:

estimate a plurality of coordinates using results of processing of a plurality of pieces of image data obtained by capturing a front area, a rear area, and a lateral area of the vehicle and the size and shape of the alighting infrastructure, and

calculate center coordinates of the vehicle using the estimated plurality of coordinates and determine the center coordinates to be the position coordinates of the vehicle.

3. The vehicle control system of claim 1 ,

wherein the alighting infrastructure information includes one or more reference coordinates indicating a position of a part of the alighting infrastructure,

wherein the controller is configured to:

extract a first distance between the vehicle and the alighting infrastructure corresponding to a first direction and a second distance between the vehicle and the alighting infrastructure corresponding to a second direction perpendicular to the first direction among distances resulting from processing the image data; and

determine coordinates spaced apart from the reference coordinates by the first distance and the second distance to be the position coordinates of the vehicle.

4. The vehicle control system of claim 1 ,

wherein the image sensor is provided in one or more units thereof on each of a front part, a rear part, and a lateral part of the vehicle to have a respective field of view of a front side, a rear side, and a lateral side of the vehicle,

wherein the alighting infrastructure information includes a shape of the alighting infrastructure,

wherein the controller is configured to:

estimate a turning angle of the vehicle with respect to the alighting infrastructure using results of processing of a plurality of pieces of image data obtained by capturing at least one of a front area, a rear area, and a lateral area of the vehicle and the shape of the alighting infrastructure, and

determine the stop type of the vehicle to be one of a longitudinal stop, a traverse stop, and an oblique stop based on the turning angle.

5. The vehicle control system of claim 1 ,

wherein the image sensor is provided in one or more units thereof on each of a front part, a rear part, and a lateral part of the vehicle to have a respective field of view of a front side, a rear side, a first lateral side, and a second lateral side of the vehicle, and

wherein the controller is configured to:

calculate a plurality of coordinates using a plurality of distances resulting from processing a plurality of pieces of image data obtained by capturing a front area, a rear area, and a lateral area of the vehicle, respectively, and the plurality of grid lines,

calculate a turning angle of the vehicle with respect to the alighting infrastructure based on one of a first reference line virtually connecting first coordinates corresponding to the front area to second coordinates corresponding to the rear area and a second reference line virtually connecting third coordinates corresponding to a first lateral area and fourth coordinates corresponding to a second lateral area, and

determine the stop type of the vehicle to be one of a longitudinal stop, a traverse stop, and an oblique stop based on the turning angle of the vehicle.

6. The vehicle control system of claim 1 , wherein the controller controls the vehicle to travel along the travelling route in response to receiving a travel command signal from a wireless communication terminal.

7. The vehicle control system of claim 1 , wherein the controller sets a local route based on a possibility of collision with an obstacle while driving the vehicle along the travelling route.

8. The vehicle control system of claim 1 , wherein the controller stores exit infrastructure information about an exit infrastructure in advance,

wherein the controller is configured to:

in response to completion of parking of the vehicle in the parking infrastructure, determine whether an exit command signal generated by a wireless communication terminal is received;

in response to receiving the exit command signal, set an exit route from the parking infrastructure to the exit infrastructure; and

control the vehicle parked in the parking infrastructure to exit along the exit route.

9. The vehicle control system of claim 1 , wherein the controller is configured to:

set a plurality of collision prevention boundary lines spaced apart from the travelling route by a predetermined safety distance in a width direction of the travelling route; and

control a behavior of the vehicle to prevent the vehicle travelling along the travelling from departing from the plurality of collision prevention boundary lines.

10. The vehicle control system of claim 1 , further comprising at least one non-image sensor disposed on the vehicle to have a field of sensing of an outside of the vehicle and configured to capture sensing data,

wherein the processor is configured to process the sensing data captured by the non-image sensor; and

the controller is configured to determine position coordinates of the vehicle and a stop type of the vehicle based on results of processing of the image data and the sensing data.

11. A vehicle control system comprising:

one or more image sensors disposed on a vehicle to have a field of view of an outside of the vehicle and configured to capture image data;

a smart parking assist system (SPAS) module configured to search a parking space existing around the vehicle and controlling a behavior of the vehicle such that the vehicle is parked in the parking space or the vehicle parked in the parking space is unparked; and

a domain control unit (DCU) configured to process the image data captured by the image sensor and control at least one driver assistance system provided in the vehicle and including the SPAS module,

wherein the alighting infrastructure is defined at previously stored alighting infrastructure information,

wherein the DCU is configured to:

determine position coordinates of the vehicle and a stop type of the vehicle in an alighting infrastructure based on a result of processing of the image data and the alighting infrastructure information;

extract position coordinates of a parking infrastructure based on previously stored parking infrastructure information;

set a travelling route using the position coordinates of the vehicle and the position coordinates of the parking infrastructure; and

determine an initial behavior for a start of a stopped vehicle based on the stop type of the vehicle,

wherein the alighting infrastructure information includes:

a plurality of grid lines for detecting a first component and a second component of coordinates in the alighting infrastructure, and

a size and a shape of the alighting infrastructure, and

wherein the controller is configured to:

compare the result of processing of the image data with the plurality of grid lines;

extract a first distance between the vehicle and the alighting infrastructure corresponding to the first component and a second distance between the vehicle and the alighting infrastructure corresponding to the second component among distances resulting from processing the image data; and

determine the position coordinates of the vehicle and the stop type of the vehicle in the alighting infrastructure using the first distance the second distance, and the size and shape of the alighting infrastructure.

12. The vehicle control system of claim 11 , wherein the image sensor is provided in one or more units thereof on a front part, a rear part, a first lateral part, and a second lateral part of the vehicle to have a respective field of view of a front side, a rear side, a first lateral side, and a second lateral side of the vehicle, and

wherein the controller is configured to:

estimate a plurality of coordinates using results of processing of a plurality of pieces of image data obtained by capturing a front area, a rear area, and a lateral area of the vehicle, respectively, and the size and shape of the alighting infrastructure, and

calculate center coordinates of the vehicle using the estimated plurality of coordinates and determine the calculated center coordinates to be the position coordinates of the vehicle.

13. The vehicle control system of claim 11 , wherein the alighting infrastructure information includes one or more reference coordinates indicating a position of a part of the alighting infrastructure,

wherein the DCU is configured to:

extract a first distance between the vehicle and the alighting infrastructure corresponding to a first direction and a second distance between the vehicle and the alighting infrastructure corresponding to a second direction perpendicular to the first direction among distances resulting from processing the image data; and

determine coordinates spaced apart from the reference coordinates by the first distance and the second distance to be the position coordinates of the vehicle.

14. The vehicle control system of claim 11 ,

wherein the image sensor is provided in one or more units thereof on each of a front part, a rear part, a first lateral part, and a second lateral side of the vehicle to have a respective field of view of a front side, a rear side, a first lateral side, and a second lateral side of the vehicle,

wherein the DCU is configured to:

calculate a plurality of coordinates using a plurality of distances resulting from processing a plurality of pieces of image data obtained by capturing a front area, a rear area, and a lateral area of the vehicle, respectively, and the plurality of grid lines;

calculate a turning angle of the vehicle with respect to the alighting infrastructure based on one of a first reference line virtually connecting first coordinates corresponding to the front area to second coordinates corresponding to the rear area and a second reference line virtually connecting third coordinates corresponding to a first lateral area and fourth coordinates corresponding to a second lateral area; and

determine the stop type of the vehicle to be one of a longitudinal stop, a travers stop, and an oblique stop based on the turning angle of the vehicle.

15. The vehicle control system of claim 11 , further comprising at least one non-image sensor disposed on the vehicle to have a field of sensing of an outside of the vehicle and configured to capture sensing data,

wherein the controller is configured to determine position coordinates of the vehicle and a stop type of the vehicle based on results of processing of the image data and the sensing data.

16. A vehicle control method comprising:

capturing image data using one or more image sensor disposed on a vehicle to have a field of view of an outside of the vehicle;

processing the image data captured by the image sensor; and

setting a travelling route from an alighting infrastructure to a parking infrastructure based at least in part on processing of the image data, and controlling the vehicle stopped in the alighting infrastructure to travel along the travelling route and to be parked in the parking infrastructure,

wherein the alighting infrastructure is defined at previously stored alighting infrastructure information,

wherein the controlling of the vehicle to be parked in the parking infrastructure includes:

determining position coordinates of the vehicle and a stop type of the vehicle in the alighting infrastructure based on a result of processing of the image data and previously stored alighting infrastructure information;

extracting position coordinates of the parking infrastructure based on previously stored parking infrastructure;

setting the travelling route using the position coordinates of the vehicle and the position coordinates of the parking infrastructure; and

determining an initial behavior for a start of the stopped vehicle based on the stop type of the vehicle,

wherein the alighting infrastructure information includes:

a plurality of grid lines for detecting a first component and a second component of coordinates in the alighting infrastructure, and

a size and a shape of the alighting infrastructure, and

wherein the controlling of the vehicle to be parked in the parking infrastructure includes:

comparing the result of processing of the image data with the plurality of grid lines;

extracting a first distance between the vehicle and the alighting infrastructure corresponding to the first component and a second distance between the vehicle and the alighting infrastructure corresponding to the second component among distances resulting from processing the image data; and

determine the position coordinates of the vehicle and the stop type of the vehicle in the alighting infrastructure using the first distance the second distance, and the size and shape of the alighting infrastructure.

Assignments (3)
MERGER Recorded Aug 23, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 060874/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2021
From: MANDO CORPORATION
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 058042/0307 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2019
From: WOO, HYEONG MIN; KIM, JAE SUK
To: MANDO CORPORATION
Reel/Frame 050731/0694 →
Priority Claims (1)
KR 10-2018-0123221 · Oct 16, 2018 · national
Continuity (1)
Related Publication 20200114906A1 · Apr 16, 2020