IP Library Granted Patent US 11,325,588
Granted Patent B2
US 11,325,588 · App. 16/732,980 · Granted May 10, 2022

Vehicle control system and vehicle control method

Inventor: Nac Dong Kim (Uiwang-si, KR)
Assignee: Mando Mobility Solutions Corporation
B60W30/06G06V20/586
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,325,588
App. No.
16/732,980
Granted
May 10, 2022
Kind
B2
Abstract

Disclosed herein is a vehicle control system and a method of controlling the vehicle. The vehicle control system includes: at least one sensor module disposed in a vehicle to have a detecting area for the inside or the outside of the vehicle, configured to capture detecting data and to process the captured detecting data; and a controller configured to park the vehicle in a recognized parking space using position coordinates of each of at least two objects based at least in part on the processing of the detecting data.

Claims (71)

1. A vehicle control system comprising:

a camera disposed in a vehicle to have a field of view of the inside or the outside of the vehicle, configured to capture image data and to process the captured image data;

at least one sensor disposed in a vehicle to have a detecting area for the inside or the outside of the vehicle, configured to capture detecting data and to process the captured detecting data; and

a controller configured to park the vehicle in a recognized parking space using position coordinates of each of at least two objects based at least in part on the processing of the image data and the detecting data, wherein the controller is configured to:

determine a parking type according to states of the at least two objects obtained from a processing result of the image data and the detecting data;

calculate the position coordinates of the at least two objects, respectively, by detecting a first object using the image data and the detecting data, after the first object is detected continuing to move and pass an area where no object is detected, detecting a second object using the image data and the detecting data, and calculating an undetected time;

calculate a difference value between specific components among the position coordinates of the at least two objects;

compare the difference value with a length corresponding to the parking type among preset lengths of the vehicle; and

when the difference value is larger than the length of the vehicle, recognize the difference value as the parking space and park the vehicle in the recognized parking space.

2. The vehicle control system according to claim 1 , wherein the controller is configured to:

when the parking type is determined as perpendicular parking, compare the difference with a transverse length of the vehicle corresponding to the perpendicular parking; and

when the parking type is determined as longitudinal parking, compare the difference value with a longitudinal length of the vehicle corresponding to the longitudinal parking.

3. The vehicle control system according to claim 1 , wherein the controller is configured to:

when an obstacle existing between the two objects is identified from the processing result of the image data and the detecting data, calculate the position coordinates of the obstacle;

calculate a first difference value between a first position coordinates of a first object of the two objects and the specific component of the position coordinates of the obstacle and a second difference value between a second position coordinates of a second object of the two objects and the specific component of the position coordinates of the obstacle; and

recognize a value greater than the preset length of the vehicle corresponding to the parking type of either the first difference value and the second difference value as the parking space.

4. The vehicle control system according to claim 3 , wherein, when the parking type is determined as the perpendicular parking, the controller is configured to recognize the a value greater than the transverse length of the vehicle of either the first difference value and the second difference value as the parking space.

5. The vehicle control system according to claim 3 , wherein, when the parking type is determined as the longitudinal parking, the controller is configured to recognize the value greater than the longitudinal length of the vehicle of either the first difference value and the second difference value as the parking space.

6. The vehicle control system according to claim 3 , wherein, when the parking space is recognized, the controller is configured to determine that parking is completed when an entry rate of the vehicle with respect to the recognized parking space is equal to or greater than a preset reference entry rate, and an interval between the obstacle and the vehicle satisfies a preset reference interval.

7. The vehicle control system according to claim 3 , wherein the controller is configured to:

determine whether parking space selection information is received; and

upon receiving the parking space selection information, select one of a recognized first parking space based on the position coordinates of the two objects based on the received parking space selection information and a recognized second parking space based on the value greater than the preset length of the vehicle corresponding to the parking type.

8. The vehicle control system according to claim 1 , wherein the controller is configured to:

when the parking type is determined as the diagonal parking, calculate a parking angle between the vehicle and the object from the processing result of the image data and the detecting data; and

compare a result value calculated by multiplying a value of a trigonometric function for the parking angle in the difference value with a transverse length of the vehicle corresponding to the diagonal parking.

9. The vehicle control system according to claim 8 , wherein the controller is configured to:

when the obstacle existing between the two objects is identified from the processing result of the image data and the detecting data, calculate the position coordinates of an obstacle;

calculate a first result value calculated by multiplying the value of the trigonometric function for the parking angle to the first difference value between the first position coordinates of the first object of the two objects and the specific component of the position coordinates of the obstacle and a second result value calculated by multiplying the value of the trigonometric function for the parking angle to the second difference value between the second position coordinates of the second object of the two objects and the specific component of the position coordinates of the obstacle; and

recognize a result value larger than the transverse length of the vehicle among the first result value and the second result value as the parking space.

10. The vehicle control system according to claim 1 , wherein, when the parking space is recognized, the controller is configured to determine that parking is completed when an entry rate of the vehicle with respect to the recognized parking space is equal to or greater than a preset reference entry rate.

11. A vehicle control system comprising:

a camera disposed in a vehicle to have a field of view of the inside or the outside of the vehicle, configured to capture image data;

at least one sensor disposed in the vehicle to have a detecting area for the inside or the outside of the vehicle, configured to capture detecting data;

at least one of driver assistance systems module configured to search for a parking space existing in the vicinity of the vehicle and to control a behavior of the vehicle for parking the vehicle in the parking space or departing the vehicle parked in the parking space; and

a domain controller configured to process the image data and the detecting data and to control at least one of the driver assistance systems included in the vehicle including a smart parking assistance system (SPAS),

wherein the DCU is configured to:

determine a parking type according to states of the at least two objects obtained from a processing result of the image data and the detecting data;

calculate the position coordinates of the at least two objects, respectively, by detecting a first object using the image data and the detecting data, after the first object is detected continuing to move and pass an area where no object is detected, detecting a second object using the image data and the detecting data, and calculating an undetected time;

calculate a difference value between specific components among the position coordinates of the at least two objects;

compare the difference value with a length corresponding to the parking type among preset lengths of the vehicle; and

when the difference value is larger than the length of the vehicle, recognize the difference value as the parking space and park the vehicle in the recognized parking space.

12. The vehicle control system according to claim 11 , wherein the DCU is configured to:

when the parking type is determined as perpendicular parking, compare the difference with a transverse length of the vehicle corresponding to the perpendicular parking; and

when the parking type is determined as longitudinal parking, compare the difference value with a longitudinal length of the vehicle corresponding to the longitudinal parking.

13. The vehicle control system according to claim 11 , wherein the DCU is configured to:

when an obstacle existing between the two objects is identified from the processing result of the image data and the detecting data, calculate the position coordinates of the obstacle;

calculate a first difference value between a first position coordinates of a first object of the two objects and the specific component of the position coordinates of the obstacle and a second difference value between a second position coordinates of a second object of the two objects and the specific component of the position coordinates of the obstacle; and

recognize a value greater than the preset length of the vehicle corresponding to the parking type of either the first difference value and the second difference value as the parking space.

14. The vehicle control system according to claim 13 , wherein, when the parking type is determined as the perpendicular parking, the DCU is configured to recognize the value greater than the transverse length of the vehicle of either the first difference value and the second difference value as the parking space.

15. The vehicle control system according to claim 13 , wherein, when the parking type is determined as the longitudinal parking, the DCU is configured to recognize the value greater than the longitudinal length of the vehicle of either the first difference value and the second difference value as the parking space.

16. The vehicle control system according to claim 13 , wherein, when the parking space is recognized, the DCU is configured to determine that parking is completed when an entry rate of the vehicle with respect to the recognized parking space is equal to or greater than a preset reference entry rate, and an interval between the obstacle and the vehicle satisfies a preset reference interval.

17. The vehicle control system according to claim 13 , wherein the DCU is configured to:

determine whether parking space selection information is received; and

upon receiving the parking space selection information, select one of a recognized first parking space based on the position coordinates of the two objects based on the received parking space selection information and a recognized second parking space based on the value greater than the preset length of the vehicle corresponding to the parking type.

18. The vehicle control system according to claim 11 , wherein the DCU is configured to:

when the parking type is determined as the diagonal parking, calculate a parking angle between the vehicle and the object from the processing result of the image data and the detecting data; and

compare a result value calculated by multiplying a value of a trigonometric function for the parking angle in the difference value with a transverse length of the vehicle corresponding to the diagonal parking.

19. The vehicle control system according to claim 18 , wherein the DCU is configured to:

when the obstacle existing between the two objects is identified from the processing result of the image data and the detecting data, calculate the position coordinates of an obstacle;

calculate a first result value calculated by multiplying the value of the trigonometric function for the parking angle to the first difference value between the first position coordinates of the first object of the two objects and the specific component of the position coordinates of the obstacle and a second result value calculated by multiplying the value of the trigonometric function for the parking angle to the second difference value between the second position coordinates of the second object of the two objects and the specific component of the position coordinates of the obstacle; and

recognize a result value larger than the transverse length of the vehicle among the first result value and the second result value as the parking space.

20. The vehicle control system according to claim 11 , wherein, when the parking space is recognized, the DCU is configured to determine that parking is completed when an entry rate of the vehicle with respect to the recognized parking space is equal to or greater than a preset reference entry rate.

21. A method of controlling a vehicle comprising:

capturing, by a camera disposed in a vehicle to have a field of view of the inside or the outside of the vehicle, image data and processing the captured image data;

capturing, by at least one sensor disposed in the vehicle to have a detecting area for the inside or the outside of the vehicle, detecting data and processing the captured detecting data; and

parking, by a controller, the vehicle in a recognized parking space using position coordinates of each of at least two objects based at least in part on the processing of the image data and the detecting data, wherein the parking of the vehicle comprises:

determining a parking type according to states of the at least two objects obtained from a processing result of the image data and the detecting data;

calculating the position coordinates of the at least two objects, respectively, by detecting a first object using the image data and the detecting data, after the first object is detected continuing to move and pass an area where no object is detected, detecting a second object using the image data and the detecting data and calculating an undetected time;

calculate a difference value between specific components among the position coordinates of the at least two objects;

comparing the difference value with a length corresponding to the parking type among preset lengths of the vehicle; and

when the difference value is larger than the length of the vehicle, recognizing the difference value as the parking space and park the vehicle in the recognized parking space.

Assignments (3)
MERGER Recorded Aug 15, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 061148/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2021
From: MANDO CORPORATION
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 058598/0480 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2020
From: KIM, NAC DONG
To: MANDO CORPORATION
Reel/Frame 051406/0526 →