IP Library Granted Patent US 11,654,897
Granted Patent B2
US 11,654,897 · App. 17/341,788 · Granted May 23, 2023

System and method for controlling autonomous parking of vehicle

Inventors: Jongmo Kim (Goyang-si, KR); Minsung Son (Gwacheon-si, KR); Hayeon Lee (Gwacheon-si, KR); Jinwook Choi (Seoul, KR); Wonjune Lee (Yongin-si, KR); Sohee You (Suwon-si, KR)
Assignees: Hyundai Motor Company; Kia Motors Corporation; Hyundai Mobis Co., Ltd.
B60W30/06G06F18/23G06F18/2431G06V10/30G06V10/443G06V20/586G06V20/588
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,654,897
App. No.
17/341,788
Granted
May 23, 2023
Kind
B2
Abstract

A system for performing autonomous parking of a vehicle includes: a camera configured to acquire a surrounding image of the vehicle including a parking line; and a controller configured to derive spatial recognition data based on the surrounding vehicle image as an input, derive a feature point corresponding to the parking line based on the surrounding image and the spatial recognition data, determine a candidate parking line based on clustering of the feature point, and control the vehicle to perform parking in a parking area having the candidate parking line.

Claims (39)

1. A system for performing autonomous parking of a vehicle,

the system comprising:

a camera configured to acquire a surrounding image of the vehicle including a parking line; and

a controller configured to:

derive spatial recognition data based on the surrounding image as an input,

derive a feature point corresponding to the parking line based on the surrounding image and the spatial recognition data,

determine a candidate parking line based on clustering of the feature point, and

control the vehicle to perform parking in a parking area which has the candidate parking line,

wherein the controller is configured to determine a plurality of additional candidate parking lines, determine a first area provided as a boundary with endpoints of the plurality of additional candidate parking lines and an endpoint of the candidate parking line, determine a second area provided as an empty space between the plurality of additional candidate parking lines and the candidate parking line, and determine the parking area based on a ratio of a number of pixels in the first area and a number of pixels in the second area.

2. The vehicle according to claim 1 , wherein the controller is configured to remove noise of the surrounding image of the vehicle by using a first filter, and extract an edge based on a gradient of each pixel including in the surrounding image of the vehicle.

3. The vehicle according to claim 1 , wherein the controller is configured to classify objects included in the surrounding image of the vehicle into at least one category based on the spatial recognition data.

4. The vehicle according to claim 1 , wherein the controller is configured to derive a plurality of feature points corresponding to the parking line from the surrounding image of the vehicle and the spatial recognition data using a second filter corresponding to the parking area of the parking line.

5. The vehicle according to claim 4 , wherein the controller is configured to determine reliability of each of the plurality of feature points based on consistency of direction values of each of the plurality of feature points corresponding to the parking line, and determine the candidate parking line based on a feature point of which reliability exceeds a predetermined value.

6. The vehicle according to claim 1 , wherein the controller is configured to determine the parking area based on the feature point corresponding to the parking line when the feature point corresponds to the parking line included in the vehicle corresponding to the surrounding image of the vehicle and the spatial recognition data.

7. The vehicle according to claim 1 , wherein the controller is configured to determine the parking area based on a number of pixels corresponding to the parking line, a ratio of a number of pixels of the feature point and the feature point.

8. The vehicle according to claim 1 , wherein, when an overlap ratio of a first feature point determined based on the surrounding image of the vehicle and a second feature point determined based on the spatial recognition data exceeds a predetermined value, the controller is configured to determine the candidate parking line based on the first feature point and the second feature point.

9. A method for controlling autonomous parking of a vehicle, comprising:

acquiring a surrounding image of the vehicle including a parking line;

deriving spatial recognition data based on the surrounding vehicle image as an input;

deriving a feature point corresponding to the parking line based on the surrounding image and the spatial recognition data;

determining a candidate parking line based on clustering of the feature point; and

controlling the vehicle to perform parking in a parking area having the candidate parking line,

the controlling the vehicle to perform parking in the parking area includes:

determining a plurality of additional candidate parking lines;

determining a first area provided as a boundary with endpoints of the plurality of additional candidate parking lines and an endpoint of the candidate parking line;

determining a second area provided as an empty space between the plurality of additional candidate parking lines and the candidate parking line; and

determining the parking area based on a ratio of a number of pixels in the first area and a number of pixels in the second area.

10. The method according to claim 9 , wherein determining the candidate parking line includes:

removing noise of the surrounding image of the vehicle by using a first filter, and

extracting an edge based on a gradient of each pixel including in the surrounding image of the vehicle.

11. The method according to claim 9 , wherein determining the candidate parking line includes:

classifying objects included in the surrounding image of the vehicle into at least one category based on the spatial recognition data.

12. The method according to claim 9 , wherein the determining the candidate parking line includes deriving a plurality of feature points corresponding to the parking line from the surrounding image of the vehicle and the spatial recognition data using a second filter corresponding to the parking area of the parking line.

13. The method according to claim 12 , wherein the determining the candidate parking line includes:

determining reliability of each of the plurality of feature points based on consistency of direction values of each of the plurality of feature points corresponding to the parking line; and

determining the candidate parking line based on the feature point having reliability that exceeds a predetermined value.

14. The method according to claim 9 , wherein the determining the candidate parking line includes, when the feature point corresponds to the parking line included in the vehicle corresponding to the surrounding image of the vehicle and the spatial recognition data, determining the parking area based on the feature point corresponding to the parking line.

15. The method according to claim 9 , wherein the controlling the vehicle to perform parking in the parking area includes determining the parking area based on the number of pixels corresponding to the parking line, a ratio of a number of pixels of the feature point and the feature point.

16. The method according to claim 9 , wherein the determining the candidate parking line includes, when an overlap ratio of a first feature point determined based on the surrounding image of the vehicle, and a second feature point determined based on the spatial recognition data exceeds a predetermined value, determining the candidate parking line based on the first feature point and the second feature point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2021
From: KIM, JONGMO; SON, MINSUNG; LEE, HAYEON; CHOI, JINWOOK; LEE, WONJUNE; YOU, SOHEE
To: HYUNDAI MOTOR COMPANY; KIA MOTORS CORPORATION; HYUNDAI MOBIS CO., LTD.
Reel/Frame 056487/0486 →
Priority Claims (1)
KR 10-2020-0113689 · Sep 7, 2020 · national
Continuity (1)
Related Publication 20220073055A1 · Mar 10, 2022