IP Library Granted Patent US 11,418,693
Granted Patent B2
US 11,418,693 · App. 16/934,857 · Granted Aug 16, 2022

Vehicle and method of controlling the same

Inventors: Junsik An (Seoul, KR); Hayeon Lee (Gwacheon-si, KR); Jongmo Kim (Goyang-si, KR); Jinwook Choi (Seoul, KR); Minsung Son (Gwacheon-si, KR)
Assignees: HYUNDAI MOTOR COMPANY; KIA MOTORS CORPORATION
H04N5/232B60R1/00G01C21/30G01S15/86G01S15/931G06V20/586H04N5/2628H04N7/18B60R2300/105B60R2300/20B60R2300/607B60R2300/806G01S2015/932
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,418,693
App. No.
16/934,857
Granted
Aug 16, 2022
Kind
B2
Abstract

A vehicle includes a camera unit disposed in the vehicle to have a plurality of channels and configured to obtain an image around the vehicle, the camera unit including one or more cameras, a sensing device including an ultrasonic sensor, the sensing device configured to obtain distance information between an object and the vehicle, and a controller configured to match a part of the image around the vehicle with at least one mask, form map information based on the at least one mask and the distance information, determine at least one control point based on the map information, and obtain the image around the vehicle based on a priority of the camera unit corresponding to a surrounding type of the vehicle determined based on the control point.

Claims (50)

1. A vehicle comprising:

a display;

a camera unit disposed in the vehicle, comprising a plurality of cameras;

a sensing device including an ultrasonic sensor, the sensing device configured to obtain distance information between an object and the vehicle; and

a controller configured to:

identify a free space based on images obtained by the plurality of cameras,

based on the free space, determine a parking direction in which the vehicle is to be parked,

identify an image corresponding to the parking direction among the images obtained by the plurality of cameras,

generate a view image based on the identified image and the remaining image among the images obtained by the plurality of cameras, and

control display of the view image,

wherein, when the controlling the display of the view image, the controller is configured to:

divide a display region of the display into a plurality of regions based on a number of the plurality of cameras, and

adjust a boundary of a region in which the identified image is displayed so that the region in which the identified image is displayed is displayed larger than each region in which the remaining images are displayed.

2. The vehicle according to claim 1 ,

wherein the controller is configured to generate map information based on the distance information between the object and the vehicle obtained by the sensing device, determine at least one control point based on the map information, and control driving to avoid the at least one control point,

wherein the map information comprises the distance information corresponding to pixels of the images obtained by the plurality of cameras.

3. The vehicle according to claim 1 , wherein the controller is configured to convert the images obtained by the plurality of cameras to a vehicle coordinate system to match with a mask.

4. The vehicle according to claim 1 , wherein the controller is configured to determine a surrounding type of the vehicle based on the identified free space, wherein the surrounding type further includes a relationship between the object and the vehicle, and a relationship between a road and the vehicle,

wherein the controller is configured to determine the surrounding type of the vehicle through learning of the images obtained by the plurality of cameras.

5. The vehicle according to claim 4 , wherein, when the surrounding type of the vehicle is longitudinal parking on a side of the vehicle, the controller is configured to assign a high priority to a camera on the side of the vehicle among the plurality of cameras.

6. The vehicle according to claim 4 , wherein, when the surrounding type of the vehicle is reverse diagonal parking of the vehicle, the controller is configured to assign a high priority to a camera in front of the vehicle among the plurality of cameras.

7. The vehicle according to claim 4 , wherein, when the surrounding type of the vehicle is forward diagonal parking of the vehicle, the controller is configured to assign a high priority to a camera on a side of the vehicle among the plurality of cameras.

8. The vehicle according to claim 4 , wherein, when the surrounding type of the vehicle is rear parking of the vehicle, the controller is configured to assign a high priority to a camera behind the vehicle among the plurality of cameras.

9. The vehicle according to claim 1 , wherein the controller is configured to assign a priority for the plurality of cameras based on the parking direction, and change the priority in real time in response to driving of the vehicle.

10. The vehicle according to claim 9 , wherein the controller is configured form a boundary line on the view image based on priority information of the plurality of cameras and output the boundary line to the display.

11. A method of controlling a vehicle, the method comprising:

obtaining, by a camera unit having a plurality of cameras, images around the vehicle;

obtaining, by a sensing device, distance information between an object and the vehicle;

identifying a free space based on images obtained by the plurality of cameras;

determining a parking direction in which the vehicle is to be parked, based on the free space;

identifying an image corresponding to the parking direction among the images obtained by the plurality of cameras;

generating a view image based on the identified image and the remaining image among the images obtained by the plurality of cameras; and

displaying, by the display, the view image, wherein the controlling the display of the view image includes:

dividing a display region of the display into a plurality of regions based on a number of the plurality of cameras, and

adjusting a boundary of a region in which the identified image is displayed so that the region in which the identified image is displayed is displayed larger than each region in which the remaining images are displayed.

12. The method according to claim 11 ,

further comprising: generating map information based on the distance information between the object and the vehicle obtained by the sensing device,

wherein the map information comprises the distance information corresponding to pixels of the images obtained by the plurality of cameras.

13. The method according to claim 11 , further comprising converting the images obtained by the plurality of cameras to a vehicle coordinate system to match with a mask.

14. The method according to claim 11 ,

further comprising determining a surrounding type of the vehicle based on the identified free space, wherein the surrounding type further includes a relationship between the object and the vehicle, and a relationship between a road and the vehicle,

wherein obtaining the image around the vehicle comprises determining the surrounding type of the vehicle through learning of the images obtained by the plurality of cameras.

15. The method according to claim 14 , wherein obtaining the images obtained by the plurality of cameras comprises giving a high priority to a camera on a side of the vehicle among the plurality of cameras when the surrounding type of the vehicle is longitudinal parking on the side of the vehicle.

16. The method according to claim 14 , wherein obtaining the image around the vehicle comprises giving a high priority to a camera in front of the vehicle among the plurality of cameras when the surrounding type of the vehicle is reverse diagonal parking of the vehicle.

17. The method according to claim 14 , wherein obtaining the image around the vehicle comprises giving a high priority to a camera on a side of the vehicle among the plurality of cameras when the surrounding type of the vehicle is forward diagonal parking of the vehicle.

18. The method according to claim 14 , wherein obtaining the image around the vehicle comprises giving a high priority to a camera behind the vehicle among the plurality of cameras when the surrounding type of the vehicle is rear parking of the vehicle.

19. The method according to claim 11 , further comprising assign a priority for the plurality of cameras based on the parking direction, and changing the priority in real time in response to driving of the vehicle.

20. The method according to claim 19 , further comprising:

forming a boundary line on the view image based on the priority of the plurality of cameras; and

outputting the boundary line to the display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2020
From: AN, JUNSIK; LEE, HAYEON; KIM, JONGMO; CHOI, JINWOOK; SON, MINSUNG
To: HYUNDAI MOTOR COMPANY; KIA MOTORS CORPORATION
Reel/Frame 053270/0258 →
Priority Claims (1)
KR 10-2019-0166111 · Dec 12, 2019 · national
Continuity (1)
Related Publication 20210185205A1 · Jun 17, 2021
Cited By (1)
US 12,344,167