IP Library › Granted Patent US 12,091,017
Granted Patent B2
US 12,091,017 · App. 17/382,906 · Granted Sep 17, 2024

Vehicle and method of controlling the same

Inventor: Sangwoo Chun (Suwon-si, KR)
Assignees: Hyundai Motor Company; Kia Corporation
B60W40/06G06V10/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,091,017
App. No.
17/382,906
Granted
Sep 17, 2024
Kind
B2
Abstract

A vehicle may include a camera; a storage; and a controller electrically connected to the camera and the storage. The controller may be configured to obtain a front image of the vehicle from the camera by controlling the camera, in a response to obtaining the front image, to identify image data corresponding to a license plate of a front vehicle positioned in front of the vehicle from the front image, to identify a decrease in a distance between the vehicle and the front vehicle based on the image data and reference distance information corresponding to at least one reference image data of at least one reference license plate stored in the storage, to identify a change in height of the license plate of the front vehicle based on the image data, and based on the decrease in the distance between the vehicle and the front vehicle and the change in height of the license plate of the front vehicle, to identify a speed bump located in front of the vehicle.

Claims (77)

1. A vehicle comprising:

a camera;

a storage; and

a controller electrically connected to the camera and the storage,

wherein the controller is configured to:

obtain a front image of the vehicle from the camera by controlling the camera,

in a response to obtaining the front image, identify image data corresponding to a license plate of a front vehicle positioned in front of the vehicle from the front image,

identify a decrease in a distance between the vehicle and the front vehicle according to the image data and reference distance information corresponding to at least one reference image data of at least one reference license plate stored in the storage,

identify a change in height of the license plate of the front vehicle according to the image data, and

according to the decrease in the distance between the vehicle and the front vehicle and the change in height of the license plate of the front vehicle, identify a speed bump located in front of the vehicle,

wherein the image data includes a plurality of image data corresponding to a passage of time, and

wherein, in a response to the identification of the change in height of the license plate of the front vehicle, the controller is further configured to identify a distance between the vehicle and the speed bump according to at least one of the plurality of image data corresponding to the change in height of the license plate and the reference distance information corresponding to the at least one reference image data of the at least one reference license plate stored in the storage.

2. The vehicle according to claim 1 , wherein the controller is configured to control a driving speed of the vehicle according to the identification of the speed bump.

3. The vehicle according to claim 1 ,

wherein the controller is configured to:

identify the change in height in a vertical direction of the license plate according to a position comparison of pixel values between the plurality of image data, and

identify a presence of the speed bump in front of the vehicle according to the identification of the change in height of the license plate.

4. The vehicle according to claim 3 ,

wherein the plurality of image data includes first image data of a first time point, second image data of a second time point after the first time point, and third image data of a third time point after the second time point, and

wherein the controller is configured to:

change a position of pixel values of the second image data in a first vertical direction from a position of pixel values of the first image data, and

according to a fact that a position of pixel values of the third image data is a position changed in a second vertical direction opposite to the first vertical direction from the position of the pixel values of the second image data, identify that the license plate of a first height is changed to the first height after changing in a downward direction.

5. The vehicle according to claim 4 ,

wherein the plurality of image data includes fourth image data of a fourth time point after the third time point, and fifth image data of a fifth time point after the fourth time point, and

wherein the controller is configured to:

change a position of pixel values of the fourth image data in the second vertical direction from the position of pixel values of the third image data, and

according to a fact that a position of pixel values of the fifth image data is the position changed in the first vertical direction from the position of the pixel values of the fourth image data, identify that the license plate of the first height is changed to the first height after changing in an upward direction.

6. The vehicle according to claim 3 , wherein the controller is configured to:

generate a pattern corresponding to the change in height of the license plate over a passage of time,

remove a noise in the pattern corresponding to the change in height of the license plate via a predetermined noise filter, and

identify a position of the speed bump located in front of the vehicle according to the noise-removed pattern.

7. The vehicle according to claim 3 , wherein the controller is configured to:

determine a driving speed of the front vehicle according to a driving speed of the vehicle and a change in a distance between the vehicle and the front vehicle,

identify an elapsed time from a time point at which the license plate of a first height is changed in a downward direction and then starts to change to the first height again to a time point at which the license plate is changed in an upward direction and then starts to change to the first height again, and

determine a height of the speed bump according to the driving speed of the front vehicle and the elapsed time of the front vehicle.

8. The vehicle according to claim 7 , wherein the controller is configured to:

determine a distance between a front wheel axis and a rear wheel axis of the front vehicle according to the driving speed of the front vehicle and the elapsed time of the front vehicle,

determine a difference value between the first height of the license plate and a second height of the license plate changed in the upward direction, and

determine the height of the speed bump according to the distance between the front wheel axis and the rear wheel axis, the difference value, and a predetermined distance between the rear wheel axle and the license plate.

9. A method of controlling a vehicle, the method including:

obtaining, by a controller, a front image of the vehicle;

in a response to obtaining the front image, identifying, by the controller, image data corresponding to a license plate of a front vehicle of the vehicle from the front image;

identifying, by the controller, a decrease in a distance between the vehicle and the front vehicle according to the image data and reference distance information corresponding to at least one reference image data of at least one reference license plate stored in a storage electrically connected to the controller;

identifying, by the controller, a change in height of the license plate of the front vehicle according to the image data; and

according to the decrease in the distance between the vehicle and the front vehicle and the change in height of the license plate of the front vehicle, identifying, by the controller, a speed bump located in front of the vehicle,

wherein the image data includes a plurality of image data corresponding to a passage of time, and

the method further including:

in a response to the identification of the change in height of the license plate of the front vehicle, identifying, by the controller, a distance between the vehicle and the speed bump according to at least one of the plurality of image data corresponding to the change in height of the license plate and the reference distance information corresponding to the at least one reference image data of the at least one reference license plate stored in the storage.

10. The method according to claim 9 , further including:

controlling, by the controller, a driving speed of the vehicle according to the identification of the speed bump.

11. A non-transitory computer readable storage medium on which a program for performing the method of claim 9 is recorded.

12. The method according to claim 9 ,

wherein the identifying of the speed bump located in front of the vehicle includes:

identifying the change in height in a vertical direction of the license plate according to a position comparison of pixel values between the plurality of image data, and

identifying a presence of the speed bump in front of the vehicle according to the identification of the change in height of the license plate.

13. The method according to claim 12 ,

wherein the plurality of image data includes first image data of a first time point, second image data of a second time point after the first time point, and third image data of a third time point after the second time point, and

wherein the identifying of the change in height of the license includes:

changing a position of pixel values of the second image data in a first vertical direction from a position of pixel values of the first image data, and

according to a fact that a position of pixel values of the third image data is a position changed in a second vertical direction opposite to the first vertical direction from the position of the pixel values of the second image data, identifying that the license plate of a first height is changed to the first height after changing in a downward direction.

14. The method according to claim 13 ,

wherein the plurality of image data includes fourth image data of a fourth time point after the third time point, and fifth image data of a fifth time point after the fourth time point, and

wherein the identifying of the change in height of the license includes:

changing a position of pixel values of the fourth image data in the second vertical direction from the position of pixel values of the third image data, and

according to a fact that a position of pixel values of the fifth image data is the position changed in the first vertical direction from the position of the pixel values of the fourth image data, identifying that the license plate of the first height is changed to the first height after changing in an upward direction.

15. The method according to claim 12 , wherein the identifying of the speed bump located in front of the vehicle includes:

generating a pattern corresponding to the change in height of the license plate over a passage of time;

removing a noise in the pattern corresponding to the change in height of the license plate via a predetermined noise filter; and

identifying a position of the speed bump located in front of the vehicle according to the noise-removed pattern.

16. The method according to claim 12 , further including:

determining, by the controller, a driving speed of the front vehicle according to a driving speed of the vehicle and a change in a distance between the vehicle and the front vehicle;

identifying, by the controller, an elapsed time from a time point at which the license plate of a first height is changed in a downward direction and then starts to change to the first height again to a time point at which the license plate is changed in an upward direction and then starts to change to the first height again; and

determining, by the controller, a height of the speed bump according to the driving speed of the front vehicle and the elapsed time of the front vehicle.

17. The method according to claim 16 , wherein the determining of the height of the speed bump includes:

determining a distance between a front wheel axis and a rear wheel axis of the front vehicle according to the driving speed of the front vehicle and the elapsed time of the front vehicle;

determining a difference value between the first height of the license plate and a second height of the license plate changed in the upward direction; and

determining the height of the speed bump according to the distance between the front wheel axis and the rear wheel axis, the difference value, and a predetermined distance between the rear wheel axle and the license plate.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2021
From: CHUN, SANGWOO
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 056970/0938 →
Priority Claims (1)
KR 10-2020-0120530 · Sep 18, 2020 · national
Continuity (1)
Related Publication 20220092319A1 · Mar 24, 2022