IP Library › Granted Patent US 10,953,811
Granted Patent B2
US 10,953,811 · App. 16/743,894 · Granted Mar 23, 2021

Vehicle image controller, system including the same, and method thereof

Inventor: Min Han Kim (Gunpo-si, KR)
Assignees: Hyundai Motor Company; KIA Motors Corporation
B60R11/0235G02B27/0093B60R2300/202B60R2300/605B60R2300/8026
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,953,811
App. No.
16/743,894
Granted
Mar 23, 2021
Kind
B2
Abstract

A vehicle image controller, a system including the same, and a method thereof are provided. The vehicle image controller includes a processor configured to determine a head motion of a user or a sight motion of the user and to align a view point displayed on a display of a vehicle corresponding to the head motion or the sight motion and a storage configured to store information regarding the head motion or the sight motion.

Claims (62)

1. A vehicle image controller, comprising:

a processor configured to:

determine a head motion of a driver or a sight motion of the driver; and

align a view point displayed on a display of a vehicle corresponding to the head motion or the sight motion; and

a storage configured to store information regarding the head motion or the sight motion,

wherein the processor is configured to:

set a reference location on image data displayed on the display based on at least one of a sight of the driver, a head location of the driver, or an eye location of the driver; and

shift and display the view point based on the reference location.

2. The vehicle image controller of claim 1 , wherein the processor is configured to:

extract at least one of the sight of the driver, the head location of the driver, or the eye location of the driver based on face image data of the driver.

3. The vehicle image controller of claim 2 , wherein the processor is configured to:

extract and filter at least a portion of vehicle image data that the driver sees outside the vehicle based on at least one of the sight of the driver, the head location of the driver, or the eye location of the driver.

4. The vehicle image controller of claim 2 , wherein the processor is configured to:

correct an error of a filtered vehicle image data based on an acceleration sensing value of the vehicle.

5. The vehicle image controller of claim 4 , wherein the processor is configured to:

correct the error by removing a noise using acceleration of each axis from the acceleration sensing value of the vehicle, wherein the noise is caused by a vehicle movement and a vehicle impact in the head motion or the sight motion.

6. The vehicle image controller of claim 3 , wherein the processor is configured to:

correct a distortion of wide-angle image data, wherein the wide-angle image data is the vehicle image data.

7. The vehicle image controller of claim 6 , wherein the processor is configured to:

correct the distortion of the wide-angle image data by applying a correction filter to an area displayed on the display in the wide-angle image data.

8. The vehicle image controller of claim 6 , wherein the processor is configured to:

invert an area displayed on the display in the wide-angle image data based on the head motion or the sight motion;

shift a view point of the area displayed on the display; and

expand and display a view area.

9. The vehicle image controller of claim 1 , wherein the processor is configured to:

set eyes and a center point of the eyes based on face image data when the driver sits in a driver seat.

10. The vehicle image controller of claim 9 , wherein the processor is configured to:

set reference axes of X-axis and Y-axis on the face image data; and

determine an amount of view point movement of the driver based on an amount of offset between the reference axes and the center point.

11. The vehicle image controller of claim 10 , wherein the processor is configured to:

determine the amount of view point movement of the driver based on the amount of offset between the reference axes and the center point or a distance between the eyes when the driver turns a head of the driver toward Z-axis.

12. A vehicle system, comprising:

a display configured to display an image outside a vehicle; and

a vehicle image controller configured to:

determine a head motion of a driver or a sight motion of the driver; and

align a view point displayed on the display corresponding to the head motion or the sight motion,

wherein the vehicle image controller is configured to:

set a reference location on image data displayed on the display based on at least one of a sight of the driver, a head location of the driver, or an eye location of the driver; and

shift and display the view point based on the reference location.

13. The vehicle system of claim 12 , wherein the system further comprises:

a driver tracking camera configured to capture a face or eyes of the driver; and

a plurality of vehicle cameras configured to:

capture a front side of the vehicle, a rear side of the vehicle, a left side of the vehicle, and a right side of the vehicle; and

provide a wide-angle image.

14. The vehicle system of claim 13 , wherein the plurality of vehicle cameras includes at least one of a blind-spot monitoring (BVM), a rear view monitoring (RVM), or a rear view camera.

15. The vehicle system of claim 13 , wherein the driver tracking camera is mounted on at least one of a lower end of a cluster, a crash pad, a steering wheel shroud, an audio, video, navigation (AVN), a headlining, or an overhead console of the vehicle.

16. The vehicle system of claim 13 , wherein the system further comprises:

an acceleration sensor configured to sense X-, Y-, or Z-axis acceleration of the vehicle.

17. A vehicle image control method, comprising:

determining a head motion of a driver or a sight motion of the driver; and

controlling a view point displayed on a display of a vehicle such that the view point is aligned and displayed corresponding to the head motion or the sight motion;

wherein controlling the view point comprises:

setting a reference location on image data displayed on the display based on at least one of a sight of the driver, a head location of the driver, or an eye location of the driver; and

shifting and displaying the view point based on the reference location.

18. The vehicle image control method of claim 17 , wherein determining the head motion or the sight motion comprises:

extracting at least one of the sight of the driver, the head location of the driver, or the eye location of the driver from face image data of the driver;

setting reference axes of X-axis and Y-axis on the face image data; and

determining an amount of view point movement of the driver based on an amount of offset between the reference axes and a center point of eyes.

19. The vehicle image control method of claim 17 , wherein controlling the view point comprises:

extracting and filtering at least a portion of vehicle image data that the driver sees outside the vehicle based on at least one of a sight of the driver, a head location of the driver, or an eye location of the driver;

correcting an error of a filtered vehicle image data based on an acceleration sensing value of the vehicle; and

correcting the error by removing a noise using acceleration of each axis from the acceleration sensing value of the vehicle, wherein the noise is caused by a vehicle movement and a vehicle impact in the head motion or the sight motion.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2020
From: KIM, MIN HAN
To: HYUNDAI MOTOR COMPANY; KIA MOTORS CORPORATION
Reel/Frame 052612/0850 →
Priority Claims (1)
KR 10-2019-0088488 · Jul 22, 2019 · national
Continuity (1)
Related Publication 20210024008A1 · Jan 28, 2021
Cited By (1)
US 12,307,714