IP Library Granted Patent US 10,750,164
Granted Patent B2
US 10,750,164 · App. 15/783,490 · Granted Aug 18, 2020

User interface apparatus for vehicle, and vehicle

Inventors: Yuna Seo (Seoul, KR); Minsick Park (Seoul, KR); Minjae Kim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N13/383B60R1/00G06K9/00845H04N13/117H04N13/31H04N13/378B60R2300/107H04N13/239H04N13/305H04N13/307
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,750,164
App. No.
15/783,490
Granted
Aug 18, 2020
Kind
B2
Abstract

Disclosed is a user interface apparatus for a vehicle, the apparatus including: a display unit configured to output stereoscopic content; an internal camera configured to acquire an image of the inside of the vehicle; and a processor configured to detect an image of a head of a user of the vehicle based on the image of the inside of the vehicle, generate pose information and movement information of the head based on the image of the head, and set a virtual head box based on a method for implementing the stereoscopic content, the pose information, and the movement information.

Claims (34)

1. A user interface apparatus for a vehicle, the apparatus comprising:

a display unit configured to output stereoscopic content;

an internal camera configured to acquire an image of an inside of the vehicle; and

a processor configured to:

detect an image of a head of a user of the vehicle based on the image of the inside of the vehicle,

generate pose information and movement information of the head based on the image of the head, and

set a virtual head box based on a method for implementing the stereoscopic content, the pose information, and the movement information,

wherein the virtual head box is defined as a three-dimensional (3D) space in which the head needs to be positioned so that the user is able to see the stereoscopic content with bare eyes of the user,

wherein the display unit comprises:

an image output unit, in which blocks including at least one pixel are alternatively arranged, and configured to display a multi-view image for a first frame duration; and

a filter configured to form barrier areas and light transmission areas which are formed to correspond to the multi-view image for the first frame duration.

2. The user interface apparatus according to claim 1 , wherein the processor is configured to control the display unit so that the stereoscopic content is output based on one of a lenticular method, a microlens array method, and a parallax method as the method for implementing the stereoscopic image.

3. The user interface apparatus according to claim 1 , wherein the processor is configured to detect a preset feature point from the image of the head, and generate the pose information of the head and the movement information of the head based on the detected preset feature point.

4. The user interface apparatus according to claim 3 , wherein the preset feature point comprises at least one of a first point of a left eye of the user, a second point of the left eye of the user, a first point of a right eye of the user, a second point of the right eye of the user, a first point of lips of the user, and a second point of the lips of the user.

5. The user interface apparatus according to claim 3 , wherein the processor is configured to track a feature point detected from a plurality of frames and generate information on a rotation of the head based on the tracked feature point.

6. The user interface apparatus according to claim 5 , wherein the processor is configured to determine whether the rotation of the head is within a reference range.

7. The user interface apparatus according to claim 6 , wherein it is determined that the rotation of the head is within the reference range, the processor is configured to maintain a preset position and a size of the virtual head box.

8. The user interface apparatus according to claim 6 , wherein when it is determined that the rotation of the head is beyond the reference range, the processor is configured to control the display unit to convert the stereoscopic content into flat content.

9. The user interface apparatus according to claim 1 , wherein the processor is configured to:

detect the preset feature point from a plurality of frames:

calculate a mean and a standard deviation of locations of the preset feature point in the plurality of frames; and

generate the movement information of the head based on the mean and the standard deviation.

10. The user interface apparatus according to claim 9 , wherein the processor is configured to:

divide the image of the inside of the vehicle into a first region and a second region based on a viewing angle; and

determine whether the preset feature point is located in one of the first region and the second region.

11. The user interface apparatus according to claim 10 , wherein, when it is determined that the preset feature point is located in the first region, the processor is configured to determine whether the mean and the standard deviation are within a reference range in the first region.

12. The user interface apparatus according to claim 11 , wherein, when it is determined that the mean and the standard deviation are within the reference range in the first region, the processor is configured to maintain a preset position and a size of the virtual head box.

13. The user interface apparatus according to claim 11 , wherein, when it is determined that at least one of the mean and the standard deviation is beyond the reference range in the first region, the processor is configured to adjust a preset position of the virtual head box to an adjusted position based on the preset feature point.

14. The user interface apparatus according to claim 13 , wherein the processor is configured to adjust positions of the barrier areas and the light transmission areas based on the adjusted position of the virtual head box.

15. The user interface apparatus according to claim 10 , wherein, when it is determined that the preset feature point is located in the second region, the processor is configured to determine whether the mean and the standard deviation are within a reference range in the second region.

16. The user interface apparatus according to claim 15 , wherein when it is determined that the mean and the standard deviation are within the reference range in the second region, the processor is configured to maintain a preset position and a size of the virtual head box.

17. The user interface apparatus according to claim 15 , wherein, when it is determined that at least one of the mean and the standard deviation is beyond the reference range in the second region, the processor is configured to adjust a preset size of the virtual head box based on the mean and the standard deviation.

18. A vehicle comprising the user interface apparatus according to claim 1 .

19. The user interface apparatus according to claim 1 , wherein the processor is further configured to preset the virtual head box at the inside of the vehicle, and subsequently detect the head of the user based the image of the inside of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2020
From: SEO, YUNA; PARK, MINSICK; KIM, MINJAE
To: LG ELECTRONICS INC.
Reel/Frame 053175/0989 →
Priority Claims (1)
KR 10-2017-0008796 · Jan 18, 2017 · national
Continuity (1)
Related Publication 20180205944A1 · Jul 19, 2018