IP Library › Granted Patent US 10,379,362
Granted Patent B2
US 10,379,362 · App. 15/748,615 · Granted Aug 13, 2019

Head mounted display and control method thereof

Inventors: Sungmin Baek (Seoul, KR); Soungmin Im (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G02B27/0172G02B27/01G06F3/002G06F3/011G06T7/70G06T19/006G02B2027/0161G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,379,362
App. No.
15/748,615
Granted
Aug 13, 2019
Kind
B2
Abstract

The present invention relates to a head mounted display (HMD) capable of receiving an image through a camera. An HMD according to an embodiment of the present invention comprises: a main body configured to be worn on a user's head; a camera equipped in the main body; a sensing unit configured to measure the distance between the main body and a subject corresponding to the image received through the camera; and a control unit which determines a plurality of feature points satisfying preset conditions in the image, measured, by means of the sensing unit, the distance between the main body and the subject corresponding to at least one of the plurality of feature points, and determines the movement of the main body on the basis of at least one of the plurality of feature points and the measured distance.

Claims (29)

1. A Head Mounted Display (HMD), comprising:

a main body formed to be wearable on a head of a user;

a camera provided in the main body;

a sensing unit configured to measure a distance between the main body and a subject corresponding to an image received through the camera; and

a controller configured to determine a plurality of feature points satisfying a preset condition in the image, measure using the sensing unit a distance between the main body and a subject corresponding to at least one of the plurality of feature points, and determine a motion of the main body based on at least one of the plurality of feature points and the measured distance

wherein the controller determines the motion of the main body based on a rate of change of relative distances among the plurality of feature points and a rate of change of the measured distance.

2. The display of claim 1 , wherein the controller determines a rotated degree of the main body based on the rate of change of the relative distances among the plurality of feature points and the rate of change of the measured distance, and

determines an actually moved distance of the main body based on the rate of change of the measured distance.

3. The display of claim 1 , wherein the main body is provided with at least two cameras disposed with being apart from each other, and

wherein the distance between the main body and the subject corresponding to the at least one feature point is measurable using the at least two cameras.

4. The display of claim 1 , wherein the controller receives a new image through the camera due to the motion of the main body, and determines a new feature point satisfying the preset condition in the new image when the plurality of feature points are not included in the new image.

5. The display of claim 4 , wherein the new feature point is present in plurality, and

wherein the controller measures a distance between the main body and a subject corresponding to at least one of the plurality of new feature points so as to use for determining the motion of the main body.

6. The display of claim 1 , wherein the controller determines a plurality of feature points satisfying the preset condition in a first image received through the camera, and generates first spatial information including information related to the plurality of feature points.

7. The display of claim 6 , wherein the information related to the plurality of feature points includes a distance between the main body and a subject corresponding to at least one of the plurality of feature points, and relative distances among the plurality of feature points.

8. The display of claim 6 , wherein the controller determines a plurality of feature points satisfying the preset condition in a second image different from the first image when the second image is received through the camera due to the motion of the main body, and generates second spatial information including information related to the plurality of feature points included in the second image based on a number of duplicate feature points between the plurality of feature points included in the first image and the plurality of feature points included in the second image.

9. The display of claim 8 , wherein the second spatial information is generated when the number of duplicate feature points is a preset number or less.

10. The display of claim 8 , wherein the controller generates stereoscopic spatial information using the first spatial information and the second spatial information.

11. A method of controlling a Head Mounted Display (HMD), the method comprising:

determining a plurality of feature points satisfying a preset condition in an image received through a camera;

measuring a distance between a main body thereof and a subject corresponding to at least one of the plurality of feature points; and

determining a motion of the HMD based on at east one of the plurality of feature points and the measured distance

wherein the determining is configured to determine the motion of the main body based on a rate of change of relative distances among the plurality of feature points and a rate of change of the measured distance.

12. The method of claim 11 , further comprising:

determining a plurality of feature points satisfying the preset condition in a new image received due to the motion of the HMD; and

generating three-dimensional (3D) spatial information based on information related to the plurality of feature points included in the image and information related to the plurality of feature points included in the new image.

13. The method of claim 12 , wherein the determining is configured to generating first spatial information including the information related to the plurality of feature points included in the image; and

generating second spatial information including the information related to the plurality of feature points included in the new image when the number of duplicate feature points among the plurality of feature points included in the image and the plurality of feature points included in the new image is a preset number or less, and

wherein the three-dimensional spatial information is generated using the first spatial information and the second spatial information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2018
From: BAEK, SUNGMIN; IM, SOUNGMIN
To: LG ELECTRONICS INC.
Reel/Frame 044770/0882 →
Priority Claims (1)
KR 10-2015-0110243 · Aug 4, 2015 · national
Continuity (1)
Related Publication 20190004316A1 · Jan 3, 2019
Cited By (1)
US 12,407,370