IP Library Granted Patent US 10,318,007
Granted Patent B2
US 10,318,007 · App. 15/110,052 · Granted Jun 11, 2019

Head mounted display device for multi-tasking and method for controlling same

Inventors: Sangyun Lee (Seoul, KR); Sunghwan Jeon (Seoul, KR); Seehwan Yoo (Seoul, KR); Dojung Kim (Seoul, KR); Haejin Cho (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G06F3/017G02B27/017G06F3/011G06F3/0304G06F3/0482G06F3/04815G06F3/14G06T11/00G06T19/006G02B2027/014G02B2027/0178G02B2027/0187G06F3/1454G09G3/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,318,007
App. No.
15/110,052
Granted
Jun 11, 2019
Kind
B2
Abstract

A head mounted display device can include a display unit configured to output an image; a sensing unit configured to sense a first gesture input based on an image acquired through a camera; and a controller configured to recognize an external terminal corresponding to the first gesture input, execute a first function associated with the first gesture input while the first gesture input is sensed, sense, via the sensing unit, a second gesture input while the first function is being executed, maintain the execution of the first function while the first gesture input and second gesture input are no longer sensed, sense, via the sensing unit, a third gesture input, and in response to sensing the third gesture input, execute a second function together with the first function while the third gesture is sensed.

Claims (30)

1. A head mounted display device, comprising:

a communication unit;

a display unit configured to output an image;

a sensing unit configured to sense a first gesture input based on an image acquired through a camera; and

a controller configured to:

recognize a first external terminal corresponding to the first gesture input,

execute a first function associated with the first gesture input while the first gesture input is sensed,

sense, via the sensing unit, a second gesture input while the first function is being executed,

maintain the execution of the first function while the first gesture input and second gesture input are no longer sensed,

sense, via the sensing unit, a third gesture input;

recognize a second external terminal corresponding to the third gesture input and connect the second external terminal to the head mounted display device through the communication unit; and

in response to sensing the third gesture input, execute a second function related to the second external terminal together with the first function while the third gesture is sensed.

2. The head mounted display device of claim 1 , wherein the first function and the second function correspond to at least one application, respectively.

3. The head mounted display device of claim 1 , wherein the controller outputs information corresponding to each of a plurality of functions on the display unit when the plurality of functions match the first gesture input, and executes a function selected by a user selection among those information.

4. The head mounted display device of claim 3 , wherein the controller outputs those information near one area of the display unit, through which a user's body portion is transmitted.

5. The head mounted display device of claim 1 , wherein the controller outputs first screen information corresponding to a plurality of peripheral devices on the display unit when the function matched with the first gesture input is a function associated with the plurality of peripheral devices, and wherein the plurality of peripheral devices are located in different directions from one another on the first screen information.

6. The head mounted display device of claim 5 , wherein the controller, when the first screen information is output, connects with at least one of the plurality of peripheral devices to enable communication therewith and output second screen information related to the connected peripheral device on the display unit, in response to an additional gesture, and

wherein the controller controls an operation of the connected peripheral device, in response to a user gesture additionally recognized with respect to the second screen information.

7. The head mounted display device of claim 1 , further comprising a memory configured to store information related to the first function of the first external terminal matched with the first gesture input,

wherein the controller extracts the matched function and the information related to the first function of the first external terminal from the memory when the first gesture input is sensed.

8. A method for controlling a head mounted display device provided with a display unit to output an image, the method comprising:

sensing, via a sensing unit, a first gesture input based on an image acquired through a camera;

recognizing, via a controller, a first external terminal corresponding to the first gesture input;

executing, via the controller, a first function associated with the first gesture input while the first gesture input is sensed;

sensing, via the sensing unit, a second gesture input while the first function is being executed;

maintaining, via the controller, the execution of the first function while the first gesture input and second gesture input are no longer sensed;

sensing, via the sensing unit, a third gesture input;

recognizing a second external terminal corresponding to the third gesture input and connecting the second external terminal to the head mounted display device through wireless communication; and

in response to sensing the third gesture input, executing, via the controller, a second function related to the second external terminal together with the first function while the third gesture is sensed.

9. The method of claim 8 , wherein the first function and the second function correspond to an execution of at least one application, respectively.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2016
From: LEE, SANGYUN; JEON, SUNGHWAN; YOO, SEEHWAN; KIM, DOJUNG; CHO, HAEJIN
To: LG ELECTRONICS INC.
Reel/Frame 039101/0637 →
Continuity (1)
Related Publication 20160328021A1 · Nov 10, 2016
Cited By (2)
US 12,314,471 US 12,632,106