IP Library Granted Patent US 9,423,619
Granted Patent B2
US 9,423,619 · App. 14/203,315 · Granted Aug 23, 2016

Head mounted display and method of outputting a content using the same in which the same identical content is displayed

Inventor: Yongsin Kim (Seoul, KR)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G02B27/017G06F3/1454G02B2027/014G02B2027/0123G02B2027/0178G09G5/12G09G2370/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,423,619
App. No.
14/203,315
Granted
Aug 23, 2016
Kind
B2
Abstract

A HMD (head mounted display) and its methods are discussed. In one embodiment, the HMD includes a processor which can detect a first marker of a augmented reality image within a view angle region of the HMD, and determine a location state of the first marker, the location state including a first state in which the first marker is located within the view angle region of the HMD and a second state in which the first marker is located beyond the view angle region. When the location state of the first marker is switched from the first state to the second state, the processor can start displaying the augmented reality image on a display unit, and when the location state of the first marker is switched from the second state to the first state, the processor can stop displaying the augmented reality image on the display unit.

Claims (41)

1. An HMD (head mounted display) comprising:

a processor configured to control an operation of the HMD;

a sensor unit configured to detect a real object and a marker of an augmented reality image;

a display unit configured to output the augmented reality image based on the detected marker; and

a communication unit configured to transmit and receive data with an external server,

wherein the processor is further configured to:

detect a first real object including a first marker of a first augmented reality image within a view angle region of the HMD, the first real object including visual content,

determine whether content of the first augmented reality image is identical to visual content of the first real object,

determine a location state of the first marker, the location state comprising a first state in which the first marker is located within the view angle region of the HMD and a second state in which the first marker is located beyond the view angle region,

when the location state of the first marker is switched from the first state to the second state, start displaying the first augmented reality image on the display unit, and

when the location state of the first marker is switched from the second state to the first state, if content of the first augmented reality image is identical to visual content of the first real object, stop displaying the first augmented reality image on the display unit.

2. The HMD of claim 1 , wherein the first marker is a printed image on the first real object which is located within the view angle region of the HMD.

3. The HMD of claim 2 , wherein the first real object includes a book, a magazine, a newspaper or a photograph.

4. The HMD of claim 2 , wherein the first marker includes a bar code, a QR code, a color code or an image code.

5. The HMD of claim 1 , wherein the processor is further configured to receive the first augmented reality image from the external server.

6. The HMD of claim 1 , wherein the processor is further configured to stop displaying the first augmented reality image when a second marker is detected within the view angle region of HMD.

7. The HMD of claim 1 , wherein the processor is further configured to not display the first augmented reality image of the first maker while the first marker is located within the view angle region of the HMD.

8. The HMD of claim 1 , wherein the processor is further configured to display the first augmented reality image of the first marker while the first marker is located beyond the view angle region of the HMD.

9. The HMD of claim 1 , wherein the location state of the first marker is determined further based on eyes of a user who wears the HMD.

10. The HMD of claim 9 , wherein the HMD further comprises an image photographing sensor configured to detect a position of the eyes of the user wearing the HMD.

11. The HMD of claim 9 , wherein the location state of the first marker is determined based on whether the first marker is located within a view angle region of the user.

12. A method of displaying an augmented reality image using an HMD (head mounted display), comprising:

detecting a first real object including a first marker of a first augmented reality image within a view angle region of the HMD, the first real object including visual content;

determining whether content the first augmented reality image is identical to visual content of the first real object;

determining a location state of the first marker, the location state comprising a first state in which the first marker is located within the view angle region of the HMD and a second state in which the first marker is located beyond the view angle region;

when the location state of the first marker is switched from the first state to the second state, displaying the first augmented reality image on a display unit of the HMD; and

when the location state of the first marker is switched from the second state to the first state, if content of the first augmented reality image is identical to visual content of the first real object, excluding the first augmented reality image from the display unit of the HMD.

13. The method of displaying an augmented reality image of claim 12 , wherein the first marker is a printed image on the first real object which is located within the view angle region of the HMD.

14. The method of displaying an augmented reality image of claim 13 , wherein the first real object includes a book, a magazine, a newspaper, or a photograph.

15. The method of displaying an augmented reality image of claim 13 , wherein the first marker includes a bar code, a QR code, a color code or an image code.

16. The method of displaying an augmented reality image of claim 12 , further comprising:

receiving the first augmented reality image from the external server.

17. The method of displaying an augmented reality image of claim 12 , further comprising:

terminating the first augmented reality image when a second marker is detected within the view angle region of the HMD.

18. The method of displaying an augmented reality image of claim 12 , further comprising:

excluding the first augmented reality image of the first marker from the display unit while the first marker is located within the view angle region of the HMD.

19. The method of displaying an augmented reality image of claim 12 , further comprising:

displaying the first augmented reality image of the first marker while the first marker is located beyond the view angle region of the HMD.

20. The method of displaying an augmented reality image of claim 12 , wherein the location state of the first marker is determined further based on eyes of a user who wears the HMD.

21. The method of displaying an augmented reality image of claim 20 , wherein the HMD further comprises an image photographing sensor configured to detect a position of the eyes of the user wearing the HMD.

22. The method of displaying an augmented reality image of claim 20 , wherein the location state of the first marker is determined based on whether the first marker is located within a view angle region of the user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2016
From: KIM, YONGSIN
To: LG ELECTRONICS INC.
Reel/Frame 038444/0490 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2015
From: LG ELECTRONICS INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 036042/0088 →
Priority Claims (1)
KR 10-2012-0077352 · Jul 16, 2012 · national
Continuity (3)
Continuation 13850108 · Mar 25, 2013
Continuation 13587527 · Aug 16, 2012
Related Publication 20140191929A1 · Jul 10, 2014