IP Library Granted Patent US 9,147,290
Granted Patent B2
US 9,147,290 · App. 13/777,678 · Granted Sep 29, 2015

Head mounted display and method for controlling the same

Inventor: Jihyun Kim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G06T19/006G02B27/017G06F3/011G07B11/00G02B2027/014G02B2027/0138G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,147,290
App. No.
13/777,678
Granted
Sep 29, 2015
Kind
B2
Abstract

A head mounted display (HMD) and a method for controlling the same are disclosed. Most particularly, the HMD and the method for controlling the same may detect an external device having a ticket stored therein and display augmented reality information related to the stored ticket in a location approximate to an individual carrying an external device, in order to check tickets.

Claims (46)

1. A head mounted display (HMD), comprising:

a camera unit configured to capture an image;

a display unit configured to display augmented reality information;

a communication unit configured to transmit and receive data to and from an external device;

a sensor unit configured to sense a position of the HMD and to deliver the sensed position to a processor; and

the processor configured to control the camera unit, the display unit, the communication unit, and the sensor unit,

wherein the processor is further configured to:

control the communication unit to request ticket information from the external device,

control the communication unit to receive a response including the ticket information according to the request from the external device,

acquire augmented reality information associated with the ticket information, when the ticket information received by the communication unit from the external device is valid,

detect an object related to the external device in the image captured by the camera unit, and

control the display unit to display the augmented reality information associated with the ticket information on a surrounding area of the detected object.

2. The HMD of claim 1 , wherein the processor acquires position information of the external device, and

wherein the processor extracts at least one of distance information, direction information, and altitude information of the external device with reference to a position of the HMD from the acquired position information of the external device.

3. The HMD of claim 2 , wherein the processor receives the position information according to a global positioning system (GPS) from the external device or acquires the position information by using wireless LAN signal information of the external device and an address information where the HMD is positioned.

4. The HMD of claim 2 , wherein the processor captures an image, when the processor detects that the external device is located within an angle of a view zone of the HMD according to the position information of the external device.

5. The HMD of claim 2 , wherein the processor detects an object related to the external device in the captured image by using at least one of the distance information, direction information, and altitude information of the external device.

6. The HMD of claim 2 , wherein the captured image includes a three-dimensional (3D) image, and wherein the processor extracts depth information of at least one object included in the captured image.

7. The HMD of claim 6 , wherein the processor detects an object related to the external device in the captured image by using the depth information and at least one of the distance information, direction information, and altitude information of the external device.

8. The HMD of claim 2 , wherein the processor generates an identification area corresponding to a position of the external device within the captured image by using at least one of distance information, direction information, and altitude information of the external device, and

wherein the processor detects an object including the identification area or an object neighboring the identification area.

9. The HMD of claim 1 , wherein the processor converts a format of the captured image to a gray mode, extracts a borderline from the converted image, and recognizes an object based on the extracted borderline.

10. The HMD of claim 9 , wherein the processor recognizes an object based on a looped curve from the extracted borderline.

11. The HMD of claim 1 , wherein the processor requests the ticket information to at least one external object by using a broadcast way.

12. The HMD of claim 1 , wherein the ticket information includes valid time information of the ticket, place information of the ticket, and identification information for distinguishing the ticket from other tickets, and

wherein the augmented reality information is matched with the identification information.

13. The HMD of claim 1 , wherein the augmented reality information includes the ticket information or a ticket purchase history.

14. The HMD of claim 1 , wherein the processor acquires the augmented reality information from a server that has issued the ticket.

15. The HMD of claim 1 , wherein the processor transmits certification information to the external device, when the ticket information is valid.

16. The HMD of claim 15 , wherein the processor transmits the certification information, if the processor detects an eyesight of a user focused on the displayed augmented reality information.

17. A method for controlling a head mounted display (HMD), the method comprising:

requesting, by a communication unit in the HMD, ticket information from an external device;

receiving, by the communication unit, a response including the ticket information according to the request from the external device;

acquiring, by a processor in the HMD, augmented reality information associated with the ticket information, when the ticket information received by the communication unit from the external device is valid;

capturing, by a camera unit in the HMD, an image;

detecting, by the processor, an object related to the external device in the image captured by the camera unit; and

displaying, by a display unit in the HMD, the augmented reality information associated with the ticket information on a surrounding area of the detected object.

18. The method of claim 17 , further comprising:

acquiring, by the processor, position information of the external device; and

extracting, by the processor, at least one of distance information, direction information, and altitude information of the external device with reference to a position of the HMD, based on the acquired position information of the external device.

19. The method of claim 17 , wherein the detecting the object comprises:

converting, by the processor, a format of the captured image to a gray mode;

extracting, by the processor, a borderline from the converted image;

recognizing, by the processor, an object based on a looped curve from the extracted borderline;

detecting, by the processor, an identification area corresponding to a position of the external device within the captured image by using at least one of the distance information, direction information, and altitude information of the external device; and

detecting, by the processor, an object including the identification area or an object neighboring the identification area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2013
From: KIM, JIHYUN
To: LG ELECTRONICS INC.
Reel/Frame 029889/0614 →
Priority Claims (1)
KR 10-2013-0001107 · Jan 4, 2013 · national
Continuity (1)
Related Publication 20140192085A1 · Jul 10, 2014