IP Library Granted Patent US 10,359,862
Granted Patent B2
US 10,359,862 · App. 15/651,239 · Granted Jul 23, 2019

Mobile terminal and method for controlling the same

Inventors: Beomsuk Moon (Seoul, KR); Minhyeok Kim (Seoul, KR); Yusol Ha (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G06F3/0346G06F3/012G06F3/016G06F3/017G06F3/038G06F3/0487G06F3/04845G06K9/00335
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,359,862
App. No.
15/651,239
Granted
Jul 23, 2019
Kind
B2
Abstract

The present invention relates to a system including a head mounted display, which is able to freely use a screen configured to output external environment while using virtual reality content using the head mounted display, and a method of controlling therefor.

Claims (63)

1. A head mounted display (HMD) system, comprising:

at least one external controller comprising:

a first wireless communication unit configured to transceive data with a HMD; and

a sensing unit configured to detect movement of the at least one external controller; and

the HMD comprising:

a display;

a camera;

a second wireless communication unit configured to transceive data with the at least one external controller; and

a controller configured to:

cause the display to display virtual reality (VR) content on a first screen of the display;

cause the display to display an external image received via the camera on a second screen of the display;

receive first movement information from the at least one external controller via the second wireless communication unit; and

cause the display to display the external image previously displayed on the second screen on the first screen based on the first movement information,

wherein the first movement information indicates that the at least one external controller is positioned at a screen switching area,

wherein the screen switching area corresponds to an area near the HMD and an eye of user wearing the HMD, and is positioned within a predetermined distance on the basis of the HMD.

2. The HMD system of claim 1 , wherein the controller is further configured to cause the display to display the VR content previously displayed on the first screen on the second screen based on the first movement information.

3. The HMD system of claim 1 , wherein the controller is further configured to: receive second movement information from the at least one external controller via the second wireless communication unit, wherein the second movement information corresponds to information indicating that the at least one external controller moves in a first direction after being positioned at the screen switching area; and maintain a state of displaying the external image on the first screen based on the second movement information.

4. The HMD system of claim 3 , wherein the controller is further configured to:

receive third movement information from the at least one external controller via the second wireless communication unit, wherein the third movement information corresponds to information indicating that the at least one external controller moves in a second direction after being positioned at the screen switching area; and

cause the display to re-display the VR content on the first screen based on the third movement information.

5. The HMD system of claim 4 , wherein the controller is further configured to:

receive fourth movement information from the at least one external controller via the second wireless communication unit; and

control at least one of the VR content or the external image based on the fourth movement information.

6. The HMD system of claim 5 , wherein the fourth movement information comprises direction information indicating that the at least one external controller is facing the first screen or the second screen.

7. The HMD system of claim 6 , wherein the controller is further configured to control the at least one external device based on the fourth movement information when the at least one external controller is facing the first screen.

8. The HMD system of claim 1 , wherein the at least one external controller comprises a first external controller and a second external controller.

9. The HMD system of claim 8 , wherein the controller is further configured to:

map the first external controller to control the VR content; and

map the second external controller to control the external image.

10. The HMD system of claim 1 , wherein the controller is further configured to cause the display to output the second screen at one side of an object corresponding to the at least one external controller displayed on the display.

11. The HMD system of claim 1 , wherein the controller is further configured to cause the display to display a real time external image received via the camera on the second screen.

12. The HMD system of claim 1 , wherein the controller is further configured to perform a pairing with the at least one external controller via the second wireless communication unit.

13. The HMD system of claim 1 , wherein the controller is further configured to:

receive second movement information from the at least one external controller via the second wireless communication unit; and

change at least a size, a position, or a form of the second screen on which the external image is displayed based on the second movement information, causing the display to output the changed second screen.

14. The HMD system of claim 13 , wherein the controller is further configured to:

output the second screen by magnifying the size of the second screen when the second movement information indicates that a distance between the at least one external controller and the HMD is decreasing; and

output the second screen by reducing the size of the second screen when the second movement information indicates that the distance between the at least one external controller and the HMD is increasing.

15. The HMD system of claim 14 , wherein an angle of a view of the external image displayed on the second screen is uniformly maintained.

16. The HMD system of claim 1 , wherein a size of the first screen is greater than a size of the second screen.

17. The HMD system of claim 1 , wherein:

the second screen is displayed in a manner of being overlaid on the first screen; and

the second screen is displayed at a closer distance compared to the first screen on the basis of the HMD.

18. A head mounted display (HMD), comprising:

a display;

a camera;

a wireless communication unit configured to transceive data with at least one external controller; and

a controller configured to:

cause the display to display virtual reality (VR) content on a first screen of the display;

cause the display to display an external image received via the camera on a second screen of the display;

receive movement information from the at least one external controller via the wireless communication unit; and

cause the display to display the external image previously displayed on the second screen on the first screen based on the movement information,

wherein the movement information indicates that the controller is positioned at a screen switching area,

wherein the screen switching area corresponds to an area near the HMD and an eye of user wearing the HMD, and is positioned within a predetermined distance on the basis of the HMD.

19. A method of controlling a head mounted display (HMD) system comprising a head mounted display (HMD) and at least one external controller, comprising:

displaying virtual reality (VR) content on a first screen of a display of the HMD;

displaying an external image received via a camera on a second screen of the display;

sensing movement of the at least one external controller via a sensing unit of the at least one external controller;

transmitting movement information to the HMD via a wireless communication unit of the at least one external controller based on the sensed movement;

receiving the movement information from the at least one external controller via a wireless communication unit of the HMD; and

displaying the external image previously displayed on the second screen on the first screen based on the movement information,

wherein the movement information indicates that the at least one external controller is positioned at a screen switching area,

wherein the screen switching area corresponds to an area near the HMD and an eye of user wearing the HMD, and is positioned within a predetermined distance on the basis of the HMD.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2017
From: MOON, BEOMSUK; KIM, MINHYEOK; HA, YUSOL
To: LG ELECTRONICS INC
Reel/Frame 043024/0348 →
Priority Claims (1)
KR 10-2017-0026281 · Feb 28, 2017 · national
Continuity (1)
Related Publication 20180246565A1 · Aug 30, 2018
Cited By (2)
US 12,210,671 US 12,614,361