IP Library Granted Patent US 10,691,220
Granted Patent B2
US 10,691,220 · App. 15/896,732 · Granted Jun 23, 2020

Method for display of information from real world environment on a virtual reality (VR) device and VR device thereof

Inventors: Varun Nigam (Kanpur, IN); Veenu Pandey (Delhi, IN)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/017G06F3/011G06F3/012G06F3/013G06F3/16G06F3/167G06T19/006A61B5/01A61B5/021A61B5/024A61B5/0816A61B5/163G06F2203/011G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,691,220
App. No.
15/896,732
Granted
Jun 23, 2020
Kind
B2
Abstract

The present invention relates to method ( 1100 ) for display of information from real world environment on a virtual reality (VR) device ( 101 ). In accordance with one embodiment, the method comprises capturing ( 1101 ) an event in a real world environment; and presenting ( 1103 ) information pertaining to the captured event on a VR enabled display unit ( 106 ) without absolute interruption of an ongoing rendering of content on the VR enabled display unit ( 106 ), if the event thus captured satisfies at least one predetermined rule.

Claims (88)

1. A method for display of information on a virtual reality (VR) device, the method comprising:

displaying at least one VR content on a screen of a VR enabled display unit;

detecting at least one event in a real world environment;

determining information corresponding to the detected at least one event; and

dividing, if the detected at least one event satisfies at least one predetermined rule, the screen of the VR enabled display unit into at least two display areas including a first display area and a second display area, displaying continuously the at least one VR content on the first display area and displaying the determined information on the second display area,

wherein the information includes at least one of a real time video depicting the real world environment and a real time image depicting the real world environment and is captured by at least one sensor unit of the VR device.

2. The method of claim 1 , wherein the at least one event is detected by the at least one sensor unit, the at least one sensor unit comprising an eye-tracing sensor, a facial expression sensor, a touch panel, a vibrator, an optics module, an accelerometer, a gyroscope, a geomagnetic sensor, a magnetic sensor, a proximity sensor, a gesture sensor, a grip sensor, a biometric sensor, an access sensor, a camera module, an audio module, an atmospheric pressure sensor, a red, green, blue (RGB) sensor, a temperature sensor, a humidity sensor, a light sensor, a physiological sensor, a location/position detection sensor, or an ultraviolet (UV) sensor.

3. The method of claim 1 , wherein the at least one event corresponds to a change within a predefined area in the real world environment surrounding the VR device and includes at least one of:

a risk or a threat to a user of the VR device,

a physiological state of the user of the VR device,

a gesture input,

an audio input,

an eye gaze movement,

a facial expression of a person proximate to the VR device,

a movement of the VR device,

a proximity of a person to the VR device,

a proximity of an object to the VR device, or

a sudden movement in proximity to the VR device.

4. The method of claim 1 , wherein the at least one predetermined rule includes:

the at least one event or at least one parameter associated with the at least one event is predefined in a memory;

the at least one event or at least one parameter associated with the at least one event is specified by a user;

at least one parameter associated with the event has a value higher than a predefined threshold value; and

at least one parameter associated with the event has a constant value for a predefined threshold value of time.

5. The method of claim 1 , wherein the determined information is displayed on the screen of the VR enabled display unit in one of: an overlay mode, a picture-in-picture mode, a split screen mode, a split view mode, and a sectional view mode.

6. The method of claim 1 , wherein the information is displayed based on the at least one predetermined rule.

7. The method of claim 1 , wherein the displaying the information comprises:

determining a direction of the detected at least one event;

determining a position on the VR enabled display unit based on the determined direction;

selecting the first display area on the VR enabled display unit based on the determined position; and

presenting the information at the first display area on the screen of the VR enabled display unit.

8. The method of claim 1 , wherein the displaying the information comprises:

determining at least one of a type of the detected at least one event, a priority level of the detected at least one event, or an application rendering the at least one VR content, based on the at least one predetermined rule;

selecting the second display area on the VR enabled display unit based on the determined type; and

presenting the information at the second display area on the screen of the VR enabled display unit.

9. The method of claim 1 , further comprising:

detecting a view-time event, the view-time event being one of:

expiry of a predetermined time from a time of capturing of the event;

a movement of the VR device from a first position to a second position subsequent to the detecting of the at least one event;

a reception of a predefined gesture input; or

a reception of a predefined audio input; and

controlling the presentation of the information on the VR enabled display unit based on the view time event.

10. A virtual reality (VR) device for displaying information, the VR device comprising:

at least one sensor unit to detect at least one event;

a VR enabled display unit;

at least one processor; and

a memory configured to store instructions which, when executed, cause the at least one processor to:

display at least one VR content on a screen of the VR enabled display unit,

detect the at least one event in a real world environment,

determine information corresponding to the detected at least one event through the at least one sensor unit,

divide, if the detected at least one event satisfies at least one predetermined rule, the screen of the VR enabled display unit into at least two display areas including a first display area and a second display area,

display continuously the at least one VR content on the first display area, and

display the determined information on the second display area,

wherein the information includes at least one of a real time video depicting the real world environment and a real time image depicting the real world environment and is captured by the at least one sensor unit of the VR device.

11. The VR device of claim 10 , wherein the at least one sensor unit comprises an eye-tracing sensor, a facial expression sensor, a touch panel, a vibrator, an optics module, an accelerometer, a gyroscope, a geomagnetic sensor, a magnetic sensor, a proximity sensor, a gesture sensor, a grip sensor, a biometric sensor, an access sensor, a camera module, an audio module, an atmospheric pressure sensor, a red, green, blue (RGB) sensor, a temperature sensor, a humidity sensor, a light sensor, a physiological sensor, a location/position detection sensor, or an ultraviolet (UV) sensor.

12. The VR device of claim 10 , wherein the at least one event corresponds to a change within a predefined area in the real world environment surrounding the VR device and includes at least one of:

a risk or a threat to a user of the VR device,

a physiological state of the user of the VR device,

a gesture input,

an audio input,

an eye gaze movement,

a facial expression of a person proximate to the VR device,

a movement of the VR device,

a proximity of a person to the VR device,

a proximity of an object to the VR device, or

a sudden movement in proximity to the VR device.

13. The VR device of claim 10 , wherein the at least one predetermined rule includes:

the at least one event or at least one parameter associated with the at least one event is predefined in a memory;

the at least one event or at least one parameter associated with the at least one event is specified by a user;

at least one parameter associated with the event has a value higher than a predefined threshold value; and

at least one parameter associated with the event has a constant value for a predefined threshold value of time.

14. The VR device of claim 10 , wherein the determined information is displayed on the screen of the VR enabled display unit in one of: an overlay mode, a picture-in-picture mode, a split screen mode, a split view mode, and a sectional view mode.

15. The VR device of claim 10 wherein the determined information is displayed based on the at least one predetermined rule.

16. The VR device of claim 10 , wherein the instructions further cause the at least one processor to:

determine a direction of the detected at least one event;

determine a position on the VR enabled display unit based on the determined direction;

select the first display area on the display based on the determined position; and

present the information on the first display area of the screen of the VR enabled display unit.

17. The VR device of claim 10 , wherein the instructions further cause the at least one processor to:

determine at least one of a type of the detected at least one event, a priority level of the detected at least one event, or an application rendering the at least one VR content based on the at least one predetermined rule;

select the second display area on the display based on the determined type; and

present the information at the second display area of the screen of the VR enabled display unit.

18. The VR device of claim 10 , wherein the instructions further cause the at least one processor to:

detect a view-time event, the view-time event being one of:

expiry of a predetermined time from a time of capturing of the event;

a movement of the VR device from a first position to a second position subsequent to the capturing of the event,

a reception of a predefined gesture input, or

a reception of a predefined audio input; and

control the presentation of the information on the VR enabled display unit based on the view-time event.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2018
From: NIGAM, VARUN; PANDEY, VEENU
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 044930/0879 →
Priority Claims (1)
IN 201711005259 · Feb 14, 2017 · national
Continuity (1)
Related Publication 20180232056A1 · Aug 16, 2018
Cited By (1)
US 12,664,624