IP Library › Granted Patent US 10,002,429
Granted Patent B2
US 10,002,429 · App. 14/828,107 · Granted Jun 19, 2018

Apparatus and method for notifying a virtual reality user of real world objects

Inventors: Suk Hwan Yoon (Sunnyvale, CA); Waddah Kudaimi (San Jose, CA)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T7/004G06F3/011G06F3/167G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,002,429
App. No.
14/828,107
Granted
Jun 19, 2018
Kind
B2
Abstract

A virtual reality apparatus comprising: i) a plurality of sensors for detecting objects in the vicinity of a user of the virtual reality apparatus; and ii) a controller coupled to the plurality of sensors and configured to determine that an object has been detected. The controller determines a direction of the detected object with respect to the user. The controller generates a glowing region in a virtual reality image being viewed by the user. The location of the glowing region in the virtual reality image notifies the user of the direction of the detected object. The controller generates an audible notification in response to detection of the detected object and determines a distance of the detected object with respect to the user.

Claims (31)

1. A virtual reality apparatus comprising:

a plurality of sensors configured to detect objects in a vicinity of a user of the virtual reality apparatus;

a display configured to display a virtual reality image, wherein the display comprises a plurality of peripheral regions; and

a controller coupled to the plurality of sensors and configured to determine that an object has been detected and to determine a direction of and a relative distance to the detected object with respect to the virtual reality apparatus,

wherein the controller is further configured to generate a glowing region in at least one of the peripheral regions of the plurality of peripheral regions, wherein a location of the glowing region is configured to indicate the direction of the detected object with respect to the virtual reality apparatus, wherein the controller is further configured to modify a thickness parameter of the glowing region in the peripheral region of the plurality of peripheral regions such that the modified thickness parameter of the glowing region increases as the relative distance to the detected object decreases with respect to the virtual reality apparatus, the thickness parameter notifies a user of the relative distance of the detected object, and wherein the plurality of peripheral regions comprise at least a lateral peripheral region and a vertical peripheral region and wherein the vicinity comprises an area that includes:

in front of the user, and

at least one of: to a side of the user, to a rear of the user, above the user, or below a field of view of a user.

2. The virtual reality apparatus as set forth in claim 1 , wherein the controller is further configured to generate an audible notification in response to detection of the detected object.

3. The virtual reality apparatus as set forth in claim 1 , wherein the controller is further configured to modify a brightness parameter of the glowing region such that the modified brightness parameter of the glowing region increases as the relative distance to the detected object decreases with respect to the virtual reality apparatus.

4. The virtual reality apparatus as set forth in claim 1 , wherein the controller is further configured to generate an audible notification in response to detection of the detected object.

5. The virtual reality apparatus as set forth in claim 4 , wherein the controller is further configured to modify a frequency of the audible notification to indicate the relative distance to the detected object is decreasing with respect to the virtual reality apparatus.

6. A method comprising:

displaying, by a display in a virtual reality apparatus, a virtual reality image, wherein the display comprises a plurality of peripheral regions;

detecting, by a plurality of sensors in the virtual reality apparatus, an object in a vicinity of the virtual reality apparatus;

determining, by a controller in the virtual reality apparatus, a direction and a relative distance to the detected object with respect to the virtual reality apparatus; and

in response to determining that an object has been detected proximate to the virtual reality apparatus, generating a glowing region in at least one of the plurality of peripheral regions, wherein a location of the glowing region is configured to indicate the direction of the detected object with respect to the virtual reality apparatus, wherein a thickness parameter of the glowing region in at least one of the peripheral regions increases as the relative distance to the detected object decreases with respect to the virtual reality apparatus, the thickness parameter notifies a user of the relative distance to the detected object, and wherein the plurality of peripheral regions comprise at least a lateral peripheral region and a vertical peripheral region and wherein the vicinity comprises an area that includes:

in front of the user, and

at least one of: to a side of the user, to a rear of the user, above the user, or below a field of view of a user.

7. The method as set forth in claim 6 , further comprising generating an audible notification in response to detection of the detected object.

8. The method as set forth in claim 6 , wherein a brightness parameter of the glowing region in at least one of the peripheral regions increases as the relative distance to the detected object decreases with respect to the virtual reality apparatus.

9. The method as set forth in claim 6 , further comprising generating an audible notification in response to detection of the detected object.

10. The method as set forth in claim 9 , further comprising modifying a frequency of the audible notification to indicate the detected object is moving towards the virtual reality apparatus.

11. A non-transitory computer readable medium comprising a plurality of instructions, when executed, the plurality of instructions configured to cause one or more processors of a virtual reality apparatus to:

detect, via a plurality of sensors, objects in a vicinity of a user of the virtual reality apparatus;

display, via a screen, a virtual reality image, wherein the screen comprises a plurality of peripheral regions; and

a controller coupled to the plurality of sensors and configured to determine that an object has been detected and to determine a direction of the detected object and a relative distance to the detected object with respect to the virtual reality apparatus, wherein the controller is further configured to generate a glowing region in at least one of the peripheral regions, wherein a location of the glowing region in one or more of the plurality of peripheral regions is configured to indicate the direction of the detected object with respect to the virtual reality apparatus, wherein the controller is further configured to modify a thickness parameter of the glowing region in at least one of the peripheral regions such that the thickness parameter increases as the relative distance to the detected object decreases with respect to the virtual reality apparatus, the thickness parameter notifies a user of the relative distance to the detected object, and wherein the plurality of peripheral regions comprise at least a lateral peripheral region and a vertical peripheral region and wherein the vicinity comprises an area that includes:

in front of the user, and

at least one of: to a side of the user, to a rear of the user, above the user, or below a field of view of a user.

12. The non-transitory computer readable medium as set forth in claim 11 , wherein the plurality of instructions is further configured to cause the one or more processors to generate an audible notification in response to detection of the detected object.

13. The non-transitory computer readable medium as set forth in claim 12 , wherein the controller is further configured to modify a frequency of the audible notification to indicate the detected object is moving towards the virtual reality apparatus.

14. The virtual reality apparatus as set forth in claim 1 , wherein one or more of the plurality of sensors are disposed on a headstrap of the virtual reality apparatus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2015
From: YOON, SUK HWAN; KUDAIMI, WADDAH
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 036342/0263 →
Continuity (1)
Related Publication 20170053440A1 · Feb 23, 2017
Cited By (1)
US 12,315,363