IP Library Granted Patent US 9,939,635
Granted Patent B2
US 9,939,635 · App. 15/143,258 · Granted Apr 10, 2018

Method for providing notification in virtual reality device

Inventors: Renji Kuruvilla Thomas (Bangalore, IN); Gaurav Jain (Bangalore, IN); Venkat Kumar Sivaramamurthy (Bangalore, IN); Puneet Gupta (Bangalore, IN); Karthik Gopalakrishnan Vinmani (Bangalore, IN)
Assignee: Brillio LLC
G02B27/0093G02B27/017G06T19/006G08B5/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,939,635
App. No.
15/143,258
Granted
Apr 10, 2018
Kind
B2
Abstract

Embodiments herein provide a method for providing a notification in a Virtual Reality (VR) device. The method includes detecting, by a processor, an obstacle in proximity to a user while VR content is displayed on a screen of the VR device worn by the user. Further, the method includes detecting, by the processor, a severity level of the obstacle based on at least one parameter. Further, the method includes providing, by a notification engine, a notification on a portion of the screen of the VR device based on the severity level.

Claims (73)

1. A method for providing a notification in a Virtual Reality (VR) device, the method comprising:

detecting, by a processor, an obstacle in proximity to a user while a VR content is displayed on a screen of the VR device worn by the user based on an obstacle threshold, wherein the obstacle threshold is dynamically determined based on user reflexes indicating a response of the user for at least one of the obstacle and notifications in a past session;

computing, by the processor, a severity level of the obstacle based on at least one parameter; and

providing, by a notification engine, a first notification on a portion of the screen of the VR device based on the severity level.

2. The method of claim 1 , wherein the method further comprising:

tracking, by the processor, a movement of at least one of the user and the obstacle;

computing, by the processor, a distance between the obstacle and the VR device based on the movement of at least one of the user and the obstacle;

determining, by the processor, whether the distance meets a severity threshold; and

providing, by the notification engine, a second notification on a portion of the screen of the VR device based on the severity threshold.

3. The method of claim 2 , wherein the second notification is provided to alert the user about the obstacle ahead of time to avoid collision of the user with the obstacle, wherein a type of the second notification is dynamically determined based on an ambient noise around the user, the user reflexes, the severity level of the obstacle, the obstacle threshold, and the severity threshold.

4. The method of claim 2 , further comprising:

detecting by the processor a user reflex indicating a time taken by the user to respond to the second notification and a response of the user to the second notification; and

dynamically updating by the processor the obstacle threshold and the severity threshold based on the user reflex for the second notification.

5. The method of claim 1 , wherein detecting, by the processor, the obstacle while the VR content is displayed on the screen of the VR device worn by the user comprising:

detecting a physical object in proximity to the user while the VR content is displayed on the screen of the VR device;

tracking a movement of at least one of the user and the physical object;

computing a distance between the object and the VR device based on the movement;

dynamically determining the obstacle threshold based on the user reflexes;

determining that the distance meets the obstacle threshold; and

detecting the obstacle in response to determining the distance meets the obstacle threshold.

6. The method of claim 1 , wherein at least one of improvement and degradation of the user reflexes are dynamically tracked based on learning from at least one of a time taken by the user to respond to notification, a current response of the user for the obstacle and the past response of the user for the obstacle.

7. The method of claim 1 , wherein the parameter is an output of an obstacle tracker, an obstacle detector, a movement detector, and a context engine.

8. The method of claim 1 , wherein the first notification is at least one of a visual notification, an audio notification, and a vibration notification and is provided to alert the user about the obstacle ahead of time to avoid collision of the user with the obstacle, wherein a type of the first notification is dynamically determined based on an ambient noise around the user, the user reflexes, the severity level of the obstacle and the obstacle threshold.

9. The method of claim 1 , further comprising:

detecting by the processor a user reflex indicating a time taken by the user to respond to the first notification and a response of the user to the first notification; and

dynamically updating by the processor the obstacle threshold based on the user reflex for the first notification.

10. A Virtual Reality (VR) device for providing a notification, the VR device comprising:

a memory;

a processor configured to:

detect an obstacle in proximity to a user while a VR content is displayed on a screen of the VR device worn by the user based on an obstacle threshold, wherein the obstacle threshold is dynamically determined based on user reflexes indicating a response of the user for at least one of the obstacle and notifications in a past session; and

detect a severity level of the obstacle based on at least one parameter; and

a notification engine configured to provide a first notification on a portion of the screen of the VR device based on the severity level.

11. The VR device of claim 10 , wherein the processor unit is further configured to:

track a movement of at least one of the user and the obstacle;

compute a distance between the obstacle and the VR device based on the movement of at least one of the user and the obstacle; and

determine whether the distance meets a severity threshold; and

provide a second notification on a portion of the screen of the VR device based on the severity threshold.

12. The VR device of claim 11 , wherein the second notification is provided to alert the user about the obstacle ahead of time to avoid collision of the user with the obstacle, wherein a type of the second notification is dynamically determined based on an ambient noise around the user, the user reflexes, the severity level of the obstacle, the obstacle threshold, and the severity threshold.

13. The VR device of claim 11 , wherein the processor is further configured to:

detect a user reflex indicating a time taken by the user to respond to the second notification and a response of the user to the second notification; and

dynamically update the obstacle threshold and the severity threshold based on the user reflex for the second notification.

14. The VR device of claim 10 , wherein detect the obstacle while the VR content is displayed on the screen of the VR device worn by the user comprises:

detect a physical object in proximity to the user while the VR content is displayed on the screen of the VR device;

track a movement of at least one of the user and the physical object;

compute a distance between the object and the VR device based on the movement;

dynamically determine the obstacle threshold based on the user reflexes;

determine that the distance meets the obstacle threshold; and

detect the obstacle in response to determining the distance meets the obstacle threshold.

15. The VR device of claim 10 , wherein at least one of improvement and degradation of the user reflexes are dynamically tracked based on learning from at least one of a time taken by the user to respond to notification, a current response of the user for the obstacle and the past response of the user for the obstacle.

16. The VR device of claim 10 , wherein the parameter is an output of an obstacle tracker, an obstacle detector, a movement detector, and a context engine.

17. The VR device of claim 10 , wherein the first notification is at least one of a visual notification, an audio notification, and a vibration notification and is provided to alert the user about the obstacle ahead of time to avoid collision of the user with the obstacle, wherein a type of the first notification is dynamically determined based on an ambient noise around the user, the user reflexes, the severity level of the obstacle and the obstacle threshold.

18. The VR device of claim 10 , wherein the processor is further configured to:

detect a user reflex indicating a time taken by the user to respond to the first notification and a response of the user to the first notification; and

dynamically update the obstacle threshold based on the user reflex for the first notification.

19. A computer program product comprising computer executable program code recorded on a computer readable non-transitory storage medium, said computer executable program code when executed causing the actions including:

detecting an obstacle in proximity to a user while a Virtual Reality (VR) content is displayed on a screen of a VR device worn by the user;

detecting a severity level of the obstacle based on at least one parameter;

providing a notification on a portion of the screen of the VR device based on the severity level;

detecting a user reflex indicating a time taken by the user to respond to the notification displayed on the portion of the screen of the VR device and a response of the user to at least one of the obstacle and the notification; and

dynamically updating the obstacle threshold based on the user reflex.

20. A method for providing a notification in a Virtual Reality (VR) device, the method comprising:

detecting, by a processor, an obstacle in proximity to a user while a VR content is displayed on a screen of the VR device worn by the user based on an obstacle threshold;

determining a type of a first notification to be provided to the user based on an ambient noise around the user, user reflexes, a severity level of the obstacle and the obstacle threshold;

providing, by a notification engine, the determined type of the first notification on a portion of the screen of the VR device to avoid collision of the user with the obstacle;

detecting by the processor a user reflex indicating a time taken by the user to respond to the first notification and a response of the user to the first notification; and

dynamically updating by the processor the obstacle threshold based on the user reflex for the first notification.

21. The method of claim 20 , wherein the obstacle threshold is dynamically determined based on the user reflexes indicating a response of the user for the obstacle in a past session, wherein the user reflexes are dynamically tracked based on learning from at least one of current response of the user for the obstacle and the past response of the user for the obstacle, herein at least one of improvement and degradation of the user reflexes are dynamically tracked based on learning from at least one of a time taken by the user to respond to notification, a current response of the user for the obstacle and the past response of the user for the obstacle.

22. The method of claim 20 , further comprising:

determining, by the processor, whether a distance between the obstacle and the VR device meets a severity threshold; and

determining a type of a second notification to be provided to the user based on an ambient noise around the user, user reflexes, a severity level of the obstacle and the severity threshold;

providing, by a notification engine, the determined type of the second notification on a portion of the screen of the VR device to avoid collision of the user with the obstacle;

detecting by the processor a user reflex indicating a time taken by the user to respond to the second notification and a response of the user to the second notification; and

dynamically updating by the processor the obstacle threshold and the severity threshold based on the user reflex for the second notification.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Nov 1, 2021
From: CITIZENS BANK, N.A., AS COLLATERAL AGENT
To: BRILLIO, LLC
Reel/Frame 057983/0135 →
SECURITY INTEREST Recorded Oct 29, 2021
From: BRILLIO, LLC
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 057963/0108 →
SECURITY INTEREST Recorded Feb 7, 2019
From: BRILLIO, LLC
To: CITIZENS BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 048264/0883 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2016
From: THOMAS, RENJI KURUVILLA; JAIN, GAURAV; SIVARAMAMURTHY, VENKAT KUMAR; GUPTA, PUNEET; VINMANI, KARTHIK GOPALAKRISHNAN
To: BRILLIO LLC
Reel/Frame 038583/0952 →
Priority Claims (1)
IN 201641006997 · Feb 29, 2016 · national
Continuity (1)
Related Publication 20170248785A1 · Aug 31, 2017