IP Library Granted Patent US 9,659,413
Granted Patent B2
US 9,659,413 · App. 14/975,486 · Granted May 23, 2017

Method, system and device for navigating in a virtual reality environment

Inventors: Nadav Grossinger (Karmei Yosef, IL); Emil Alon (Pardes Hana, IL); Iddo Bar David (Haifa, IL); Efrat Solodnik (Tel Aviv, IL)
Assignee: Facebook, Inc.
G06T19/006G06F3/011G06F3/012G06F3/017G06F3/04815
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,659,413
App. No.
14/975,486
Granted
May 23, 2017
Kind
B2
Abstract

A method, a system, and a device for navigating in a virtual reality scene, using body parts gesturing and posturing are provided herein. The method may include: projecting a synthetic 3D scene, into both eyes of a user, via a near eye display, so as to provide a virtual reality view to the user; identifying at least one gesture or posture carried out by at least one body part of said user; measuring at least one metric of a vector associated with the detected gesture or posture; applying a movement or action of said user in virtual reality environment, based on the measured metrics; and modifying the virtual reality view so as to reflect the movement or action of said user in the virtual reality environment.

Claims (33)

1. A method comprising:

projecting a synthetic 3D scene, into both eyes of a user, so as to provide a virtual reality view to the user;

identifying at least one gesture or posture carried out by at least one body part of the user;

deriving a vector that spatially represents the identified gesture or posture;

transferring the vector into a continuous movement or action of the user in a virtual reality environment, based on at least one of an angle of the vector and a length of the vector; and

modifying the virtual reality view so as to reflect the movement or action of the user in the virtual reality environment.

2. The method of claim 1 , wherein the identifying the at least one gesture or posture comprises applying a classifier to a database of predefined postures and gestures.

3. The method of claim 1 , wherein the movement or action of the user in the virtual reality environment is carried out continuously as long as the at least one of the angle of the vector and the length of the vector maintains a value beyond a predefined threshold.

4. The method of claim 1 , wherein the movement or action of the user in the virtual reality environment is terminated responsive to detecting a predefined termination act.

5. The method of claim 1 , wherein the movement or action of the user in the virtual reality environment is terminated responsive to detecting a return of the body part to a basic posture position.

6. The method of claim 1 , wherein the identified posture is leaning forward a torso of the user.

7. The method of claim 1 , wherein the identified posture is raising shoulders of the user.

8. The method of claim 1 , wherein the identified posture is defined by a spatial relationship between at least two body parts of the user, and the method further comprises determining angles between the at least two body parts and transferring the determined angles into the continuous movement or action of the user in the virtual reality environment.

9. The method of claim 1 , wherein the vector associated with the identified gesture or posture further comprise a spatial direction angle.

10. The method of claim 1 , wherein identifying the least one gesture or posture further comprises subtracting movement component affiliated with head movements of the user, so as to only retrieve postures and gestures of the at least one body part, that are relative to the head of the user.

11. The method of claim 1 , further comprising superimposing a virtual user-interface object into the synthetic 3D scene enabling the user to apply gestures and postures relative to the virtual user-interface object.

12. A system comprising:

a device configured to project a synthetic 3D scene, into both eyes of a user, so as to provide a virtual reality view to the user; and

a computer processor configured to:

identify at least one gesture or posture carried out by at least one body part of the user;

derive a vector that spatially represents the identified gesture or posture;

transfer the vector into a continuous movement or action of the user in a virtual reality environment, based on at least one of an angle of the vector and a length of the vector; and

modify the virtual reality view so as to reflect the movement or action of the user in the virtual reality environment.

13. The system of claim 12 , wherein the computer processor is further configured to apply a classifier to a database of predefined postures and gestures to identify the at least one gesture or posture.

14. The system of claim 12 , wherein the computer processor is further configured to perform the movement or action of the user in the virtual reality environment continuously as long as the at least one of the angle of the vector and the length of the vector maintains a value beyond a predefined threshold.

15. The system of claim 12 , wherein the computer processor is further configured to terminate the movement or action of the user in the virtual reality environment responsive to detection of a predefined termination act.

16. The system of claim 12 , wherein the computer processor is further configured to terminate the movement or action of the user in the virtual reality environment responsive to detecting a return of the body part to a basic posture position.

17. The system of claim 12 , wherein the identified posture is leaning forward a torso of the user.

18. The system of claim 12 , wherein the identified posture is raising shoulders of the user.

19. The system of claim 12 , wherein the identified posture is defined by a spatial relationship between at least two body parts of the user, and the computer processor is further configured to determine angles between the at least two body parts and transfer the determined angles into the continuous movement or action of the user in the virtual reality environment.

20. The system of claim 12 , wherein the vector associated with the identified gesture or posture further comprise a spatial direction angle.

21. The system of claim 12 , wherein the computer processor is further configured to subtract movement component affiliated with head movements of the user, so as to only retrieve postures and gestures of the at least one body part, that are relative to the head of the user.

22. The system of claim 12 , wherein the computer processor is further configured to superimpose a virtual user-interface object into the synthetic 3D scene enabling the user to apply gestures and postures relative to the virtual user-interface object.

Assignments (7)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2018
From: FACEBOOK, INC.
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047687/0942 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2017
From: SOLODNIK, EFRAT
To: PEBBLES LTD.
Reel/Frame 041653/0424 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2017
From: OCULUS VR, LLC
To: FACEBOOK, INC.
Reel/Frame 041653/0444 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2017
From: GROSSINGER, NADAV; ALON, EMIL; DAVID, IDDO BAR
To: OCULUS VR, LLC
Reel/Frame 041647/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2017
From: PEBBLES LTD.
To: OCULUS VR, LLC
Reel/Frame 041647/0218 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2016
From: OCULUS VR, LLC
To: FACEBOOK, INC.
Reel/Frame 040196/0790 →
Continuity (2)
Provisional Application 62093493 · Dec 18, 2014
Related Publication 20160180595A1 · Jun 23, 2016