IP Library Granted Patent US 9,858,703
Granted Patent B2
US 9,858,703 · App. 14/975,492 · Granted Jan 2, 2018

System, device and method for providing user interface for a virtual reality environment

Inventors: Kobi Kaminitz (Tel Aviv, IL); Nadav Grossinger (Yosef, IL); Moshe Meyassed (Kadima, IL); Nitay Romano (Geva Binyamin, IL)
Assignee: Facebook, Inc.
G06T15/005G06F3/011G06F3/017G06F3/0304G06T11/60G06T19/006H04N5/2226H04N5/2256H04N5/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,858,703
App. No.
14/975,492
Granted
Jan 2, 2018
Kind
B2
Abstract

A device connectable to a near eye display or to a virtual reality headset and to a portable computing platform having a processor is provided herein. The device may include: an illuminator configured to illuminate a proximity of a user wearing the headset or the near eye display with patterned light; and an IR camera configured to capture reflections of said patterned light coming from at least one object located in the proximity of the user, wherein the processor is configured to: establish data and power connection between the device and said portable computing platform and said near eye display; and generate a depth map of said object based on the reflections.

Claims (53)

1. A device connectable to a virtual reality headset and to a portable computing platform having a processor, the device comprising:

an illuminator configured to illuminate a proximity of a user wearing the virtual reality headset with patterned light;

a camera configured to capture reflections of the patterned light coming from at least one object located at the proximity of the user; and

a pre-processor configured to:

perform pre-processing of data related to the captured reflections; and

provide the pre-processed data to the processor of the portable computing platform,

wherein the processor of the portable computing platform is configured to:

establish data and power connection between the device and the portable computing platform;

obtain the pre-processed data from the pre-processor; and

generate a depth map of the at least one object based on the pre-processed data.

2. The device of claim 1 , wherein the illuminator and the camera are operating at an infra-red (IR) range.

3. The device of claim 1 , wherein the processor is further configured to:

generate a 3D image of the at least one object, based on the depth map and 2D images of the at least one object; and

superimpose the 3D image of the at least one object on a virtual reality (VR) scene generated by the processor and viewable by the user.

4. The device of claim 3 , wherein the portable computing platform further comprises a visible light camera configured to capture the 2D images of the at least one object.

5. The device of claim 3 , further comprising a visible light camera configured to capture the 2D images of the at least one object.

6. The device of claim 3 , wherein the processor is further configured to align the 3D image of the at least one object with a viewing angle of the VR scene by the user.

7. The device of claim 1 , wherein a power consumption of the device is below approximately 1 Watt.

8. The device of claim 1 , wherein the portable computing platform and the virtual reality headset are integrated as a single element.

9. The device of claim 1 , wherein the processor is further configured to establish data and power connection between the device and the portable computing platform based on “Plug and Play”.

10. The device of claim 1 , wherein the at least one object is a body part of the user.

11. The device of claim 1 , wherein the portable computing platform is selected from a group comprising: a smartphone, a laptop personal computer (PC), and a tablet PC.

12. The device of claim 1 , wherein the illuminator and the camera exhibit a horizontal field of view of approximately 55° degrees and a vertical field of view of approximately 43° degrees in a “landscape” configuration and a horizontal field of view of approximately 43° degrees and a vertical field of view of approximately 55° degrees in a “portrait” configuration.

13. A method comprising:

connecting a device to a virtual reality headset and to a portable computing platform having a processor, the device comprising an illuminator, a camera, and a pre-processor;

establishing data and power connection between the device and the portable computing platform;

illuminating a proximity of a user wearing the virtual reality headset with patterned light;

capturing reflections of the patterned light coming from at least one object located in the proximity of the user;

pre-processing of data related to the captured reflections;

providing the pre-processed data to the processor of the portable computing platform;

obtaining, at the processor of the portable computing platform, the pre-processed data from the pre-processor of the device; and

generating a depth map of the at least one object based on the obtained pre-processed data.

14. The method of claim 13 , wherein the illuminator and the camera are operating at an infra-red (IR) range.

15. The method of claim 13 , further comprising generating a 3D image of the at least one object, based on the depth map and 2D images of the at least one object; and superimposing the 3D image of the at least one object on a virtual reality (VR) scene generated by the processor and viewable by the user.

16. The method of claim 15 , wherein the portable computing platform further comprises a visible light camera, and the method further comprising capturing the 2D images of the at least one object using the visible light camera.

17. The method of claim 15 , further comprising aligning the 3D image of the at least one object with a viewing angle of the VR scene by the user.

18. The method of claim 13 , wherein an overall a power consumption of the device is below approximately 1 Watt.

19. The method of claim 13 , wherein the portable computing platform and the virtual reality headset are integrated as a single element.

20. The method of claim 13 , wherein the establishing of data and power connection between the device and the portable computing platform is carried out as “Plug and Play”.

21. The method of claim 13 , wherein the at least one object is a body part of the user.

22. A device connectable to a near eye display and to a portable computing platform having a processor, the device comprising:

an illuminator configured to illuminate a proximity of a user wearing the near eye display with patterned light;

a camera configured to capture reflections of the patterned light coming from at least one object located at the proximity of the user; and

a pre-processor configured to:

perform pre-processing of data related to the captured reflections; and

provide the pre-processed data to the processor of the portable computing platform,

wherein the processor of the portable computing platform is configured to:

establish data and power connection between the device, the near eye display, and the portable computing platform;

obtain the pre-processed data from the pre-processor; and

generate a depth map of the at least one object based on the pre-processed data.

23. The device of claim 22 , wherein the processor is further configured to:

generate a 3D image of the at least one object, based on the depth map and 2D images of the at least one object; and

superimpose the 3D image of the at least one object on a virtual reality (VR) scene generated by the processor and viewable by the user over the near eye display.

Assignments (4)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2018
From: FACEBOOK, INC.
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047687/0942 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2016
From: OCULUS VR, LLC
To: FACEBOOK, INC.
Reel/Frame 040196/0790 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2016
From: KAMINITZ, KOBI; GROSSINGER, NADAV; MEYASSED, MOSHE; ROMANO, NITAY
To: OCULUS VR, LLC
Reel/Frame 039739/0223 →
Continuity (2)
Provisional Application 62093490 · Dec 18, 2014
Related Publication 20160180574A1 · Jun 23, 2016