IP Library Granted Patent US 10,529,087
Granted Patent B1
US 10,529,087 · App. 15/975,281 · Granted Jan 7, 2020

System for a depth mapping device

Inventors: Frank Joris Maria Jan Dellaert (Palo Alto, CA); Saara Khan (Mountain View, CA); James Krogdahl (Menlo Park, CA)
Assignee: Facebook Technologies, LLC
G06T7/596G01B11/2518G03B37/04H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,529,087
App. No.
15/975,281
Granted
Jan 7, 2020
Kind
B1
Abstract

A depth mapping device comprises a plurality of imaging components arranged among one or more rings. A depth mapping device may be designed by identifying a plurality of configurations satisfying a set of input parameters that includes a number of imaging components, each configuration indicating a different arrangement of imaging components among one or more rings. Coverages for different configuration parameter sets for the configuration are analyzed to determine a configuration parameter set associated with the configuration having a highest coverage, where the coverage is indicative of an amount of a local area viewable by a depth mapping device using the configuration and associated configuration parameter set. A target configuration having a highest coverage is selected and used to generate a depth mapping device design to be manufactured.

Claims (47)

1. A method, comprising:

identifying a plurality of device configurations that satisfy a set of input parameters that includes a number of imaging components, each device configuration indicating a different arrangement of the number of imaging components among one or more rings of a depth mapping device design;

adjusting one or more parameters of one or more configurations of the plurality of configurations to adjust a coverage associated with each of the respective one or more configurations, wherein the coverage associated with a configuration of the one or more configurations is indicative of an amount of a local area viewable through the imaging components arranged in accordance with the configuration;

selecting a target configuration from the one or more configurations, based in part on a coverage associated with the target configuration; and

generating a depth mapping device design based upon the target configuration, wherein manufacture of a depth mapping device is based in part on the depth mapping device design.

2. The method of claim 1 , wherein the set of input parameters further includes input parameters that are selected from a group consisting of: a number of first band cameras associated with a first wavelength band, a number of second band cameras associated with a second wavelength band that is different from the first wavelength band, a first band camera field of view, a second band camera field of view, a number of rings, and a number of projectors.

3. The method of claim 2 , wherein the first band cameras correspond to red-green-blue (RGB) cameras, and the second band cameras correspond to infrared (IR) cameras.

4. The method of claim 1 , wherein the set of input parameters further comprises a number of sample points, and wherein adjusting one or more parameters of one or more configurations of the plurality of configurations to adjust a coverage associated with each of the respective one or more configurations comprises:

calculating coverages for each of the one or more configurations using the number of sample points.

5. The method of claim 1 , wherein one or more of the parameters are selected from a group consisting of: an angle of one or more imaging components on a particular ring, and an offset angle between two or more rings.

6. The method of claim 1 , wherein adjusting the one or more parameters of the one or more configurations of the plurality of configurations to adjust the coverage associated with each of the respective one or more configurations comprises:

identifying, for each parameter of the one or more parameters, a parameter range and a plurality of parameter values within the parameter range;

generating one or more parameter sets based upon the identified parameter values for each parameter; and

for each of the one or more parameter sets, determining a coverage for an associated configuration of the one or more configurations.

7. The method of claim 6 , wherein determining the coverage for the associated configuration of a parameter set of the one or more parameter sets comprises:

generating a set of sample points, each sample point corresponding to a different location on a virtual sphere surrounding the configuration;

for each sample point of the set of sample points, determining whether the sample point is within a field of view of an imaging component of the configuration; and

calculating the coverage based upon the sample points of the set of sample points determined to be within a field of view of an imaging component of the configuration.

8. The method of claim 7 , wherein the set of sample points are evenly distributed over the virtual sphere.

9. The method of claim 7 , further comprising generating a set of weights corresponding to the set of sample points, and wherein the coverage is based upon a weighted sum of the sample points determined to be within a field of view of an imaging component of the configuration.

10. The method of claim 1 , wherein the coverage comprises a first coverage level indicating a portion of the local area viewable by at least one imaging component of the configuration, and a second coverage level indicating a portion of the local area viewable by at least two imaging components of the configuration, wherein the coverage comprises aggregating at least the first coverage level and the second coverage level based upon one or more corresponding coverage weight values.

11. A non-transitory computer-readable storage medium storing executable computer program instructions, the computer program instructions executable by a processor to perform steps comprising:

identifying a plurality of device configurations that satisfy a set of input parameters that includes a number of imaging components, each device configuration indicating a different arrangement of the number of imaging components among one or more rings of a depth mapping device design;

adjusting one or more parameters of one or more configurations of the plurality of configurations to adjust a coverage associated with each of the respective one or more configurations, wherein the coverage associated with a configuration of the one or more configurations is indicative of an amount of a local area viewable through the imaging components arranged in accordance with the configuration;

selecting a target configuration from the one or more configurations, based in part on a coverage associated with the target configuration; and

generating a depth mapping device design based upon the target configuration, wherein manufacture of a depth mapping device is based in part on the depth mapping device design.

12. The computer readable storage medium of claim 11 , wherein the set of input parameters further includes input parameters that are selected from a group consisting of: a number of first band cameras associated with a first wavelength band, a number of second band cameras associated with a second wavelength band that is different from the first wavelength band, a first band camera field of view, a second band camera field of view, a number of rings, and a number of projectors.

13. The computer readable storage medium of claim 12 , wherein the first band cameras correspond to RGB color cameras, and the second band cameras correspond to IR cameras.

14. The computer readable storage medium of claim 11 , wherein the set of input parameters further comprises a number of sample points, and wherein adjusting one or more parameters of one or more configurations of the plurality of configurations to adjust a coverage associated with each of the respective one or more configurations comprises:

calculating coverages for each of the one or more configurations using the number of sample points.

15. The computer readable storage medium of claim 11 , wherein one or more of the parameters are selected from a group consisting of: an angle of one or more imaging components on a particular ring, and an offset angle between two or more rings.

16. The computer readable storage medium of claim 11 , wherein the adjusting the one or more parameters of the one or more configurations of the plurality of configurations to adjust the coverage associated with each of the respective one or more configurations comprises:

identifying, for each parameter of the one or more parameters, a parameter range and a plurality of parameter values within the parameter range;

generating one or more parameter sets based upon the identified parameter values for each parameter; and

for each of the one or more parameter sets, determining a coverage for an associated configuration of the one or more configurations.

17. The computer readable storage medium of claim 16 , wherein the determining the coverage for the associated configuration of a parameter set of the one or more parameter sets comprises:

generating a set of sample points, each sample point corresponding to a different location on a virtual sphere surrounding the configuration;

for each sample point of the set of sample points, determining whether the sample point is within a field of view of an imaging component of the configuration; and

calculating the coverage based upon the sample points of the set of sample points determined to be within a field of view of an imaging component of the configuration.

18. The computer readable storage medium of claim 17 , wherein the set of sample points are evenly distributed over the virtual sphere.

19. The computer readable storage medium of claim 11 , wherein the coverage comprises a first coverage level indicating a portion of the local area viewable by at least one imaging component of the configuration, and a second coverage level indicating a portion of the local area viewable by at least two imaging components of the configuration, wherein the coverage comprises aggregating at least the first coverage level and the second coverage level based upon one or more corresponding coverage weight values.

20. A design system comprising:

a configuration generation module configured to identify a plurality of device configurations that satisfy a set of input parameters received via a user interface, the set of input parameters including a number of imaging components, each device configuration indicating a different arrangement of the number of imaging components among one or more rings of a depth mapping device design;

a configuration adjustment module and a coverage analysis module configured to:

adjust one or more parameters of one or more configurations of the plurality of configurations to adjust a coverage associated with each of the respective one or more configurations, wherein the coverage associated with a configuration of the one or more configurations is indicative of an amount of a local area viewable through the imaging components arranged in accordance with the configuration;

a coverage analysis module configured to select a target configuration from the one or more configurations, based in part on a coverage associated with the target configuration; and

a design generator module configured to generate a depth mapping device design based upon the target configuration, wherein manufacture of a depth mapping device is based in part on the depth mapping device design.

Assignments (3)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
CHANGE OF NAME Recorded Sep 12, 2018
From: OCULUS VR, LLC
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047178/0616 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2018
From: DELLAERT, FRANK JORIS MARIA JAN; KHAN, SAARA; KROGDAHL, JAMES
To: OCULUS VR, LLC
Reel/Frame 045846/0082 →