Depth mapping with a head mounted display using stereo cameras and structured light
A tracking system generates a structured light pattern in a local area. The system includes an array of lasers that generate light. The array of lasers includes a plurality of lasers and an optical element. The plurality of lasers are grouped into at least two subsets of lasers, and each of the at least two subsets of lasers is independently switchable. The optical element includes a plurality of cells that are each aligned with a respective subset of the array of lasers. Each cell receives light from a corresponding laser of the array of lasers, and each cell individually applies a modulation to the received light passing through the cell to form a corresponding portion of the structured light pattern that is projected onto a local area.
1. A system comprising:
an optical element that comprises a plurality of cells that are each aligned with a respective subset of an array of lasers, such that each cell receives light from a corresponding laser of the array of lasers, and each cell individually and dynamically applies a modulation to the received light passing through the cell to form a corresponding portion of a structured light pattern that is projected into a local area, wherein the structured light pattern includes at least a first portion and a second portion that has a different modulation than that of the first portion, the first portion and the second portion generated by the plurality of cells, and the first portion of the structured light pattern is projected into the local area.
2. The system of claim 1 , wherein the modulation is one member of a group comprising: a diffractive modulation, a refractive modulation, and a combination of a diffractive modulation and a refractive modulation.
3. The system of claim 1 , wherein a subset of the array of lasers, of the at least two subsets, and its respective cells are constructed from a single molded element.
4. The system of claim 1 , wherein a width of a cell, of the plurality of cells, is 1 mm or less.
5. The system of claim 1 , wherein one or more cells are individually controllable to change modulation.
6. The system of claim 5 , wherein the one or more of cells associated with an optical element are controllable to dynamically provide changes to the structured light pattern based on receiving and analyzing at least one captured frame, the frame comprising a plurality of pixels in a two-dimensional layout.
7. The system of claim 6 , wherein the dynamic control is configurable to apply the structured light pattern with increased resolution to a first part portion of the structured light pattern and to apply the structured light pattern with reduced resolution to a second portion of the local area.
8. The system of claim 6 , wherein changes to the structured light pattern comprise a change in at least one cell of a plurality of cells associated with an optical element.
9. The system of claim 6 , wherein changes to the structured light pattern comprise a change in at least one cell of a plurality of cells associated with an optical element.
10. The system of claim 9 , wherein changes to the structured light pattern comprise a change in at least one cell of a plurality of cells.
11. The system of claim 5 , wherein the plurality of cells is further controllable with respect to a position and a shape of the generated structured light pattern.
12. A system comprising:
an optical element that comprises a plurality of cells that are each aligned with a respective subset of an array of lasers, such that each cell receives light from a corresponding laser of the array of lasers, and each cell individually and dynamically applies a modulation to the received light passing through the cell to form a corresponding portion of a structured light pattern that is projected into a local area, wherein the structured light pattern includes at least a first portion and a second portion that has a different modulation than that of the first portion, the first portion and the second portion generated by the plurality of cells, and the first portion of the structured light pattern is projected into the local area; and
a controller configured to determine depth information for one or more objects in the three-dimensional space using one or more images.
13. The apparatus of claim 12 , wherein the modulation is one member of a group comprising: a diffractive modulation, a refractive modulation, and a combination of a diffractive modulation and a refractive modulation.
14. The system of claim 12 , wherein a subset of the array of lasers, of the at least two subsets, and its respective cells are constructed from a single molded element.
15. The system of claim 12 , wherein a width of a cell, of the plurality of cells, is 1 mm or less.
16. The system of claim 12 , wherein one or more cells are individually controllable to change modulation.
17. The system of claim 16 , wherein the one or more of cells are controllable to dynamically provide changes to the structured light pattern based on receiving and analyzing at least one captured frame, said frame comprising a plurality of pixels in a two-dimensional layout.
18. The system of claim 17 , wherein the dynamic control is configurable to apply the structured light pattern with increased resolution to a first part portion of the structured light pattern and to apply the structured light pattern with reduced resolution to a second portion of the local area.
19. The system of claim 17 , wherein changes to the structured light pattern comprise a change in at one cell of a plurality of cells.
20. The system of claim 16 , wherein the plurality of cells are further controllable with respect to a position and a shape of the generated structured light pattern.