Depth sensing using dynamic illumination with range extension
In one embodiment, a system includes at least one projector comprising a plurality of light emitters, where the projector is configured to project a projected pattern comprising a plurality of projected features having different locations; a camera configured to capture an image comprising a detected pattern corresponding to a reflection of the projected pattern; and one or more processors configured to: identify at least one detected feature of the detected pattern, wherein the detected feature corresponds to at least one reflection of the projected features; and activate or deactivate one or more of the light emitters based on the detected feature. The light emitters may be activated or deactivated by determining a detected feature measurement based on the detected feature, and activating or deactivating one or more of the light emitters when the detected feature measurement satisfies a threshold feature measurement condition.
1. A method comprising, by an electronic device:
projecting, utilizing at least one projector of an electronic device, a projected pattern, wherein the projector comprises a plurality of light emitters each configured to project a separate line of structured light to form the projected pattern;
capturing, utilizing a camera of the electronic device, an image comprising a detected pattern corresponding to a reflection of the projected pattern;
determining whether a distance between the camera and the projected pattern is less than a threshold distance based on the captured image; and
in response to determining that the distance between the camera and the projected pattern is less than the threshold distance, deactivating one or more of the plurality of light emitters according to a predetermined deactivation sequence.
2. The method of claim 1 , wherein deactivating one or more of the plurality of light emitters according to the predetermined deactivation sequence comprises deactivating one or more of the plurality of light emitters, such that no horizontally adjacent pairs of the plurality of light emitters are activated concurrently.
3. The method of claim 1 , wherein deactivating one or more of the plurality of light emitters according to the predetermined deactivation sequence comprises deactivating one or more of the plurality of light emitters, such that no vertically adjacent pairs of the plurality of light emitters are activated concurrently.
4. The method of claim 1 , wherein deactivating one or more of the plurality of light emitters according to the predetermined deactivation sequence comprises deactivating every other light emitter of one or more rows of the plurality of light emitters or one or more columns of the plurality of light emitters.
5. The method of claim 1 , wherein determining whether the distance between the camera and the projected pattern is less than the threshold distance comprises determining, based on the captured image, whether each separate line of structured light of the projected pattern is individually resolvable.
6. The method of claim 5 , wherein, subsequent to deactivating a first set of light emitters of one or more rows or columns of the plurality of light emitters, the method further comprising:
in response to determining that each separate line of structured light of the projected pattern is not individually resolvable, deactivating a second set of light emitters of one or more rows or columns of the plurality of light emitters.
7. The method of claim 6 , wherein, subsequent to deactivating the second set of light emitters of one or more rows or columns of the plurality of light emitters, the method further comprising:
in response to determining that each separate line of structured light of the projected pattern is not individually resolvable, deactivating a third set of light emitters of one or more rows or columns of the plurality of light emitters.
8. An electronic device comprising:
one or more non-transitory computer-readable storage media including instructions; and
one or more processors coupled to the storage media, the one or more processors configured to execute the instructions to:
project, utilizing at least one projector of an electronic device, a projected pattern, wherein the projector comprises a plurality of light emitters each configured to project a separate line of structured light to form the projected pattern;
capture, utilizing a camera of the electronic device, an image comprising a detected pattern corresponding to a reflection of the projected pattern;
determine whether a distance between the camera and the projected pattern is less than a threshold distance based on the captured image; and
in response to determining that the distance between the camera and the projected pattern is less than the threshold distance, deactivate one or more of the plurality of light emitters according to a predetermined deactivation sequence.
9. The electronic device of claim 8 , wherein the instructions to deactivate one or more of the plurality of light emitters according to the predetermined deactivation sequence further comprises instructions to deactivate one or more of the plurality of light emitters, such that no horizontally adjacent pairs of the plurality of light emitters are activated concurrently.
10. The electronic device of claim 8 , wherein the instructions to deactivate one or more of the plurality of light emitters according to the predetermined deactivation sequence further comprises instructions to deactivate one or more of the plurality of light emitters, such that no vertically adjacent pairs of the plurality of light emitters are activated concurrently.
11. The electronic device of claim 8 , wherein the instructions to deactivate one or more of the plurality of light emitters according to the predetermined deactivation sequence further comprises instructions to deactivate every other light emitter of one or more rows of the plurality of light emitters or one or more columns of the plurality of light emitters.
12. The electronic device of claim 8 , wherein the instructions to determine whether the distance between the camera and the projected pattern is less than the threshold distance further comprises instructions to determine, based on the captured image, whether each separate line of structured light of the projected pattern is individually resolvable.
13. The electronic device of claim 12 , wherein, subsequent to deactivating a first set of light emitters of one or more rows or columns of the plurality of light emitters, the instructions further comprising instructions to:
in response to determining that each separate line of structured light of the projected pattern is not individually resolvable, deactivate a second set of light emitters of one or more rows or columns of the plurality of light emitters.
14. The electronic device of claim 13 , wherein, subsequent to deactivating the second set of light emitters of one or more rows or columns of the plurality of light emitters, the instructions further comprising instructions to:
in response to determining that each separate line of structured light of the projected pattern is not individually resolvable, deactivate a third set of light emitters of one or more rows or columns of the plurality of light emitters.
15. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of an electronic device, cause the one or more processors to:
project, utilizing at least one projector of the electronic device, a projected pattern, wherein the projector comprises a plurality of light emitters each configured to project a separate line of structured light to form the projected pattern;
capture, utilizing a camera of the electronic device, an image comprising a detected pattern corresponding to a reflection of the projected pattern;
determine whether a distance between the camera and the projected pattern is less than a threshold distance based on the captured image; and
in response to determining that the distance between the camera and the projected pattern is less than the threshold distance, deactivate one or more of the plurality of light emitters according to a predetermined deactivation sequence.
16. The non-transitory computer-readable medium of claim 15 , wherein the instructions to deactivate one or more of the plurality of light emitters according to the predetermined deactivation sequence further comprises instructions to deactivate one or more of the plurality of light emitters, such that no horizontally adjacent pairs of the plurality of light emitters are activated concurrently.
17. The non-transitory computer-readable medium of claim 15 , wherein the instructions to deactivate one or more of the plurality of light emitters according to the predetermined deactivation sequence further comprises instructions to deactivate one or more of the plurality of light emitters, such that no vertically adjacent pairs of the plurality of light emitters are activated concurrently.
18. The non-transitory computer-readable medium of claim 15 , wherein the instructions to deactivate one or more of the plurality of light emitters according to the predetermined deactivation sequence further comprises instructions to deactivate every other light emitter of one or more rows of the plurality of light emitters or one or more columns of the plurality of light emitters.
19. The non-transitory computer-readable medium of claim 15 , wherein the instructions to determine whether the distance between the camera and the projected pattern is less than the threshold distance further comprises instructions to determine, based on the captured image, whether each separate line of structured light of the projected pattern is individually resolvable.
20. The non-transitory computer-readable medium of claim 19 , wherein, subsequent to deactivating a first set of light emitters of one or more rows or columns of the plurality of light emitters, the instructions further comprising instructions to:
in response to determining that each separate line of structured light of the projected pattern is not individually resolvable, deactivate a second set of light emitters of one or more rows or columns of the plurality of light emitters.