Automatic multiple depth cameras synchronization using time sharing
Aspects relate to a depth sensing system for capturing an image containing depth information of an object. In one embodiment, a depth sensing device for use in conjunction with multiple depth sensing devices for capturing an image containing depth information of an object comprises a near-infrared transmitter comprising a laser capable of producing a near infra-red light beam, a diffractive optical element positioned to receive a light beam emitted from the laser, the diffractive optical element, a collimating lens, and a near-infrared receiver coupled to the transmitter in a relative position, the receiver comprising a sensor assembly capable of producing an image of the received light, the depth sensing device being configured to transmit and receive near infra-red light beams during a time period that is different than any of the other of two or more transmitter-receiver pairs of devices in communication with the depth sensing device.
1. A depth sensing device for capturing depth information of a scene, wherein the depth sensing device and at least one other depth sensing device are part of an arrangement of depth sensing devices, the depth sensing device comprising:
a memory; and
a processor coupled to the memory, the processor configured to:
operate to determine, using an image of the scene produced by a sensor of the depth sensing device, whether light from the at least one other depth sensing device is present in the scene without communicating with the at least one other depth sensing device;
in response to determining that the light from the at least one other depth sensing device is not present in the scene, begin an exposure window of the depth sensing device during which a transmitter is activated to project light onto the scene and a receiver is activated to sense light reflected from the scene; and
in response to determining that the light from the at least one other depth sensing device is present in the scene, delay the exposure window of the depth sensing device based at least in part on a width of light pulses emitted from the at least one other depth sensing device until the light from the at least one other depth sensing device is no longer detected in the scene, without communicating with the at least one other depth sensing device.
2. The depth sensing device of claim 1 , wherein the transmitter is configured to project light onto the scene using a laser producing a near infrared (NIR) light beam.
3. The depth sensing device of claim 2 , wherein the transmitter comprises a plurality of diffractive optical features.
4. The depth sensing device of claim 2 , wherein the transmitter comprises a time-of-flight (TOF) transmitter.
5. The depth sensing device of claim 2 , wherein the receiver comprises a shutter, and wherein execution of the instructions causes the transmitter to project a structured light pattern onto the scene.
6. The depth sensing device of claim 5 , wherein the processor is further configured to delay the transmitter from producing the NIR light beam for a delay period based on a presence of NIR light indicative of the structured light pattern on the scene.
7. The depth sensing device of claim 2 , wherein the receiver comprises a rolling shutter.
8. The depth sensing device of claim 2 , wherein the laser produces a series of laser pulses at a pulse frequency, and wherein the processor is further configured to adjust the pulse frequency based on a presence of a structured light pattern in the scene.
9. A method for capturing depth information of a scene using a depth sensing device, wherein the depth sensing device and at least one other depth sensing device are part of an arrangement of depth sensing devices, the method comprising:
determining, using an image of the scene produced by a sensor of the depth sensing device, whether light from the at least one other depth sensing device is present in the scene without communicating with the at least one other depth sensing device;
in response to determining that the light from the at least one other depth sensing device is not present in the scene, beginning an exposure window of the depth sensing device during which a transmitter is activated to project light onto the scene and a receiver is activated to sense light reflected from the scene; and
in response to determining that the light from the at least one other depth sensing device is present in the scene, delaying the exposure window of the depth sensing device based at least in part on a width of light pulses emitted from the at least one other depth sensing device until the light from the at least one other depth sensing device is no longer detected in the scene, without communicating with the at least one other depth sensing device.
10. The method of claim 9 , wherein the light projected by the transmitter is a near infrared (NIR) light beam.
11. The method of claim 10 , wherein the transmitter comprises a plurality of diffractive optical features.
12. The method of claim 9 , wherein the transmitter comprises a time-of-flight (TOF) transmitter.
13. The method of claim 9 , further comprising activating a rolling shutter during the exposure window.
14. The method of claim 9 , further comprising adjusting a pulse frequency of the light projected by the transmitter based on detected light in the scene.
15. A depth sensing device for capturing depth information of a scene, wherein the depth sensing device and at least one other depth sensing device are part of an arrangement of depth sensing devices, the depth sensing device comprising:
means for determining, using an image of the scene produced by a sensor of the depth sensing device, whether light from the at least one other depth sensing device is present in the scene without communicating with the at least one other depth sensing device;
means for, in response to determining that the light from the at least one other depth sensing device is not present in the scene, beginning an exposure window of the depth sensing device during which a transmitter is activated to project light onto the scene and a receiver is activated to sense light reflected from the scene; and
means for, in response to determining that the light from the at least one other depth sensing device is present in the scene, delaying the exposure window of the depth sensing device based at least in part on a width of light pulses emitted from the at least one other depth sensing device until the light from the at least one other depth sensing device is no longer detected in the scene, without communicating with the at least one other depth sensing device.
16. The depth sensing device of claim 15 , further comprising:
means for projecting a laser light beam onto the scene, the laser light beam including a series of laser pulses; and
means for producing the image of the scene based on the reflected light.
17. The depth sensing device of claim 16 , wherein the means for producing the image comprises a sensor assembly.
18. The depth sensing device of claim 16 , further comprising:
means for adjusting a pulse frequency of the laser light beam.
19. The depth sensing device of claim 15 , wherein the means for beginning and the means for delaying comprises at least one processor.
20. The depth sensing device of claim 15 , wherein the laser light beam is a near infrared (NIR) light beam.
21. The depth sensing device of claim 15 , wherein the transmitter comprises a plurality of diffractive optical features.
22. The depth sensing device of claim 15 , wherein the transmitter comprises a time-of-flight (TOF) transmitter.
23. The depth sensing device of claim 15 , further comprising:
means for activating the transmitter to project a structured light pattern onto the scene; and
means for adjusting a shutter of the depth sensing device to be synchronized with a pulse length of the laser light beam based on an absence of the structured light pattern.
24. The depth sensing device of claim 23 , further comprising:
means for delaying the transmitter from producing the laser light beam for a delay period based on a presence of the structured light pattern on the scene.
25. The depth sensing device of claim 23 , wherein the shutter comprises a rolling shutter.
26. A non-transitory computer readable medium containing instructions that, when executed by one or more processors of a depth sensing device, causes the depth sensing device to perform operations comprising:
determining, using an image of the scene produced by a sensor of the depth sensing device, whether light from at least one other depth sensing device is present in the scene without communicating with the at least one other depth sensing device, wherein the depth sensing device and at least one other depth sensing device are part of an arrangement of depth sensing devices;
in response to determining that the light from the at least one other depth sensing device is not present in the scene, begin an exposure window of the depth sensing device during which a transmitter is activated to project light onto the scene and a receiver is activated to sense light reflected from the scene; and
in response to determining that the light from the at least one other depth sensing device is present in the scene, delay the exposure window of the depth sensing device based at least in part on a width of light pulses emitted from the at least one other depth sensing device until the light from the at least one other depth sensing device is no longer detected in the scene, without communicating with the at least one other depth sensing device.
27. The non-transitory computer readable medium of claim 26 , wherein execution of instructions causes the depth sensing device to perform operations further comprising:
projecting, from the transmitter, a near infrared (NIR) light beam, the projected NIR light beam representing a known structured light pattern; and
detecting light reflected from the scene that is indicative of a structured light pattern.