Image contrast enhancement in depth sensor
View Patent ↗Embodiments related to the enhancement of contrast in an image pattern in a structured light depth sensor are disclosed. For example, one disclosed embodiment provides, in a structured light depth sensor system comprising a structured light depth sensor, a method comprising projecting a light pattern onto an object, detecting via an image sensor an image of the light pattern as reflected from the object, increasing a contrast of the light pattern relative to ambient light present in the image of the light pattern as reflected from the object to form a contrast-enhanced image of the light pattern as reflected from the object, and based upon a motion of the object as detected via the contrast-enhanced image of the light pattern, controlling an application that is providing output to a display.
1. In a structured light depth sensor system comprising a structured light depth sensor, a method comprising:
projecting a light pattern onto an object and modulating an intensity of the light pattern as a function of time;
detecting via an image sensor a first image of the light pattern as reflected from the object at a first light pattern intensity and a second image of the light pattern as reflected from the object at a second light pattern intensity, wherein the first image and the second image are acquired at a rate based upon a beat frequency of an ambient light source and the light pattern is displayed at the first light pattern intensity for a duration of an integration/read cycle of the image sensor;
subtracting the first image from the second image to form a contrast-enhanced image of the light pattern as reflected from the object; and
based upon a motion of the object as detected via the contrast-enhanced image of the light pattern, controlling an application that is providing output to a display.
2. The method of claim 1 , wherein modulating an intensity of the light pattern comprises turning the light pattern on and off.
3. The method of claim 1 , wherein controlling the application comprises displaying a motion of an avatar on the display.
4. The method of claim 1 , wherein the structured light depth sensor system comprises a computer gaming system.
5. The method of claim 1 , further comprising determining a variance image from one or more of the first image, the second image, and the contrast-enhanced image.
6. The method of claim 5 , wherein determining the variance image comprises, for each pixel, determining a variance value from an m×n array of nearby pixels, wherein at least one of m and n has a value of at least 2.
7. The method of claim 5 , wherein projecting the light pattern onto the object comprises projecting the light pattern via polarized light, and further comprising filtering the light pattern reflected from the object via a polarization filter positioned optically between the object and the image sensor.
8. The method of claim 1 , wherein projecting the light pattern onto the object comprises projecting the light pattern via polarized light, and further comprising filtering the light pattern reflected from the object scene via a polarization filter positioned optically between the object and the image sensor.
9. In a structured light depth sensor system comprising a structured light depth sensor, a method comprising:
projecting a light pattern onto an object and modulating an intensity of the light pattern as a function of time;
detecting via an image sensor a first image of the light pattern as reflected from the object at a first light pattern intensity and a second image of the light pattern as reflected from the object at a second light pattern intensity, wherein the first image and the second image are acquired at a rate based upon a beat frequency of an ambient light source and the light pattern is displayed at the first light pattern intensity for less than a duration of an integration/read cycle of the image sensor;
subtracting the first image from the second image to form a contrast-enhanced image of the light pattern as reflected from the object; and
based upon a motion of the object as detected via the contrast-enhanced image of the light pattern, controlling an application that is providing output to a display.
10. The method of claim 9 , wherein modulating an intensity of the light pattern comprises turning the light pattern on and off.
11. The method of claim 9 , wherein controlling the application comprises displaying a motion of an avatar on the display.
12. The method of claim 9 , wherein the structured light depth sensor system comprises a computer gaming system.
13. The method of claim 9 , further comprising determining a variance image from one or more of the first image, the second image, and the contrast-enhanced image.
14. The method of claim 13 , wherein determining the variance image comprises, for each pixel, determining a variance value from an m×n array of nearby pixels, wherein at least one of m and n has a value of at least 2.
15. The method of claim 13 , wherein projecting the light pattern onto the object comprises projecting the light pattern via polarized light, and further comprising filtering the light pattern reflected from the object via a polarization filter positioned optically between the object and the image sensor.
16. The method of claim 9 , wherein projecting the light pattern onto the object comprises projecting the light pattern via polarized light, and further comprising filtering the light pattern reflected from the object scene via a polarization filter positioned optically between the object and the image sensor.