Methods and apparatuses for compensating light reflections from a cover of a time-of-flight camera

1. A method for compensating light reflections from a cover of a time-of-flight camera, the method comprising:

receiving an image of a scene as illuminated by an illumination element of the time-of-flight camera;

modifying the image of the scene using a reference image to obtain a compensated image of the scene, wherein pixels of the reference image indicate reference values exclusively related to reflections of light from the illumination element from the cover of the time-of-flight camera; and

outputting the compensated image.

2. The method of claim 1 , wherein the illumination element of the time-of-flight camera and a light capturing element of the time-of-flight camera for receiving reflected light from the scene are arranged in a common cavity that is covered by the cover.

3. The method of claim 1 , wherein the image of the scene is one of a raw image, an image derived from the raw image, an intensity image, an image derived from the intensity image, a depth image or an image derived from the depth image.

4. The method of claim 1 , wherein the reference image is a reference raw image.

5. The method of claim 4 , wherein the time-of-flight camera uses a continuous wave modulated signal for illuminating the scene and generates measurement signals based on reflected light from the scene, wherein the image of the scene is a raw image that is based on correlations of the continuous wave modulated signal and the measurement signals according to a correlation function, and wherein the reference raw image is selected from a plurality of reference raw images based on a phase offset between the continuous wave modulated signal and the measurement signals as used for the correlations.

6. The method of claim 4 , wherein the time-of-flight camera uses a continuous wave modulated signal for illuminating the scene, and wherein the reference raw image is selected from a plurality of reference raw images based on a frequency of the continuous wave modulated signal.

7. The method of claim 4 , wherein the reference raw image is based on a factory calibration.

8. The method of claim 4 , further comprising:

controlling the time-of-flight camera to use a code modulated signal for illumination such that a measurement range of the time-of-flight camera ends immediately after the cover, wherein a raw image that is captured by the time-of-flight camera based on the code modulated signal is used as the reference raw image.

9. The method of claim 1 , further comprising:

receiving a depth image from the time-of-flight camera;

determining a closest reflective object depicted in the depth image;

determining an exposure time for the time-of-flight camera such that a measurement range of the time-of-flight camera ends before the closest reflective object; and

controlling the time-of-flight camera to capture an auxiliary raw image using the exposure time, wherein the auxiliary raw image is used as the reference image.

10. The method of claim 1 , further comprising:

receiving a depth image from the time-of-flight camera;

determining whether any reflective object at a greater distance than the cover is depicted in the depth image; and

if no reflective object at a greater distance than the cover is depicted in the depth image, controlling the time-of-flight camera to capture an auxiliary raw image, wherein the auxiliary raw image is used as the reference image.

11. The method of claim 1 , wherein the reference image is a reference depth image.

12. The method of claim 11 , further comprising:

receiving a depth image from the time-of-flight camera; and

determining whether any reflective object at a greater distance than the cover is depicted in the depth image, wherein the depth image is used as the reference depth image if no reflective object at a greater distance than the cover is depicted in the depth image.

13. The method of claim 1 , wherein the reference image is a reference intensity image.

14. The method of claim 13 , wherein modifying the image of the scene using the reference image comprises:

scaling the reference values indicated by the pixels of the reference intensity image by a scaling factor to obtain a scaled reference intensity image; and

modifying the image of the scene using the scaled reference intensity image to obtain the compensated image.

15. The method of claim 1 , wherein exposure times of the image of the scene and the reference image are equal.

16. The method of claim 1 , wherein if exposure times of the image of the scene and the reference image are different, modifying the image of the scene using the reference image comprises:

scaling the reference values indicated by the pixels of the reference image by a scaling factor to obtain a scaled reference image, wherein the scaling factor is based on a ratio of the exposure times of the image of the scene and the reference image; and

modifying the image of the scene using the scaled reference image to obtain the compensated image.

17. An apparatus for compensating light reflections from a cover of a time-of-flight camera, the apparatus comprising:

an input circuit configured to receive an image of a scene as illuminated by an illumination element of the time-of-flight camera;

a processing circuit configured to modify the image of the scene using a reference image to obtain a compensated image of the scene, wherein pixels of the reference image indicate reference values exclusively related to reflections of light from the illumination element from the cover of the time-of-flight camera; and

an output circuit configured to output the compensated image.

18. An apparatus for compensating light reflections from a cover of a time-of-flight camera, the apparatus comprising:

means for receiving a phase image of a scene as illuminated by an illumination element of the time-of-flight camera;

means for modifying the image of the scene using a reference image to obtain a compensated image of the scene, wherein pixels of the reference image indicate reference values exclusively related to reflections of light from the illumination element from the cover of the time-of-flight camera; and

means for outputting the compensated image.

19. A method for compensating light reflections from a cover of a time-of-flight camera, wherein a light capturing element of the time-of-flight camera is covered by the cover and comprises an array of photonic mixer devices, wherein each of the photonic mixer devices separates a charge generated by light arriving at the photonic mixer device so that two charge values are provided for the respective photonic mixer device, the method comprising:

receiving the charge values for the photonic mixer devices;

modifying the charge values using reference values exclusively related to light reflections from the cover of the time-of-flight camera to obtain compensated charge values; and

outputting the compensated charge values.

20. An apparatus for compensating light reflections from a cover of a time-of-flight camera, wherein a light capturing element of the time-of-flight camera is covered by the cover and comprises an array of photonic mixer devices, wherein each of the photonic mixer devices separates a charge generated by light arriving at the photonic mixer device so that two charge values are provided for the respective photonic mixer device, the apparatus comprising:

an input circuit configured to receive the charge values for the photonic mixer devices;

a processing circuit configured to modify the charge values using reference values exclusively related to light reflections from the cover of the time-of-flight camera to obtain compensated charge values; and

an output circuit configured to output the compensated charge values.

21. An apparatus for compensating light reflections from a cover of a time-of-flight camera, wherein a light capturing element of the time-of-flight camera is covered by the cover and comprises an array of photonic mixer devices, wherein each of the photonic mixer devices separates a charge generated by light arriving at the photonic mixer device so that two charge values are provided for the respective photonic mixer device, the apparatus comprising:

means for receiving the charge values for the photonic mixer devices;

means for modifying the charge values using reference values exclusively related to light reflections from the cover of the time-of-flight camera to obtain compensated charge values; and

means for outputting the compensated charge values.