Time-of-flight camera system
The invention relates to a TOF camera system comprising several cameras, at least one of the cameras being a TOF camera, wherein the cameras are assembled on a common substrate and are imaging the same scene simultaneously and wherein at least two cameras are driven by different driving parameters.
1. A sensor system comprising:
a plurality of sensors, at least one of the plurality of sensors, a first sensor, being a time-of-flight (TOF) sensor configured to obtain depthmap information of a scene, and a second sensor being configured to obtain image information of the scene, wherein the first sensor and the second sensor are disposed on a common substrate; and
circuitry configured to generate a first image by performing fusion on the depthmap information and the image information of the scene, the first image having a higher quality depth measurement for each single pixel or a higher resolution than the depthmap information and the image information.
2. The sensor system according to claim 1 , wherein a driving parameter of the TOF sensor comprises at least two different modulation frequencies for implementing a dealiasing algorithm, and wherein the dealiasing algorithm includes instructions to distinguish between two potential distance measurements generated by the TOF sensor.
3. The sensor system according to claim 1 , wherein the second sensor includes color filters corresponding to red, R, green, G, and blue, B, colors, and the TOF sensor further includes an infrared (IR) filter.
4. The sensor system according to claim 1 , wherein a resolution of the image information obtained by the second sensor is higher than a resolution of the depthmap information obtained by the TOF sensor.
5. The sensor system according to claim 1 , further comprising:
a red, green, and blue (RGB) color filter on the second sensor, wherein the image information comprises RGB information of the scene;
an infrared (IR) pass filter on the TOF sensor, wherein the depthmap further comprises IR data of the scene, and the circuitry is configured to generate the first image by performing the fusion of the IR data and the depthmap information with the image information of the scene.
6. A method of obtaining an image based on information from a plurality of sensors, at least one of the plurality of sensors being a Time-Of-Flight (TOF) sensor, disposed on a common substrate, the method comprising:
obtaining depthmap information of a scene using the TOF sensor;
obtaining image information of the scene using a second sensor among the plurality of sensors;
generating the image by performing a fusion of the depthmap information and the image information of the scene, the image having a higher quality depth measurement for each single pixel or a higher resolution than the depthmap information and the image information.
7. The method according to claim 6 , further comprising:
implementing a dealiasing algorithm using first driving parameters and second driving parameters, the first driving parameters and the second driving parameters comprising at least two different modulation frequencies, wherein implementing the dealiasing algorithm comprises distinguishing between two potential distance measurements generated by the TOF sensor.
8. The method according to claim 6 , wherein the second sensor includes color filters corresponding to red, green, and blue colors, and the TOF sensor further includes an infrared (IR) filter.
9. The method according to claim 6 , wherein obtaining the depthmap information of the scene using the TOF sensor comprises detecting a distance within the scene to an object with a resolution of distance information, and obtaining the image information of the scene using the second sensor comprises capturing an image of the object with a resolution of the image information, wherein the resolution of the image information is higher than the resolution of the distance information.
10. A sensor system comprising:
a plurality of pixels including red, green, and blue (RGB) pixels configured to receive light filtered by RGB filters, wherein the RGB pixels are configured to obtain RGB data of a scene, and an infrared (IR) pixel configured to receive light filtered by an IR filter, wherein the IR pixel is configured to obtain depth data of the scene, and the RGB pixels and the IR pixel are disposed on a common substrate; and
circuitry configured to generate a first image by performing a fusion of the depth data and the RGB data of the scene.
11. The sensor system according to claim 10 , wherein a driving parameter of the IR pixel comprises at least two different modulation frequencies for implementing a dealiasing algorithm, and wherein the dealiasing algorithm includes instructions to distinguish between two distance measurements generated by the IR pixel.
12. The sensor system according to claim 10 , a resolution of the RGB data obtained by the RGB pixels is higher than a resolution of the depth data obtained by the IR pixel.