Three-dimensional image sensors
View Patent ↗An image sensor frame rate can be increased by “interlaced” mode operation whereby only half the number of lines (alternating between odd and even lines) of an image is transported to the readout circuitry. This halves the integration time but also halves the resolution of the sensor. The reduction is tolerable for motion characterization as long as sufficient image resolution remains. Accordingly, in one embodiment, an image sensor operated in an interlaced fashion is first exposed to a scene under a first illumination form (e.g., narrowband illumination), and a first set of alternating (horizontal or vertical) lines constituting half of the pixels is read out of the array; the sensor is then exposed to the same scene under a second illumination form (e.g., existing ambient illumination with the illumination source turned off), and a second set of alternating lines, representing the other half of the pixel array, is read out.
1. A camera for capturing images of an object, the camera comprising:
a single image sensor including an array of uniformly and continuously spaced light-sensing pixels;
a plurality of lenses that focus light transmitted from an object onto a plurality of different pixel regions of the image sensor, each lens focusing light on a different one of the pixel regions; and
a controller, including a processor and an object detection module, coupled to the single image sensor that:
analyzes the pixel regions to generate a three-dimensional (3D) image of the object through a plurality of images successively obtained with the image sensor;
generates a depth map that calculates depth values for pixels of at least the object, based on the images received in the different pixel regions;
detects 3D motion of the object using the depth values;
creates a reconstructed 3D model of the object based on the 3D image; and
tracks 3D motion of the object based on the 3D model.
2. The camera of claim 1 , wherein the single image sensor is an infrared sensor with enhanced sensitivity in an infrared wavelength band.
3. The camera of claim 1 , wherein the single image sensor is an ultraviolet sensor with enhanced sensitivity in an ultraviolet wavelength band.
4. The camera of claim 1 , further comprising:
the processor coupled to the image sensor that further maps the object into voxels in 3D space based on the depth map.
5. The camera of claim 1 , wherein the lenses are positioned next to each other.
6. The camera of claim 1 , wherein the lenses comprise convex lenses.
7. The camera of claim 1 , wherein the array of uniformly and continuously spaced light-sensing pixels has an aspect ratio larger than one.
8. The camera of claim 1 , wherein a distance between the image sensor and the plurality of lenses is determined based on a distance between the object and the lenses.
9. A method of capturing images of an object using a camera comprising an image sensor having an array of light-sensing pixels and a plurality of lenses, each lens focusing light on one of pixel regions of the image sensor, the method comprising:
focusing light transmitted from the object onto a plurality of different pixel regions of the image sensor;
capturing a plurality of images, each associated with one of the pixel regions of the image sensor;
generating a three-dimensional (3D) image of the object based on the images;
generating a depth map that calculates depth values for pixels of at least the object, based on the images received in the different pixel regions;
detecting 3D motion of the object using the depth values;
creating a reconstructed 3D model of the object based on the 3D image; and
tracking 3D motion of the object based on the 3D model.
10. An image capture and analysis system comprising:
a camera oriented toward a field of view, the camera comprising:
a single image sensor including an array of uniformly and continuously spaced light-sensing pixels; and
a plurality of lenses that focus light transmitted from an object onto a plurality of different pixel regions of the image sensor, each lens focusing light on a different one of the pixel regions;
a processor for analyzing the pixel regions to generate a three-dimensional (3D) image of the object through a plurality of images successively obtained with the image sensor, generating a depth map that calculates depth values for pixels of at least the object, based on the images received in the different pixel regions, detecting 3D motion of the object using the depth values, creating a reconstructed 3D model of the object based on the 3D image and tracking 3D motion of the object based on the 3D model.
11. A method of image capture and analysis for use with a camera oriented toward a field of view, the camera comprising a single image sensor including an array of uniformly and continuously spaced light-sensing pixels and a plurality of lenses that focus light transmitted from an object onto a plurality of different pixel regions of the image sensor, each lens focusing light on a different one of the pixel regions, the method comprising:
illuminating the field of view with at least one light source disposed on a same side of the field of view as the camera;
operating the camera to capture a plurality of images, each image associated with one of the pixel regions of the image sensor, at a time when the light source is simultaneously operative to illuminate the field of view;
analyzing the pixel regions to generate a three-dimensional (3D) image of the object through a plurality of images successively obtained with the image sensor;
generating a depth map that calculates depth values for pixels of at least the object, based on the images received in the different pixel regions;
detecting 3D motion of the object using the depth values;
creating a reconstructed 3D model of the object based on the 3D image; and
tracking 3D motion of the object based on the 3D model.