Metalens 3D-from-polarization camera
View Patent ↗A camera is provided for reconstructing the surface of the object. The camera includes an optical module configured to spatially separate photons reflected from an object in a scene to form at least two focused and distinctly polarized images on a sensor, wherein the sensor is configured to receive the at least two polarized images on pixels the sensor and generate intensity values of the pixels, and a computing module including a processor and a memory having instructions stored thereon. According to the instructions, the processor computes depth values at points of a surface of the object based on a ratio of the intensity values of the pixels with respect to the at least two polarized images and reconstructs the surface of the object from the computed depth values.
1. A camera comprising:
an optical module configured to spatially separate photons reflected from an object in a scene to form at least two focused and distinctly polarized images on a sensor, wherein the sensor is configured to receive the at least two polarized images on pixels of the sensor and generate intensity values of the pixels; and
a computing module including a processor and a memory having instructions stored thereon that cause the processor to:
compute depth values at points of a surface of the object based on a ratio of the intensity values of the pixels with respect to the at least two polarized images; and
reconstruct the surface of the object from the computed depth values.
2. The camera of claim 1 , wherein the light is emitted from a diffuse unpolarized light source of unknown brightness.
3. The camera of claim 2 , wherein the two or more polarized images are obtained for a single exposure of the diffuse unpolarized light.
4. The camera of claim 1 , wherein the nanostructure of the optimal module is tuned to focus distinct polarized components of incident light from each scene point into distinct sensor pixels with minimal spill into nearby pixels.
5. The camera of claim 1 , wherein the at least two polarized images have substantially distinct polarization angles.
6. The camera of claim 1 , wherein the at least two polarized images include a horizontally polarized image and a vertically polarized image.
7. The camera of claim 1 , wherein the depth values at the points of the surface are computed by finding depth values for all adjacent surface points in the scene such that the implied surface orientation for each surface point has polarized-light reflectivities whose ratios are consistent with the ratios of polarized irradiant intensities measured at the sensor pixels that view the scene point.
8. The camera of claim 1 , wherein neighbor pixels receive differently polarized images, wherein the pixels are arranged on the focal plane.
9. The camera of claim 1 , wherein the optical module is a metalens.
10. The camera of claim 1 , wherein the camera operates in ambient light.
11. A computer-implemented method for reconstructing three-dimensional (3D) depths from a surface of an object in a scene using a computing module including a processor and a memory having instructions of 3D depth reconstruction algorithm stored thereon, comprising:
spatially separating photons reflected from the object in the scene to form at least two focused and distinctly polarized images on a sensor, wherein the sensor receives the at least two polarized images on pixels of the sensor;
generating intensity values of the pixels using the sensor;
computing depth values at points of a surface of the object based on a ratio of the intensity values of the pixels with respect to the at least two polarized; and
reconstructing the surface of the object from the computed depth values.
12. The computer-implemented method of claim 11 , wherein the light is emitted from a diffuse unpolarized light source of unknown brightness.
13. The computer-implemented method of claim 12 , wherein the two or more polarized images are obtained for a single exposure of the diffuse unpolarized light.
14. The computer-implemented method of claim 11 , wherein the nanostructure of the optimal module is tuned to focus distinct polarized components of incident light from each scene point into distinct sensor pixels with minimal spill into nearby pixels.
15. The computer-implemented method of claim 11 , wherein the at least two polarized images have substantially distinct polarization angles.
16. The computer-implemented method of claim 11 , wherein the at least two polarized images include a horizontally polarized image and a vertically polarized image.
17. The computer-implemented method of claim 11 , wherein the depth values at the points of the surface are computed by finding depth values for all adjacent surface points in the scene such that the implied surface orientation for each surface point has polarized-light reflectivities whose ratios are consistent with the ratios of polarized irradiant intensities measured at the sensor pixels that view the scene point.
18. The computer-implemented method of claim 11 , wherein neighbor pixels receive differently polarized images, wherein the pixels are arranged on the focal plane.
19. The computer-implemented method of claim 11 , wherein the optical module is a metalens.
20. The computer-implemented method of claim 11 , wherein the camera operates in ambient light.