Combined stereoscopic and phase detection depth mapping in a dual aperture camera
In an imaging system having a first camera with a first field of view (FOV) and a second camera with a second FOV smaller than the first FOV, wherein the first and second FOVs overlap over an overlap region, a method for calculating a calibrated phase detection depth map over the entire first FOV comprises calculating a stereoscopic depth map in the overlap region using image information provided by the first and second cameras, obtaining a first camera phase detection (PD) disparity map in the entire first FOV, and using the stereoscopic depth map in the overlap region to provide a calibrated 2PD depth map in the entire first FOV.
1. A method, comprising:
obtaining respective image information by applying an imaging system having a first camera with a first field of view (FOV) and a second camera with a second FOV smaller than the first FOV, wherein the first FOV and the second FOV overlap over an overlap region;
calculating a stereoscopic depth map in the overlap region using the respective image information provided by the first and second cameras;
obtaining a first camera 2 sub-pixel phase detection (2PD) disparity map in the entire first FOV; and
generating a calibrated 2PD depth map in the entire first FOV to improve the stereoscopic depth map or a 2PD depth map in at least the overlap region based on the stereoscopic depth map in the overlap region and the first camera 2PD disparity map in the entire first FOV.
2. The method of claim 1 , wherein the generating the calibrated 2PD depth map in the entire first FOV to improve the stereoscopic depth map or the 2PD depth map in at least the overlap region includes using the stereoscopic depth map in the overlap region ands the first camera 2PD disparity map in the entire first FOV.
3. The method of claim 2 , wherein the calculating a stereoscopic depth map in the overlap region includes calculating an absolute stereoscopic depth map in the overlap region.
4. The method of claim 3 , wherein the calculating an absolute stereoscopic depth map in the overlap region includes cropping the image information provided by the first camera to match the second FOV so that disparity at infinity is zero.
5. The method of claim 4 , wherein the using the stereoscopic depth map in the overlap region and the first camera 2PD disparity map in the entire first FOV includes converting disparities in the first camera 2PD disparity map in the entire first FOV from pixel units into calibrated physical units based on the calibrated result of a stereo disparity.
6. The method of claim 1 , wherein the generating the calibrated 2PD depth map in the entire first FOV to improve the stereoscopic depth map or the 2PD depth map in at least the overlap region includes using the 2PD depth map to improve the stereoscopic depth map in the overlap region.
7. The method of claim 6 , wherein the obtaining the 2PD depth map in the entire first FOV includes obtaining the 2PD depth map using a first camera image sensor.
8. The method of claim 6 , wherein the obtaining the 2PD depth map in the entire first FOV includes obtaining the 2PD depth map using a first camera image sensor and a second camera image sensor.
9. A method comprising:
obtaining respective image information by applying an imaging system having a first camera with a first field of view (FOV) and a second camera with a second FOV smaller than the first FOV, wherein the first FOV and the second FOV overlap over an overlap region;
calculating a stereoscopic depth map in the overlap region using the respective image information provided by the first and second cameras;
obtaining a first camera 2 sub-pixel phase detection (2PD) disparity map in the entire first FOV; and
generating a calibrated 2PD depth map in the entire first FOV to improve a 2PD depth map in at least the overlap region based on the stereoscopic depth map in the overlap region and the first camera 2PD disparity map in the entire first FOV.