Imaging device and image processing method
Provided is an imaging device that includes a determination unit that determines two or more regions including first and second regions with respect to an imaging region of an imaging unit on the basis of a degree of focus of an image acquired by the imaging unit. The imaging device further includes a processing unit that generates a first image based on the first region and a second image based on the second region, in which the first image has a higher resolution than the second image.
1 . An imaging device, including:
circuitry configured to:
determine two or more regions with respect to an imaging region of an imaging unit, wherein
the two or more regions include a first region and a second region,
the determination of the two or more regions is based on a degree of focus of an image acquired by the imaging unit,
the first region is an in-focus region of the image acquired by the imaging unit, and
the second region is a de-focus region of the image acquired by the imaging unit;
generate first image data based on the first region; and
generate second image data based on the second region, wherein a resolution of the first image data is higher than a resolution of the second image data.
2 . The imaging device according to claim 1 , wherein
the circuitry is further configured to determine the degree of focus, based on a size of a pixel in the imaging region and a size of a circle of confusion in the imaging region.
3 . The imaging device according to claim 1 , wherein
the imaging unit includes a plurality of image plane phase difference pixels,
the plurality of image plane phase difference pixels detects an image plane phase difference of an image formed in the imaging region, and
the circuitry is further configured to determine the two or more regions based on the image plane phase difference detected by the plurality of image plane phase difference pixels.
4 . The imaging device according to claim 3 , wherein the circuitry is further configured to:
calculate a defocus amount of the image formed in the imaging region, wherein the calculation of the defocus amount is based on the image plane phase difference; and
determine the two or more regions based on the calculated defocus amount of the image formed in the imaging region.
5 . The imaging device according to claim 1 , wherein the circuitry is further configured to:
perform a smoothing operation on the image acquired by the imaging unit;
generate a smoothed image based on the smoothing operation performed on the image acquired by the imaging unit;
compare the image acquired by the imaging unit with the smoothed image; and
determine the two or more regions based on the comparison.
6 . The imaging device according to claim 1 , wherein
the first region includes a first object,
the second region includes a second object, and
a distance of the first object from the imaging unit is farther than a distance of the second object from the imaging unit.
7 . The imaging device according to claim 1 , further including
an optical system arranged with respect to the imaging region of the imaging unit, wherein
an in-focus position of the optical system is at a specific distance or more away from the imaging unit.
8 . The imaging device according to claim 7 , wherein the in-focus position is near infinity of the optical system.
9 . The imaging device according to claim 7 , wherein the in-focus position is a position farther than infinity of the optical system.
10 . The imaging device according to claim 7 , wherein
the circuitry is further configured to adjust a position of the optical system with respect to the imaging region, and
based on the adjusted position, a Near end of a permissible circle of confusion in the imaging region is located at a boundary for between the first region and the second region.
11 . The imaging device according to claim 7 , wherein
the circuitry is further configured to determine, as the first region, a region in which a circle of confusion in the imaging region is smaller than a size of a pixel in the imaging region.
12 . The imaging device according to claim 1 , wherein the circuitry is further configured to:
integrate the first image data and the second image data; and
generate third image data based on the integration of the first image data and the second image data.
13 . The imaging device according to claim 1 , wherein the circuitry is further configured to:
read image data from the first region in the imaging region;
execute remosaic on the image data read from the first region in the imaging region; and
generate the first image data based on the remosaic executed on the image data read from the first region in the imaging region.
14 . The imaging device according to claim 1 , wherein the circuitry is further configured to:
read image data from the second region in the imaging region;
execute a binning operation on pixels of the image data read from the second region in the imaging region; and
generate the second image data based on the binning operation executed on the pixels of the image data read from the second region in the imaging region.
15 . The imaging device according to claim 1 , wherein the circuitry is further configured to:
execute a readout operation for the imaging unit;
execute a binning operation on pixels included in the second region; and
read the second image by executing data based on the binning operation executed on the pixels included in the second region.
16 . An image processing method, including:
determining two or more regions with respect to an imaging region of an imaging unit, wherein
the two or more regions include a first region and a second region,
the determination of the two or more regions is based on a degree of focus of an image acquired by the imaging unit,
the first region is an in-focus region of the image acquired by the imaging unit, and
the second region is a de-focus region of the image acquired by the imaging unit;
generating first image data based on the first region; and
generating second image data based on the second region, wherein a resolution of the first image data is higher than a resolution of the second image data.
17 . A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a computer, cause the computer to execute operations, the operations comprising:
determining two or more regions with respect to an imaging region of an imaging unit, wherein
the two or more regions include a first region and a second region,
the determination of the two or more regions is based on a degree of focus of an image acquired by the imaging unit,
the first region is an in-focus region of the image acquired by the imaging unit, and
the second region is a de-focus region of the image acquired by the imaging unit;
generating first image data based on the first region; and
generating second image data based on the second region, wherein a resolution of the first image data is higher than a resolution of the second image data.