Signal processing method and imaging apparatus
An imaging apparatus according to an embodiment of the present disclosure includes: a plurality of pixels each including a photoelectric conversion element, and disposed in matrix on a light-receiving surface; a plurality of light-receiving lenses provided one by one for each of the plurality of pixels in the plurality of pixels; and a control section that controls exposure times of the plurality of pixels. The control section controls the exposure times of the plurality of pixels to allow exposure times of at least two of the pixels, of the plurality of pixels corresponding to each of the light-receiving lenses, to be the same, and exposure times of at least two of the pixels, of the plurality of pixels corresponding to each of the light-receiving lenses, to be different from each other.
1. An imaging apparatus, comprising:
a plurality of pixels, wherein
each pixel of the plurality of pixels includes a photoelectric conversion element,
the plurality of pixels is in a matrix on a light-receiving surface,
the plurality of pixels corresponds to a plurality of pixel groups,
the plurality of pixel groups includes a plurality of first pixel groups, a plurality of second pixel groups, and a third pixel group,
each pixel group of the plurality of first pixel groups includes pixels of the plurality of pixels in two rows×two columns arrangement,
each pixel group of the plurality of second pixel groups includes pixel groups from the plurality of first pixel groups in two rows×two columns arrangement,
the third pixel group includes the plurality of second pixel groups in two rows×two columns arrangement,
the plurality of second pixel groups in the third pixel group includes:
a first group that includes a first set of two pixels in a first direction;
a second group that includes a second set of two pixels in a second direction; and
a third group that includes a third set of two pixels in a third direction,
the third direction is different from each of the first direction and the second direction, and
the first direction is different from the second direction;
a plurality of light-receiving lenses, wherein each of the plurality of light-receiving lenses is associated with a corresponding pixel group of the plurality of first pixel groups; and
a control section configured to control an exposure time associated with each of the plurality of pixels, wherein
the exposure time for the first set of two pixels in the first direction in the first group is same,
the exposure time for the second set of two pixels in the second direction in the second group is same,
the exposure time for the third set of two pixels in the third direction in the third group is same,
the exposure time of the third set of two pixels is different from each of:
the exposure time of the first set of two pixels, and
the exposure time of the second set of two pixels, and
the exposure time of the second set of two pixels is different from the exposure time of the first set of two pixels.
2. The imaging apparatus according to claim 1 , further comprising a plurality of color filters in a Bayer arrangement, wherein each of the plurality of color filters is associated with a corresponding pixel group of the plurality of pixel groups.
3. The imaging apparatus according to claim 2 , wherein
the plurality of first pixel groups in the first group of the plurality of second pixel groups includes:
a fourth group that includes the first set of two pixels in the first direction; and
a fifth group that includes a fourth set of two pixels in the second direction, and
the exposure time of the fourth set of two pixels is same.
4. The imaging apparatus according to claim 2 , wherein
the plurality of first pixel groups in the first group of the plurality of second pixel groups includes:
a fourth group that includes:
the first set of two pixels in the first direction; and
a fourth set of two pixels in the second direction; and
a fifth group that includes:
the first set of two pixels in the first direction; and
a fifth set of two pixels in the second direction,
the exposure time of the fourth set of two pixels in the second direction is same, and
the exposure time of the fifth set of two pixels is same.
5. The imaging apparatus according to claim 2 , wherein
the plurality of first pixel groups in the first group of the plurality of second pixel groups includes:
a fourth group that includes:
the first set of two pixels in the first direction; and
a fourth set of two pixels in the first direction, wherein the fourth set of two pixels is different from the first set of two pixels; and
a fifth group that includes:
a fifth set of two pixels in the second direction; and
a sixth set of two pixels in the second direction, wherein the fifth set of two pixels is different from the sixth set of two pixels,
the exposure time of the fourth set of two pixels is same,
the exposure time of the fifth set of two pixels is same, and
the exposure time of the sixth set of two pixels is same.
6. The imaging apparatus according to claim 2 , wherein
the third pixel group further includes a specific pixel group of the plurality of first pixel groups,
the control section is further configured to control the exposure time associated with each pixel of the specific pixel group, and
the exposure time of each pixel in the specific pixel group is same.
7. The imaging apparatus according to claim 2 , wherein
the plurality of second pixel groups further includes a fourth group,
the control section is further configured to control the exposure time associated with each pixel in the fourth group of the plurality of second pixel groups, and
the exposure time of each pixel in the fourth group of the plurality of second pixel groups is same.
8. The imaging apparatus according to claim 2 , wherein
the plurality of pixel groups further comprises a plurality of fourth pixel groups,
each of the plurality of fourth pixel groups includes a set of second pixel groups of the plurality of second pixel groups in one row×two columns,
the set of second pixel groups of one of the plurality of fourth pixel groups includes the first group of the plurality of second pixel groups and the second group of the plurality of second pixel groups,
the first set of two pixels in the first direction corresponds to a group of the plurality of first pixel groups in the first group of the plurality of second pixel groups, and
the second set of two pixels in the second direction corresponds to a group of the plurality of first pixel groups in the second group of the plurality of second pixel groups.
9. The imaging apparatus according to claim 2 , wherein
the plurality of pixel groups further comprises a plurality of fifth pixel groups,
each of the plurality of fifth pixel groups includes a set of second pixel groups of the plurality of second pixel groups in two rows×one column,
the set of second pixel groups of each of the plurality of fifth pixel groups includes the first group of the plurality of second pixel groups and the second group of the plurality of second pixel groups,
the first set of two pixels in the first direction corresponds to a group of the plurality of first pixel groups in the first group of the plurality of second pixel groups, and
the second set of two pixels in the second direction corresponds to a group of the plurality of first pixel groups in the second group of the plurality of second pixel groups.
10. The imaging apparatus according to claim 2 , wherein
the first group of the plurality of second pixel groups includes a first set of first pixel groups of the plurality of first pixel groups,
each pixel group of the first set of first pixel groups includes a fourth set of two pixels in the first direction and a fifth set of two pixels in the second direction,
the second group of the plurality of second pixel groups includes a second set of first pixel groups of the plurality of first pixel groups,
each pixel group of the second set of first pixel groups includes a sixth set of two pixels in the second direction and a seventh set of two pixels in the first direction,
the exposure time of the fourth set of two pixels is same,
the exposure time of the fifth set of two pixels is same,
the exposure time of the sixth set of two pixels is same, and
the exposure time of the seventh set of two pixels is same.
11. The imaging apparatus according to claim 2 , wherein
the first group of the plurality of second pixel groups includes a first set of first pixel groups of the plurality of first pixel groups,
each pixel group of the first set of first pixel groups includes a fourth set of two pixels in the first direction and a fifth set of two pixels in the first direction, wherein the fourth set of two pixels is different from the fifth set of two pixels,
the second group of the plurality of second pixel groups includes a second set of first pixel groups of the plurality of first pixel groups,
each pixel group of the second set of pixel groups includes a sixth set of two pixels in the second direction and a seventh set of two pixels in the second direction, wherein the sixth set of two pixels is different from the seventh set of two pixels,
the exposure time of the fourth set of two pixels is same,
the exposure time of the fifth set of two pixels is same,
the exposure time of the sixth set of two pixels is same, and
the exposure time of the seventh set of two pixels is same.
12. The imaging apparatus according to claim 2 , further comprising an arithmetic circuit configured to:
generate phase difference data for each of the exposure time of the first set of two pixels, the exposure time of the second set of two pixels, and the exposure time of the third set of two pixels, based on image data, wherein the image data is based on the exposure time associated with each of the plurality of pixels; and
generate a High Dynamic Range image based on the generated phase difference data.
13. The imaging apparatus according to claim 1 , wherein the first direction is one of a right upward direction, a right downward direction, a horizontal direction, or a vertical direction on the light-receiving surface.
14. The imaging apparatus according to claim 1 , wherein
each pixel group of the plurality of first pixel groups in the first group of the plurality of second pixel groups includes:
a third pixel that is different from the first set of two pixels; and
a fourth pixel that is different from the third pixel and the first set of two pixels,
the exposure time of the third pixel is different from the exposure time of the first set of two pixels, and
the exposure time of the fourth pixel is different from the exposure time of the first set of two pixels and the exposure time of the third pixel.
15. A signal processing method, comprising:
in an imaging apparatus that includes a plurality of pixels and a plurality of light-receiving lenses, wherein each of the plurality of pixels includes a photoelectric conversion element and each of the plurality of light-receiving lenses is associated with a corresponding pixel group of a plurality of first pixel groups of a plurality of pixel groups of the plurality of pixels:
controlling an exposure time associated with each of the plurality of pixels, wherein
the plurality of pixel groups includes the plurality of first pixel groups, a plurality of second pixel groups, and a third pixel group,
each pixel group of the plurality of first pixel groups includes pixels of the plurality of pixels in two rows×two columns arrangement,
each pixel group of the plurality of second pixel groups includes pixel groups from the plurality of first pixel groups in two rows×two columns arrangement,
the third pixel group includes the plurality of second pixel groups in two rows×two columns arrangement,
the plurality of second pixel groups in the third pixel group includes:
a first group that includes a first set of two pixels in a first direction;
a second group that includes a second set of two pixels in a second direction; and
a third group that includes a third set of two pixels in a third direction,
the third direction is different from each of the first direction and the second direction,
the first direction is different from the second direction,
the exposure time for the first set of two pixels in the first direction in the first group is same,
the exposure time for the second set of two pixels in the second direction in the second group is same,
the exposure time for the third set of two pixels in the third direction in the third group is same,
the exposure time of the third set of two pixels is different from each of:
the exposure time of the first set of two pixels, and
the exposure time of the second set of two pixels, and
the exposure time of the second set of two pixels is different from the exposure time of the first set of two pixels;
generating phase difference data for each of the exposure time of the first set of two pixels, the exposure time of the second set of two pixels, and the exposure time of the third set of two pixels, based on image data, wherein the image data is based on the controlled exposure time associated with each of the plurality of pixels; and
generating a High Dynamic Range image based on the generated phase difference data.