Image generation apparatus and image generation method
Provided is an image generation unit that generates a plurality of simulation images in which a plurality of images having different accumulation times is reproduced on the basis of a physical quantity corresponding to light applied to an image sensor, and an HDR synthesis unit performs HDR synthesis on a plurality of simulation images.
1 . An image generation apparatus, comprising:
a central processing unit (CPU) configured to:
generate a plurality of simulation images based on a physical quantity, wherein
the plurality of simulation images includes a reproduction of a plurality of images,
the plurality of images is associated with a plurality of accumulation times, and
the physical quantity corresponds to an application of light on an image sensor; and
the physical quantity corresponds to a specific position of the image sensor;
convert the physical quantity to a number of photons;
multiply, for each of the plurality of accumulation times, the number of photons by a plurality of transmittance values of a plurality of color filters, wherein each of the plurality of color filters corresponds to a respective pixel of a plurality of pixels of the image sensor;
integrate, for each of the plurality of accumulation times, the number of photons in a specific wavelength range;
convert, for each of the plurality of accumulation times, the number of photons into a respective charge amount;
integrate the number of photons for a pixel area and a specific accumulation time of the plurality of accumulation times;
multiply the integrated number of photons by a quantum efficiency;
calculate, based on the multiplication, the respective charge amount for each of the plurality of accumulation times, wherein the respective charge amount is associated with each of the plurality of pixels;
perform a high dynamic range (HDR) synthesis on the plurality of simulation images;
generate an HDR image based on the HDR synthesis on the plurality of simulation images;
determine a transmission band of the HDR image based on the HDR synthesis; and
perform gradation compression on the HDR image based on the transmission band of the HDR image.
2 . The image generation apparatus according to claim 1 , wherein the CPU is further configured to generate the plurality of simulation images based on the physical quantity corresponding to a specific frame.
3 . The image generation apparatus according to claim 1 , wherein
the CPU is further configured to generate the plurality of simulation images based on the physical quantity,
the physical quantity corresponds to a plurality of frames, and
each of the plurality of frames is at a respective timing of a plurality of timings.
4 . The image generation apparatus according to claim 1 , wherein the physical quantity is spectral irradiance.
5 . The image generation apparatus according to claim 1 , wherein the CPU is further configured to add a specific noise component to the respective charge amount of the each of the plurality of pixels.
6 . The image generation apparatus according to claim 1 , wherein the CPU is further configured to:
convert, for each of the plurality of accumulation times, the respective charge amount of each of the plurality of pixels into a respective voltage value;
convert, for each of the plurality of accumulation times, the respective voltage value of each of the plurality of pixels to a digital value; and
generate, for each of the plurality of accumulation times, a simulation image of the plurality of simulation images based on the conversion of the respective voltage value of each of the plurality of pixels to the digital value.
7 . The image generation apparatus according to claim 6 , wherein the CPU is further configured to add a specific noise component to the respective voltage value of each of the plurality of pixels.
8 . An image generation method, comprising:
in an image generation apparatus;
generating a plurality of simulation images based on a physical quantity, wherein the plurality of simulation images includes a reproduction of a plurality of images,
the plurality of images is associated with a plurality of accumulation times, and
the physical quantity corresponds to an application of light on an image sensor; and
the physical quantity corresponds to a specific position of the image sensor;
converting the physical quantity to a number of photons;
multiplying, for each of the plurality of accumulation times, the number of photons by a plurality of transmittance values of a plurality of color filters, wherein each of the plurality of color filters corresponds to a respective pixel of a plurality of pixels of the image sensor;
integrating, for each of the plurality of accumulation times, the number of photons in a specific wavelength range;
converting, for each of the plurality of accumulation times, the number of photons into a respective charge amount;
integrating the number of photons for a pixel area and a specific accumulation time of the plurality of accumulation times;
multiplying the integrated number of photons by a quantum efficiency;
calculating, based on the multiplying, the respective charge amount for each of the plurality of accumulation times, wherein the respective charge amount is associated with each of the plurality of pixels;
performing a high dynamic range (HDR) synthesis on the plurality of simulation images;
generating an HDR image based on the HDR synthesis on the plurality of simulation images;
determining a transmission band of the HDR image based on the HDR synthesis; and
performing gradation compression on the HDR image based on the transmission band of the HDR image.
9 . A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
generating a plurality of simulation images based on a physical quantity, wherein
the plurality of simulation images includes a reproduction of a plurality of images,
the plurality of images is associated with a plurality of accumulation times, and
the physical quantity corresponds to an application of light on an image sensor, and
the physical quantity corresponds to a specific position of the image sensor;
converting the physical quantity to a number of photons;
multiplying, for each of the plurality of accumulation times, the number of photons by a plurality of transmittance values of a plurality of color filters, wherein each of the plurality of color filters corresponds to a respective pixel of a plurality of pixels of the image sensor;
integrating, for each of the plurality of accumulation times, the number of photons in a specific wavelength range;
converting, for each of the plurality of accumulation times, the number of photons into a respective charge amount;
integrating the number of photons for a pixel area and a specific accumulation time of the plurality of accumulation times;
multiplying the integrated number of photons by a quantum efficiency;
calculating, based on the multiplying, the respective charge amount for each of the plurality of accumulation times, wherein the respective charge amount is associated with each of the plurality of pixels;
performing a high dynamic range (HDR) synthesis on the plurality of simulation images;
generating an HDR image based on the HDR synthesis on the plurality of simulation images;
determining a transmission band of the HDR image based on the HDR synthesis; and
performing gradation compression on the HDR image based on the transmission band of the HDR image.