Image processing apparatus and image processing method
An image processing apparatus includes a selecting unit selecting a reference image from input images, a calculating unit calculating brightness ratios of the remaining input images as gains, a calculating unit calculating first weights for the remaining input images and calculating a second weight based on a brightness of image data as a synthesized image of the input image with the first weights, a generating unit generating a high-contrast image by performing weighting synthesis on the input images using the first weights and the second weight, a preparing unit preparing a tone conversion curve based on a brightness distribution of the high-contrast image and a brightness distribution as conversion target, and a generating unit performing the tone conversion on the high-contrast image based on the tone conversion curve, and generating the output image having the narrow tonal range.
1. An image processing apparatus generating, based on a high-contrast image being a synthetic image whose dynamic range is extended and thus having a wide tonal range achieved by synthesizing a plurality of pieces of input images obtained by shooting a same scene and having different exposure amounts, an output image having a narrower tonal range than the high-contrast image, the image processing apparatus comprising:
a selecting unit selecting a reference image from the plurality of pieces of input images based on information of brightness components of the plurality of pieces of input images;
a gain calculating unit calculating, for each of one or more remaining input images, which are the plurality of pieces of input images excluding the reference image, a brightness ratio of each of the one or more remaining input images to the reference image as a gain, based on the information of the brightness components of the plurality of pieces of input images;
a weight calculating unit calculating one or more first weights to be applied to the one or more remaining input images based on the gain being calculated and information of a brightness component of the reference image, and calculating a second weight based on information of a brightness component of image data as a result of performing weighting synthesis calculation on the plurality of pieces of input images using the one or more first weights;
an intermediate image generating unit generating the high-contrast image by performing weighting synthesis on the plurality of pieces of input images using the one or more first weights and the second weight being calculated;
a preparing unit preparing, based on information of a shape of a brightness distribution of the high-contrast image being generated and information of a shape of a predetermined brightness distribution as a conversion target, a tone conversion curve indicating a characteristic of tone conversion; and
an output image generating unit performing the tone conversion on the high-contrast image based on the tone conversion curve being prepared, and generating the output image having the narrower tonal range than the high-contrast image.
2. The image processing apparatus according to claim 1 , wherein
the selecting unit selects, based on information of brightness components of reduced images obtained by reducing each of the plurality of pieces of input images, one piece of input image having a widest effective range of a brightness distribution among the plurality of pieces of input images as the reference image.
3. The image processing apparatus according to claim 1 , wherein
the gain calculating unit calculates, for each of the one or more remaining input images, the brightness ratio of each of the one or more remaining input images to the reference image as the gain, based on information of brightness components of reduced images obtained by reducing each of the plurality of pieces of input images.
4. The image processing apparatus according to claim 1 , wherein
the weight calculating unit,
with respect to each of the one or more remaining input images whose value of the calculated gain is smaller than a predetermined value, calculates the one or more first weights to increase a weight for a high brightness part of the one or more remaining input images, and,
with respect to each of the one or more remaining input images whose value of the calculated gain is larger than the predetermined value, calculates the one or more first weights to increase a weight for a low brightness part of the one or more remaining input images.
5. The image processing apparatus according to claim 1 , wherein
the weight calculating unit calculates a ratio determined to make a maximum brightness value of the image data as a result of performing the weighting synthesis calculation on the plurality of pieces of input images using the one or more first weights correspond to a maximum value in a predetermined “N”-bit tone as a result of extending a dynamic range, as the second weight.
6. The image processing apparatus according to claim 1 , wherein
the preparing unit extracts, from the information of the shape of the brightness distribution of the high-contrast image being generated and the information of the shape of the predetermined brightness distribution as the conversion target, information indicating a correspondence between a brightness value of the high-contrast image being a conversion source and a brightness value of the output image being a conversion destination, and prepares the tone conversion curve indicating the characteristic of the tone conversion based on the information being extracted.
7. The image processing apparatus according to claim 1 , wherein
the preparing unit prepares the tone conversion curve indicating the characteristic of the tone conversion, based on information of a shape of a brightness distribution formed by only pixels that belong to a tone range predetermined or specified by a user out of a tone range of the high-contrast image and the information of the shape of the brightness distribution as the conversion target.
8. The image processing apparatus according to claim 1 , wherein
the information of the shape of the brightness distribution is information of a shape of an accumulated histogram.
9. The image processing apparatus according to claim 1 , wherein
the high-contrast image being the synthetic image having the wide tonal range is an image whose number of tones is larger than number of tones of the plurality of pieces of input images.
10. An image processing method generating, based on a high-contrast image being a synthetic image whose dynamic range is extended and having a wide tonal range achieved by synthesizing a plurality of pieces of input images obtained by shooting a same scene and having different exposure amounts, an output image having a narrower tonal range than the high-contrast image, the image processing method comprising:
a selecting step selecting a reference image from the plurality of pieces of input images based on information of brightness components of the plurality of pieces of input images;
a gain calculating step calculating, for each of one or more remaining input images, which are the plurality of pieces of input images excluding the reference image, a brightness ratio of each of the one or more remaining input images to the reference image as a gain, based on the information of the brightness components of the plurality of pieces of input images;
a weight calculating step calculating one or more first weights to be applied to the one or more remaining input images based on the gain being calculated and information of a brightness component of the reference image, and calculating a second weight based on information of a brightness component of image data as a result of performing weighting synthesis calculation on the plurality of pieces of input images using the one or more first weights;
an intermediate image generating step generating the high-contrast image by performing weighting synthesis on the plurality of pieces of input images using the one or more first weights and the second weight being calculated;
a preparing step preparing, based on information of a shape of a brightness distribution of the high-contrast image being generated and information of a shape of a predetermined brightness distribution as a conversion target, a tone conversion curve indicating a characteristic of tone conversion; and
an output image generating step performing the tone conversion on the high-contrast image based on the tone conversion curve being prepared, and generating the output image having the narrower tonal range than the high-contrast image.
11. The image processing method according to claim 10 , wherein
the selecting step selects, based on information of brightness components of reduced images obtained by reducing each of the plurality of pieces of input images, one piece of input image having a widest effective range of a brightness distribution among the plurality of pieces of input images as the reference image.
12. The image processing method according to claim 10 , wherein
the gain calculating step calculates, for each of the one or more remaining input images, the brightness ratio of each of the one or more remaining input images to the reference image as the gain, based on information of brightness components of reduced images obtained by reducing each of the plurality of pieces of input images.
13. The image processing method according to claim 10 , wherein
the weight calculating step,
with respect to each of the one or more remaining input images whose value of the calculated gain is smaller than a predetermined value, calculates the one or more first weights to increase a weight for a high brightness part of the one or more remaining input images, and,
with respect to each of the one or more remaining input images whose value of the calculated gain is larger than the predetermined value, calculates the one or more first weights to increase a weight for a low brightness part of the one or more remaining input images.
14. The image processing method according to claim 10 , wherein
the weight calculating step calculates a ratio determined to make a maximum brightness value of the image data as a result of performing the weighting synthesis calculation on the plurality of pieces of input images using the one or more first weights correspond to a maximum value in a predetermined “N”-bit tone as a result of extending a dynamic range, as the second weight.
15. The image processing method according to claim 10 , wherein
the preparing step extracts, from the information of the shape of the brightness distribution of the high-contrast image being generated and the information of the shape of the predetermined brightness distribution as the conversion target, information indicating a correspondence between a brightness value of the high-contrast image being a conversion source and a brightness value of the output image being a conversion destination, and prepares the tone conversion curve indicating the characteristic of the tone conversion based on the information being extracted.
16. The image processing method according to claim 10 , wherein
the preparing step prepares the tone conversion curve indicating the characteristic of the tone conversion, based on information of a shape of a brightness distribution formed by only pixels that belong to a tone range predetermined or specified by a user out of a tone range of the high-contrast image and the information of the shape of the brightness distribution as the conversion target.
17. The image processing method according to claim 10 , wherein
the information of the shape of the brightness distribution is information of a shape of an accumulated histogram.
18. The image processing method according to claim 10 , wherein
the high-contrast image being the synthetic image having the wide tonal range is an image whose number of tones is larger than number of tones of the plurality of pieces of input images.