Image processing apparatus, image capturing system, image processing method, and recording medium

1. An image processing apparatus, comprising:

processing circuitry configured to

obtain a plurality of images, including a first image, a second image, and a third image, that have been captured under different exposure conditions;

receive designation of an area in the first image, the first image being one of the plurality of images;

obtain a brightness characteristic value of the designated area in the first image;

select, based on the obtained brightness characteristic value of the designated area, one of the second image and the third image to be a combining image;

determine a combining condition used for combining the first image and a second the combining image according to based on the obtained brightness characteristic value, the second image being any one of the plurality of images other than the first image; and

combine the first image and the second combining image based on the determined combining condition to correct brightness of the designated area for display of the first image,

wherein the processing circuitry is further configured to select the one of the second image and the third image, from the plurality of images that have been captured under the different exposure conditions, based on a comparison between the obtained brightness characteristic value of the designated area in the first image and a threshold,

wherein, when the brightness characteristic value is greater than the threshold, the processing circuitry is further configured to select, as the second combining image, one of the second image and the third image having an exposure level lower than an exposure level of the first image, and

wherein, when the brightness characteristic value is less than the threshold, the processing circuitry is further configured to select, as the second combining image, one of the second image and the third image having an exposure level higher than the exposure level of the first image.

2. The image processing apparatus of claim 1 , wherein the processing circuitry is further configured to determine the combining condition based on a difference between the brightness characteristic value of the designated area in the first image and the threshold.

3. The image processing apparatus of claim 1 , wherein the combining condition indicates a ratio weight indicating how much of the first image is combined, and how much of the second image is combined.

4. The image processing apparatus of claim 1 ,

wherein the processing circuitry is further configured to select the first image based on information related to brightness of the plurality of images that have been captured under the different exposure conditions.

5. The image processing apparatus of claim 1 ,

wherein the plurality of images that have been captured under the different exposure conditions are each a spherical image, and

wherein the processing circuitry is further configured to

receive designation of a line of sight direction and an angle of view with respect to the first image, as designation of the area in the first image,

apply projection transformation to the first image having the designated area defined by the line of sight direction and the angle of view, to generate a reference-area image corresponding to the designated area,

in obtaining the brightness characteristic value of the designated area, obtain a brightness characteristic value of the reference-area image, and

determine the combining condition for combining the first image and the second image, according to the brightness characteristic value of the reference-area image.

6. The image processing apparatus of claim 1 , wherein the plurality of images that have been captured under the different exposure conditions are each a planar image.

7. The image processing apparatus of claim 1 , further comprising:

a display to display an area in the combined image corresponding to the designated area in the first image.

8. An imaging system, comprising:

the image processing apparatus of claim 1 ; and

an image capturing system configured to capture the plurality of images under the different exposure conditions.

9. An image processing method, comprising:

obtaining a plurality of images, including a first image, a second image, and a third image, that have been captured under different exposure conditions;

receiving designation of an area in the first image, the first image being one of the plurality of images;

obtaining a brightness characteristic value of the designated area in the first image;

selecting, based on the obtained brightness characteristic value of the designated area, one of the second image and the third image to be a combining image;

determining a combining condition used for combining the first image and a second the combining image according to based on the obtained brightness characteristic value, the second image being any one of the plurality of images other than the first image; and

combining the first image and the second combining image based on the determined combining condition to correct brightness of the designated area for display of the first image,

wherein the method further comprises:

selecting the one of the second image and the third image, from the plurality of images that have been captured under the different exposure conditions, based on a comparison between the obtained brightness characteristic value of the designated area in the first image and a threshold,

wherein, when the brightness characteristic value is greater than the threshold, the method further includes selecting, as the second combining image, one of the second image and the third image having an exposure level lower than an exposure level of the first image, and

wherein, when the brightness characteristic value is less than the threshold, the method further includes selecting, as the second combining image, one of the second image and the third image having an exposure level higher than the exposure level of the first image.

10. A non-transitory recording medium carrying computer readable code for controlling a computer to perform the method of claim 9 .

11. The image processing apparatus of claim 1 , wherein the processing circuitry is further configured to obtain an average brightness of the designated area as the brightness characteristic value.

12. An image processing apparatus, comprising:

processing circuitry configured to

obtain a plurality of images, including a first image, a second image, and a third image, that have been captured under different exposure conditions;

receive designation of an area in the first image;

obtain a brightness characteristic value of the designated area in the first image;

select, based on the obtained brightness characteristic value of the designated area, one of the second image and the third image to be a combining image; and

combine the first image and the combining image to correct brightness of the designated area of the first image,

wherein the processing circuitry is further configured to select the one of the second image and the third image, from the plurality of images that have been captured under the different exposure conditions, based on a comparison between the obtained brightness characteristic value of the designated area in the first image and a threshold,

wherein, when the brightness characteristic value is greater than the threshold, the processing circuitry is further configured to select, as the second combining image, one of the second image and the third image having an exposure level lower than an exposure level of the first image, and

wherein, when the brightness characteristic value is less than the threshold, the processing circuitry is further configured to select, as the second combining image, one of the second image and the third image having an exposure level higher than the exposure level of the first image.

13. The image processing apparatus of claim 1 , wherein the circuitry is further configured to receive the designation of the area, which is a partial region of the first image.