Image processing apparatus, image processing method, and program

1. An image processing apparatus comprising:

a code generation section which generates, based on a comparison result between pixel values for corresponding pixels obtained from at least first and second images captured at first and second exposure times and first and second exposure durations respectively by an imaging device having multiple pixels and at least a first threshold, a code representing a brightness region for each of a plurality of pixels of the first and second images obtained by an imaging device, wherein each brightness region encompasses a range of luminance values, and wherein a spacing between brightness regions is unequal;

a code memory, wherein at least a first set of the codes generated by the code generation section for the pixels of at least the first image are stored in the code memory;

a moving photographic detection section which detects a moving photographic subject included in the plurality of images based on the generated codes by detecting a transition between a code generated for at least a first pixel included in the first set of codes compared to a code generated for the first pixel included in a second set of codes;

an image combination section which generates a combined image by combining the plurality of images, wherein the generated code for any one of the pixels in the plurality of pixels is not equal to a luminance value for the pixel in the combined image; and

an image correction section which corrects the combined image based on information related to the detected moving photographic subject.

2. The image processing apparatus according to claim 1 ,

wherein the code generation section generates the code for each pixel based on a comparison result between pixel values of the plurality of images and a threshold.

3. The image processing apparatus according to claim 2 ,

wherein the first and second images are a short time exposure image and a long time exposure image, and

wherein the code generation section generates the code for each pixel based on a comparison result between values specified by pixel values of the short time exposure image and a sum of pixel values of the short time exposure image and pixel values of the long time exposure image, and the threshold.

4. The image processing apparatus according to claim 2 ,

wherein the first and second images are a short time exposure image and a long time exposure image, and

wherein the code generation section generates the code for each pixel based on a comparison result between values specified by pixel values of the short time exposure image and pixel values of the long time exposure image, and the threshold.

5. The image processing apparatus according to claim 1 ,

wherein the first and second images are a short time exposure image and a long time exposure image, and

wherein the code generation section generates the code for each pixel by classifying and coding each pixel constituting the plurality of images into a first level in which pixels of the long time exposure image are used in an image combination process which generates a combined image by combining the plurality of images, a second level in which a sum of pixels of the long time exposure image and pixels of the short time exposure image are used in the image combination process, a third level in which pixels of the short time exposure image are used in the image combination process, and a fourth level which belongs between the second level and the third level.

6. The image processing apparatus according to claim 1 ,

wherein the first and second images are a short time exposure image and a long time exposure image, and

wherein, in the case where an imaging operation is performed by an exposure system which generates only the long time exposure image from among the short time exposure image and the long time exposure image, the code generation section generates and uses a virtual short time exposure image corresponding to a ratio of exposure times based on the long time exposure image.

7. The image processing apparatus according to claim 1 ,

wherein the moving photographic detection section detects the moving photographic subject based on a plurality of the codes generated at different times.

8. The image processing apparatus according to claim 1 ,

wherein the moving photographic detection section detects the moving photographic subject is further based on a transition between the first code from the first pixel included in the first image and codes for other pixels included in the second image that are in a vicinity of the first pixel.

9. The image processing apparatus according to claim 1 ,

wherein the moving photographic detection section detects the moving photographic subject based on a transition between the first code from the first pixel included in the first image and codes for other pixels included in the second image that are in a vicinity of the pixel of interest and that are all have a same code value.

10. The image processing apparatus according to claim 1 , further comprising:

a compression section which compresses the code information;

a memory which holds the compressed code information; and

an expansion section which reads and expands the compressed code information held in the memory,

wherein the moving photographic detection section detects the moving photographic subject based on the expanded code information.

11. An image processing method comprising:

a code generation mechanism which generates, based on a comparison result between pixel values for corresponding pixels obtained from at least first and second images captured at first and second exposure times and first and second exposure durations respectively and at least a first threshold, a code representing a brightness region of each of a plurality of pixels in the first and second images, wherein each brightness region encompasses a range of luminance values, and wherein a spacing between brightness regions is unequal;

a code memory, wherein at least a first set of the codes generated by the code generation mechanism are stored in the code memory;

a moving photographic detection mechanism which detects a moving photographic subject included in the plurality of images based on the generated codes by detecting a transition between a code generated for at least a first pixel included in the first set of codes compared to a code generated for the first pixel included in a second set of codes;

an image combination section which generates a combined image by combining the plurality of images, wherein the generated code for any one of the pixels in the plurality of pixels is not equal to a luminance value for the pixel in the combined image; and

an image correction section which corrects the combined image based on information related to the detected moving photographic subject.

12. A non-transitory computer readable medium having encoded therein a program for causing a computer to execute a plurality of mechanisms, comprising:

a code generation mechanism which generates, based on a comparison result between pixel values for corresponding pixels obtained from at least first and second images captured at first and second exposure times and first and second exposure durations respectively, a code representing an index of a brightness of a brightness region each of a plurality of pixels of the first and second images obtained by an imaging device and at least a first threshold, wherein each brightness region encompasses a range of luminance values, and wherein a spacing between brightness regions is unequal; and

a moving photographic detection mechanism which detects a moving photographic subject included in the plurality of images based on the generated codes by detecting a transition between a code generated for at least a first pixel included in a first set of codes compared to a code generated for the first pixel included in a second set of codes;

an image combination section which generates a combined image by combining the plurality of images, wherein the generated code for any one of the pixels in the plurality of pixels is not equal to a luminance value for the pixel in the combined image; and

an image correction section which corrects the combined image based on information related to the detected moving photographic subject.