Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
A single composite image is generated by selecting a pixel value for each pixel in any one of a plurality of captured images having been consecutively captured. A motion vector between at least two captured images among the plurality of captured images is calculated. Correction processing is performed, based on a motion vector corresponding to a pixel of interest in the composite image, on the pixel of interest or a pixel near the pixel of interest. The correction processing is performed by updating, using a bright pixel value, a pixel value of at least one pixel in a group of pixels associated with a path from the pixel of interest to a pixel indicated by the motion vector corresponding to the pixel of interest.
1. An image processing apparatus, comprising:
a generating unit configured to generate a single composite image by selecting a pixel value for each pixel in any one of a plurality of captured images having been consecutively captured;
a calculating unit configured to calculate a motion vector between at least two captured images among the plurality of captured images; and
a correcting unit configured to perform correction processing, based on a motion vector corresponding to a pixel of interest in the composite image, on the pixel of interest or a pixel near the pixel of interest, wherein
the correcting unit performs the correction processing by updating, using a bright pixel value, a pixel value of at least one pixel in a group of pixels associated with a path from the pixel of interest to a pixel indicated by the motion vector corresponding to the pixel of interest.
2. The image processing apparatus according to claim 1 , wherein
the correcting unit performs the correction processing on any one of the pixels included in the group of pixels associated with the path.
3. The image processing apparatus according to claim 1 , wherein
the correcting unit updates a pixel value of a correction target pixel to a brighter pixel value.
4. The image processing apparatus according to claim 1 , wherein
the correcting unit updates, using a pixel value of any one of the pixels included in the group of pixels associated with the path, a pixel value of the correction processing target pixel.
5. The image processing apparatus according to claim 1 , wherein
the correcting unit updates, using a brightest pixel value among the group of pixels associated with the path, a pixel value of the correction processing target pixel.
6. The image processing apparatus according to claim 1 , wherein
the correcting unit refers to a motion vector calculated by the calculating unit with respect to a pixel selected by the generating unit as a pixel of interest in the composite image, in order to correct a pixel value of the pixel of interest.
7. The image processing apparatus according to claim 1 , wherein
the correcting unit specifies, as a group of pixels associated with the path, pixels through which a line segment passes, the line segment connecting the pixel of interest and a pixel separate from the pixel of interest in a direction of a motion vector corresponding to the pixel of interest.
8. The image processing apparatus according to claim 1 , wherein
the correcting unit corrects, based on a pixel value of a pixel in the composite image and a pixel value of a pixel separate from the pixel in a direction of a motion vector corresponding to the pixel, the pixel value of the separate pixel.
9. The image processing apparatus according to claim 1 , wherein
the correcting unit weights a pixel value of a pixel separate from the pixel of interest in a direction of a motion vector corresponding to the pixel of interest, in accordance with a distance between the separate pixel and a line segment connecting the pixel of interest and the separate pixel, and then the correcting unit corrects the pixel value of the pixel of interest based on the weighted pixel value.
10. The image processing apparatus according to claim 1 , wherein
the generating unit selects a pixel having a maximum luminance value among pixels at a pixel of interest position of the plurality of captured images, and the generating unit selects the selected pixel as a pixel at the pixel of interest position in the composite image.
11. The image processing apparatus according to claim 1 , wherein
the generating unit selects a pixel having a minimum luminance value among the pixels at a pixel of interest position of the plurality of captured images, and the generating unit selects the selected pixel as a pixel at the pixel of interest position in the composite image.
12. The image processing apparatus according to claim 1 , wherein
the calculating unit calculates a motion vector between the captured image and a captured image having been captured immediately before the captured image.
13. The image processing apparatus according to claim 1 , wherein
the calculating unit calculates a motion vector between the captured image and a captured image having been captured immediately after the captured image.
14. The image processing apparatus according to claim 1 , wherein
the plurality of captured images is a plurality of frames included in continuous shots or a moving picture, and
the calculating unit corrects a motion vector between the frames based on an exposure time and a frame rate of the captured image.
15. The image processing apparatus according to claim 1 , wherein
the generating unit generates a single composite image using a pixel selected from a plurality of captured images that inverse γ conversion has been performed,
the calculating unit calculates a motion vector between at least two captured images among the plurality of captured images that the inverse γ conversion has been performed, and
the correcting unit corrects the composite image based on a motion vector calculated by the calculating unit with respect to a pixel selected by the generating unit as a pixel in the composite image, and the correcting unit performs γ conversion on a result obtained by α-blending the corrected composite image and an average image of the plurality of captured images that the inverse γ conversion has been performed.
16. The image processing apparatus according to claim 1 , wherein
in a case where bright pixels are included in the group of pixels associated with the path, the correcting unit performs the correction processing in such a manner as to cause the bright pixels to be continued.
17. The image processing apparatus according to claim 1 , wherein
the correcting unit specifies a pixel whose pixel value is to be updated by the correction processing, using a motion vector of the pixel of interest.
18. The image processing apparatus according to claim 1 , wherein
the correcting unit determines, using the motion vector, a value from which a pixel value of the correction processing target pixel is updated.
19. An image processing method performed by an image processing apparatus, the method comprising:
generating a single composite image by selecting a pixel value for each pixel in any one of a plurality of captured images having been consecutively captured;
calculating a motion vector between at least two captured images among the plurality of captured images; and
performing correction processing, based on a motion vector corresponding to a pixel of interest in the composite image, on the pixel of interest or a pixel near the pixel of interest, wherein
the correction processing is performed by updating, using a bright pixel value, a pixel value of at least one pixel in a group of pixels associated with a path from the pixel of interest to a pixel indicated by the motion vector corresponding to the pixel of interest.
20. A non-transitory computer-readable storage medium storing a computer program for causing a computer to function as:
a generating unit configured to generate a single composite image by selecting a pixel value for each pixel in any one of a plurality of captured images having been consecutively captured;
a calculating unit configured to calculate a motion vector between at least two captured images among the plurality of captured images; and
a correcting unit configured to perform correction processing, based on a motion vector corresponding to a pixel of interest in the composite image, on the pixel of interest or a pixel near the pixel of interest, wherein
the correcting unit performs the correction processing by updating, using a bright pixel value, a pixel value of at least one pixel in a group of pixels associated with a path from the pixel of interest to a pixel indicated by the motion vector corresponding to the pixel of interest.