Distortion estimating image processing device, method, and non-transitory storage medium
An image processing device includes an image input portion, a motion vector acquisition portion and a distortion component estimation portion. The image input portion inputs a target image which is an image to be processed. The motion vector acquisition portion acquires a motion vector generated by relative movement with respect to a subject drawn in the target image when an imaging device which has generated the target image generates the target image. The distortion component estimation portion estimates a rolling shutter distortion component of the target image based on the motion vector.
1. An image processing device that processes an image, comprising:
an image input portion inputting a target image that is an image to be processed;
a motion vector acquisition portion acquiring a motion vector generated by relative movement with respect to a subject drawn in the target image when an imaging device generates the target image; and
a distortion component estimation portion estimating a rolling shutter distortion component associating a coordinate system of the target image without distortion with a coordinate system of the target image with distortion based on a parallel movement component the motion vector and a distortion coefficient.
2. The image processing device according to claim 1 , wherein
the distortion component estimation portion estimates the rolling shutter distortion component based on the motion vector and a setting value of an imaging condition of the imaging device.
3. The image processing device according to claim 1 , wherein
the motion vector acquisition portion is configured to be able to refer to a recording portion which stores a last image which was generated immediately before the target image, and acquires the motion vector based on the last image stored in the recording portion and the target image.
4. The image processing device according to claim 1 , wherein
the motion vector acquisition portion acquires the motion vector detected by a gyro sensor included in the imaging device.
5. The image processing device according to claim 1 , further comprising:
a correction portion correcting the target image based on the rolling shutter distortion component.
6. The image processing device according to claim 5 , wherein
the correction portion is configured to be able to refer to the recording portion which stores a last history of the rolling shutter distortion component, and adjusts the rolling shutter distortion component in the target image so that, when a difference between the last rolling shutter distortion component stored in the recording portion and the rolling shutter distortion component in the target image is larger than a predetermined value, the difference is reduced.
7. The image processing device according to claim 1 , wherein
the motion vector acquisition portion is configured to be able to refer to the recording portion which stores the motion vector, and adjusts the motion vector in the target image so that, when a difference between the last motion vector stored in the recording portion and the motion vector in the target image is larger than a predetermined value, the difference is reduced.
8. An image processing method for processing an image, comprising:
an image input step of inputting a target image which is an image to be processed;
a motion vector acquisition step of acquiring a motion vector generated by relative movement with respect to a subject drawn in the target image when an imaging device generates the target image; and
a distortion component estimation step of estimating a rolling shutter distortion component associating a coordinate system of the target image without distortion with a coordinate system of the target image with distortion based on a parallel movement component of the motion vector and a distortion coefficient.
9. A non-transitory storage medium storing an image processing program for causing a computer to operate to process an image, the program causing the computer to operate as:
an image input portion inputting a target image that is an image to be processed;
a motion vector acquisition portion acquiring a motion vector generated by relative movement with respect to a subject drawn in the target image when an imaging device generates the target image; and
a distortion component estimation portion estimating a rolling shutter distortion component associating a coordinate system of the target image without distortion with a coordinate system of the target image with distortion based on a parallel movement component of the motion vector and a distortion coefficient.