Panoramic imaging apparatus, imaging method, and program with warning detection
An imaging apparatus includes: an imaging device capturing a subject image through an optical system; an image signal processor having a function of combining multiple captured images into a single image, the images being captured during the period when the imaging apparatus is moved; and a control unit, wherein the image signal processor detects any effect of parallax or a moving subject based on the similarity among motion vectors between adjacent images, and the control unit issues a warning when the image signal processor detects any effect of the moving object or parallax to prompt image recapturing.
1. An imaging apparatus for capturing multiple strip-shaped images to be combined to generate a panoramic image, comprising:
an image sensor configured to capture the multiple strip-shaped images to be combined to generate the panoramic image while the imaging apparatus is being moved in a direction perpendicular to readout lines of the image sensor; and
a system controller configured to detect any effect of parallax on the multiple strip-shaped images and issue a warning when any effect of parallax is detected to prompt image recapturing,
wherein,
each of the multiple strip-shaped images is a central portion that is clipped from an imaging range of the image sensor, and
the multiple strip-shaped images are captured at an overlapping rate of 50% or higher so that any part of a subject appears in at least two temporally adjacent strip-shaped images.
2. The imaging apparatus according to claim 1 , wherein the system controller comprises an image signal processor configured to combine the multiple strip-shaped images into a single image and detect any effect of parallax based on a similarity among motion vectors between adjacent strip-shaped images.
3. The imaging apparatus according to claim 2 , wherein:
the image signal processor is further configured to carry out multiple motion detection operations in an area where two temporally adjacent strip-shaped images overlap with each other to determine multiple motion vectors, and
the system controller further comprises a control unit configured to issue the warning without distinguishing between an effect of parallax and a moving subject at a boundary between a moving object and a stationary subject.
4. A method for capturing multiple strip-shaped images to be combined to generate a panoramic image by an imaging apparatus, the method comprising the steps of:
capturing the multiple strip-shaped images be combined to generate the panoramic image while the imaging apparatus is being moved in a direction perpendicular to readout lines of the image sensor;
detecting any effect of parallax on the multiple strip-shaped images; and
issuing a warning when any effect of parallax is detected to prompt image recapturing,
wherein,
each of the multiple strip-shaped images is a central portion that is clipped from an imaging range of the image sensor, and
the multiple strip-shaped images are captured at an overlapping rate at 50% or higher so that any part of a subject appears in at least two temporally adjacent strip-shaped images.
5. The method according to claim 4 , further comprising the steps of:
combining the multiple strip-shaped images into a single image; and
detecting any effect of parallax based on a similarity among motion vectors between adjacent strip-shaped images.
6. The method according to claim 5 , wherein:
multiple motion detection operations are carried out in an area where two temporally adjacent strip-shaped images overlap with each other to determine multiple motion vectors, and
the warning is issued in response to an effect of parallax and a moving subject not distinguished from each other at a boundary between a moving object and a stationary object.
7. A non-transitory computer readable medium having stored thereon computer executable instructions for capturing multiple strip-shaped images that are subject to be combined to generate a panoramic image by an imaging apparatus, the instructions comprising:
capturing the multiple strip-shaped images that are subject to be combined to generate the panoramic image while the imaging apparatus is being moved in a direction perpendicular to readout lines of the image sensor;
detecting any effect of parallax on the multiple strip-shaped images; and
issuing a warning when any effect of parallax is detected to prompt image recapturing,
wherein,
each of the multiple strip-shaped images is a central portion that is clipped from an imaging range of the image sensor, and
the multiple strip-shaped images are captured at an overlapping rate at 50% or higher so that any part of a subject appears in at least two temporally adjacent strip-shaped images.
8. The imaging apparatus of claim 2 , wherein the image signal processor is further configured to carry out multiple motion detection operations in an area where two temporally adjacent strip-shaped images overlap with each other to determine multiple motion vectors, and recognize that an effect of parallax is detected when motion vectors having different values are present.
9. The method of claim 5 , wherein:
multiple motion detection operations are carried out in an area where two temporally adjacent strip-shaped images overlap with each other to determine multiple motion vectors, and
an effect of parallax is detected when motion vectors having different values are present.
10. The imaging apparatus of claim 1 , wherein the panoramic image is a two-dimensional panoramic image.
11. The imaging apparatus of claim 1 , wherein the multiple strip-shaped images are captured from a single point.
12. The imaging apparatus of claim 1 , further comprising:
an attitude sensor configured to detect attitude of the imaging apparatus and supply the detected attitude to the system controller while the imaging apparatus is being moved.