Information processing apparatus, information processing method, and storage medium

1 . An information processing apparatus comprising:

an obtainment unit configured to obtain a pair of images constituting a parallax image for achieving stereoscopic vision;

an association unit configured to generate association data linking corresponding pixels in the pair of images constituting the parallax image obtained by the obtainment unit;

a correction unit configured to correct vertical misalignment between corresponding pixels in the pair of images based on the generated association data; and

a derivation unit configured to derive a correction weight of each pixel constituting the parallax image,

wherein the derivation unit derives the correction weight in accordance with an angle of a light ray relative to an optical axis direction of an image capturing apparatus that captures the parallax image, the angle being recorded in each pixel of the parallax image, and

wherein the derivation unit derives the correction weight that decreases as the absolute value of the elevation angle of the light ray increases, the elevation angle being recorded in each pixel of the parallax image.

2 . The information processing apparatus according to claim 1 , wherein the correction unit corrects one or both of the pair of images.

3 . The information processing apparatus according to claim 1 , wherein the obtainment unit obtains mesh data for displaying the parallax image, and

wherein the correction unit corrects vertical misalignment between corresponding pixels in the pair of images constituting the parallax image by correcting, based on the generated association data, coordinates indicated by the mesh data obtained by the obtainment unit.

4 . The information processing apparatus according to claim 1 , wherein the derivation unit derives the correction weight by using a sigmoid function.

5 . The information processing apparatus according to claim 1 , further comprising a generation unit configured to generate a background image excluding any moving object from the parallax image, the parallax image being temporally sequential images,

wherein the association unit generates the association data based on the background image generated by the generation unit.

6 . The information processing apparatus according to claim 1 , wherein the obtainment unit obtains a predetermined one frame in accordance with the parallax image being temporally sequential images, and

wherein the association unit generates the association data based on the predetermined one frame obtained by the obtainment unit.

7 . The information processing apparatus according to claim 1 , further comprising a setting unit configured to set a correction amount to each pixel constituting the parallax image,

wherein the setting unit sets the correction amount so that the correction weight decreases as the absolute value of the elevation angle of an image capturing apparatus that captures the parallax image increases and the correction weight increases as the absolute value of the azimuth angle of the image capturing apparatus increases, the elevation and azimuth angles being recorded in each pixel of the parallax image.

8 . The information processing apparatus according to claim 1 , wherein the association unit:

(1) performs matching processing on all pixels of the pair of images constituting the parallax image and generates the association data based on a result of the matching processing, or

(2) performs feature point detection processing on the pair of images constituting the parallax image and generates the association data based on a result of the feature point detection processing.

9 . The information processing apparatus according to claim 1 , wherein the association unit generates the association data linking regions constituted by a plurality of corresponding pixels in the pair of images, and

wherein the correction unit corrects vertical misalignment between corresponding regions in the pair of images based on the generated association data.

10 . The information processing apparatus according to claim 1 , wherein the parallax image is obtained by applying equirectangular projection processing to images acquired by capturing with an image capturing apparatus including two fisheye lenses.

11 . The information processing apparatus according to claim 1 , wherein the pair of images are made of a left-eye image and a right-eye image paired with the left-eye image and having parallax relative to the left-eye image.

12 . An information processing apparatus comprising:

an obtainment unit configured to obtain a pair of images constituting a parallax image for achieving stereoscopic vision;

an association unit configured to generate association data linking corresponding pixels in the pair of images constituting the parallax image obtained by the obtainment unit;

a correction unit configured to correct vertical misalignment between corresponding pixels in the pair of images based on the generated association data; and

a derivation unit configured to derive a correction weight of each pixel constituting the parallax image,

wherein the derivation unit derives the correction weight in accordance with an angle of a light ray relative to an optical axis direction of an image capturing apparatus that captures the parallax image, the angle being recorded in each pixel of the parallax image, and

wherein the derivation unit derives the correction weight that increases as the absolute value of the azimuth angle of the light ray increases, the azimuth angle being recorded in each pixel of the parallax image.

13 . The information processing apparatus according to claim 12 , wherein the derivation unit derives the correction weight by using a sigmoid function.

14 . An information processing method comprising:

obtaining a pair of images constituting a parallax image for achieving stereoscopic vision;

generating association data linking corresponding pixels in the obtained pair of images constituting the parallax image;

correcting vertical misalignment between corresponding pixels in the pair of images based on the generated association data; and

deriving a correction weight of each pixel constituting the parallax image,

wherein the correction weight is derived in accordance with an angle of a light ray relative to an optical axis direction of an image capturing apparatus that captures the parallax image, the angle being recorded in each pixel of the parallax image, and

wherein the correction weight is derived that decreases as the absolute value of the elevation angle of the light ray increases, the elevation angle being recorded in each pixel of the parallax image.

15 . A non-transitory computer-readable storage medium storing a program for causing a computer to perform an information processing method, the method comprising:

obtaining a pair of images constituting a parallax image for achieving stereoscopic vision;

generating association data linking corresponding pixels in the obtained pair of images constituting the parallax image;

correcting vertical misalignment between corresponding pixels in the pair of images based on the generated association data; and

deriving a correction weight of each pixel constituting the parallax image,

wherein the correction weight is derived in accordance with an angle of a light ray relative to an optical axis direction of an image capturing apparatus that captures the parallax image, the angle being recorded in each pixel of the parallax image, and

wherein the correction weight is derived that decreases as the absolute value of the elevation angle of the light ray increases, the elevation angle being recorded in each pixel of the parallax image.