Image processing apparatus, method, and storage medium

1. An image processing apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

cause a display device to display a display image based on a captured image of at least one image capturing apparatus of a plurality of image capturing apparatuses;

specify a first area on a three-dimensional shape model which is generated based on a plurality of captured images obtained by the plurality of image capturing apparatuses and which corresponds to a designated area on the display image,

specify, based on the first area on the three-dimensional shape model, a second area within a captured image or captured images of one or more other image capturing apparatuses different from the at least one image capturing apparatus of the plurality of image capturing apparatuses; and

specify a third area on the three-dimensional shape model based on the second area and based on an image feature of the captured image or the captured images of the one or more other image capturing apparatuses.

2. The image processing apparatus according to claim 1 , wherein

the display image is a captured image of the at least one image capturing apparatus.

3. The image processing apparatus according to claim 1 , wherein

the display image is an image that is obtained by performing predetermined image processing for a captured image of the at least one image capturing apparatus.

4. The image processing apparatus according to claim 1 , wherein

the display image is a virtual viewpoint image that is generated from captured images by two or more image capturing apparatuses of the plurality of image capturing apparatuses.

5. The image processing apparatus according to claim 1 , wherein

the one or more processors further executes the instructions to select the at least one image capturing apparatus from the plurality of image capturing apparatuses, and

the display image is image based on a captured image of the at least one image capturing apparatus selected from the plurality of image capturing apparatuses.

6. The image processing apparatus according to claim 5 , wherein

the at least one image capturing apparatus is selected from the plurality of image capturing apparatuses by using information on a line-of- sight direction designated by a user.

7. The image processing apparatus according to claim 1 , wherein

the one or more processors further executes the instructions to:

select one or a plurality of image capturing apparatus from the plurality of image capturing apparatuses, whose difference between a capturing direction and a line-of-sight direction is less than a threshold value;

cause a display device to display a captured image or captured images of the selected one or plurality of image capturing apparatuses; and

select a image capturing apparatus corresponding to a captured image designated by a user from one or a plurality of captured images displayed on the display device as the at least one image capturing apparatus.

8. The image processing apparatus according to claim 1 , wherein the

third area on a three-dimensional shape model

is specified based on the second area which is adjusted based on the image feature of the captured image or the captured images of the one or more other image capturing apparatuses.

9. The image processing apparatus according to claim 8 , wherein

the second area is specified by using association information for associating coordinates of the three-dimensional shape model with coordinates of the captured image.

10. The image processing apparatus according to claim 8 , wherein

the second area is adjusted, in a case where image data of a neighboring area that neighbors the second area is similar to image data of the second area, so that the neighboring area is included in the second area.

11. The image processing apparatus according to claim 8 , wherein

the second area is adjusted, in a case where a difference between a pixel value of a neighboring area that neighbors the second area and a pixel value of the second area is less than a threshold value, so that the neighboring area is included in the second area.

12. The image processing apparatus according to claim 8 , wherein

the one or more processors further executes the instructions to:

specify one or a plurality of points not corresponding to a point group within a captured image of the other image capturing apparatus of point groups making up an area on the three-dimensional shape model;

add the specified one or plurality of points to within a captured image of the other image capturing apparatus;

further adjust the second area based on an image feature of a captured image to which the one or plurality of points is added; and

specify an area on the three-dimensional shape model based on the further adjusted second area.

13. A method for controlling an image processing apparatus, the method comprising the steps of:

causing a display device to display a display image based on a captured image of at least one image capturing apparatus selected from a plurality of image capturing apparatuses;

and

specifying a first area on a three-dimensional shape model which is generated based on a plurality of captured images obtained by the plurality of image capturing apparatuses and which corresponds to a designated area on the display image;

specifying, based on the first area on the three-dimensional shape model, a second area within a captured image or captured images of one or more other image capturing apparatuses different from the at least one image capturing apparatus of the plurality of image capturing apparatuses; and specifying a third area on the three-dimensional shape model based on the second

area and based on an image feature of the captured image or the captured images of the one or more other image capturing apparatuses.

14. A non-transitory computer readable storage medium storing a program for causing a computer to perform a method for controlling an image processing apparatus, the method comprising the steps of:

causing a display device to display a display image based on a captured image of at least one image capturing apparatus selected from a plurality of image capturing apparatuses;

and

specifying a first area on a three-dimensional shape model which is generated based on a plurality of captured images obtained by the plurality of image capturing apparatuses and which corresponds to a designated area on the display image;

specifying, based on the first area on the three-dimensional shape model, a second area within a captured image or based on captured images of two or more one or more other image capturing apparatuses cameras different from the at least one image capturing apparatus of the plurality of image capturing apparatuses; and

specifying a third area on the three-dimensional shape model based on the second area and based on an image feature of the captured image or the captured images of the one or more other image capturing apparatuses.