Information processing apparatus, information processing method, and storage medium

1. An information processing apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

obtain first viewpoint information for specifying a virtual viewpoint corresponding to a virtual viewpoint image and second viewpoint information representing a viewpoint of a first image capturing apparatus existing in an image capturing range of a second image capturing apparatus that is used for generating the virtual viewpoint image;

output the virtual viewpoint image or an image captured by the first image capturing apparatus; and

perform control so that the image captured by the first image capturing apparatus is output in a case where a position of the first image capturing apparatus specified by the second viewpoint information is included in a field of view of the virtual viewpoint specified by the first viewpoint information.

2. The information processing apparatus according to claim 1 , wherein

the one or more processors further execute the instructions to:

calculate a value to determine similarity of a viewpoint based on the first viewpoint information and the second viewpoint information and

in a case where the virtual viewpoint and the viewpoint of the first image capturing apparatus are determined to be similar based on the value, control is performed so that the image captured by the first image capturing apparatus is output.

3. The information processing apparatus according to claim 1 , wherein

the one or more processors further execute the instructions to:

obtain the virtual viewpoint image corresponding to the virtual viewpoint and the image captured by the first image capturing apparatus; and

calculate a degree of image similarity between the virtual viewpoint image and the image captured by the first image capturing apparatus and

in a case where the degree of image similarity is higher than a threshold value, the control is performed so that the image captured by the first image capturing apparatus is output.

4. The information processing apparatus according to claim 2 , wherein

a first position and a first direction are obtained as the first viewpoint information and a second position and a second direction are obtained as the second viewpoint information, the first position being a position of the virtual viewpoint, the first direction being a view direction from the virtual viewpoint, the second position being a position of the first image capturing apparatus, the second direction being a direction of an orientation of the first image capturing apparatus and

in the calculating, a distance from the first position to the second position and an angle representing a difference between the first direction and the second direction are calculated.

5. The information processing apparatus according to claim 2 , wherein

the information processing apparatus is configured so as to capable of switching the image that is output to one of the image captured by the first image capturing apparatus and the virtual viewpoint image by instructions of a user and

control is performed so that the output in accordance with the value to determine similarity is performed.

6. The information processing apparatus according to claim 2 , wherein

in a case where a plurality of the first image capturing apparatuses exists, it is determined whether each viewpoint of the plurality of the first image capturing apparatuses and the virtual viewpoint are similar.

7. The information processing apparatus according to claim 6 , wherein

in a case where the viewpoint of the plurality of the first image capturing apparatuses similar to the virtual viewpoint exists, control is performed so that an image captured by one of the plurality of the first image capturing apparatuses is output.

8. The information processing apparatus according to claim 2 , wherein

the information processing apparatus is configured so as to be capable of receiving instructions from a user to select one of the image captured by the first image capturing apparatus and the virtual viewpoint image as the image that is output and

in a case where it is determined that the virtual viewpoint and the viewpoint of the first image capturing apparatus are similar and the virtual viewpoint image is being output, the output image is switched to the image captured by the first image capturing apparatus; and

in a case where it is determined that the virtual viewpoint and the viewpoint of the first image capturing apparatus are similar, on a condition that the user gives instructions to switch the output image from the image captured by the first image capturing apparatus to the virtual viewpoint image, control is performed so that the image captured by the first image capturing apparatus is output irrespective of the instructions.

9. The information processing apparatus according to claim 2 , wherein

in a case where a predetermined condition is satisfied, control not based on the value to determine similarity is performed.

10. The information processing apparatus according to claim 9 , wherein

in the image capturing range, an object is included and

a case where the predetermined condition is satisfied is a case where a relative speed of the object to the virtual viewpoint is higher than a predetermined value.

11. The information processing apparatus according to claim 9 , wherein

in the image capturing range, an object is included and

a case where the predetermined condition is satisfied is a case where a ratio at which the object occupies the virtual viewpoint image is smaller than a predetermined value.

12. The information processing apparatus according to claim 1 , wherein

based on instructions of a user, the virtual viewpoint image or the image captured by the first image capturing apparatus is output and

in a case where the position of the first image capturing apparatus which is specified by the second viewpoint information is included in a field of view of the virtual viewpoint specified by the first viewpoint information, control is performed so that a predetermined notification is given to the user.

13. The information processing apparatus according to claim 12 , wherein

the predetermined notification is a notification including information representing that the position of the first image capturing apparatus which is specified by the second viewpoint information is included in a field of view of the virtual viewpoint specified by the first viewpoint information.

14. The information processing apparatus according to claim 1 , wherein

in a case where an image representing the first image capturing apparatus is included in the virtual viewpoint image, control is performed so that the image captured by the first image capturing apparatus is output.

15. An information processing method comprising:

obtaining first viewpoint information for specifying a virtual viewpoint corresponding to a virtual viewpoint image and second viewpoint information representing a viewpoint of a first image capturing apparatus existing in an image capturing range of a second image capturing apparatus that is used for generating the virtual viewpoint image;

outputting the virtual viewpoint image or an image captured by the first image capturing apparatus; and

performing control so that the image captured by the first image capturing apparatus is output in a case where a position of the first image capturing apparatus specified by the second viewpoint information is included in a field of view of the virtual viewpoint specified by the first viewpoint information.

16. A non-transitory computer readable storage medium storing a program which causes a computer to perform an information processing method comprising:

obtaining first viewpoint information for specifying a virtual viewpoint corresponding to a virtual viewpoint image and second viewpoint information representing a viewpoint of a first image capturing apparatus existing in an image capturing range of a second image capturing apparatus that is used for generating the virtual viewpoint image;

outputting the virtual viewpoint image or an image captured by the first image capturing apparatus; and

performing control so that the image captured by the first image capturing apparatus is output in a case where a position of the first image capturing apparatus specified by the second viewpoint information is included in a field of view of the virtual viewpoint specified by the first viewpoint information.