Image capturing system, arrangement determination apparatus, arrangement determination method, and storage medium

1. A determination apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

acquire image capturing device information for specifying positions and orientations of a plurality of image capturing devices capturing a specific position in an image capturing space from different directions;

acquire positional information on the specific position;

acquire number information on a number of image capturing devices caused to have a different parameters among the plurality of image capturing devices;

specify, for each image capturing device of the plurality of image capturing devices, a symmetry degree of an own image capturing device and another image capturing device; and

determine, based on the acquired image capturing device information, the acquired positional information, the acquired number information, and the specified symmetry degree for each image capturing device, parameters specifying characteristics of the plurality of image capturing devices, a parameter affecting resolution of an object in an image captured by a first image capturing device being different from a parameter affecting a resolution of an object in an image captured by a second image capturing device, and the second image capturing device being installed at a position of two-fold symmetry of a position of the second image capturing device with respect to an axis passing the specific position and vertical to an image capturing field or a position closest to the position of two-fold symmetry of the position of the first image capturing device.

2. The image capturing system according to claim 1 , wherein the parameter affecting a resolution of an object in an image is a viewing angle.

3. The image capturing system according to claim 1 , wherein the parameter affecting a resolution of an object in an image is a focal length.

4. The image capturing system according to claim 1 , wherein the parameter affecting a resolution of an object in an image is a size of an imaging sensor.

5. The image capturing system according to claim 1 , wherein the parameter affecting a resolution of an object in an image is a kind of imaging sensor.

6. The image capturing system according to claim 1 , wherein the parameter affecting a resolution of an object in an image is a kind of lens.

7. The determination apparatus according to claim 1 , wherein

the determination is performed based on a two-dimensional direction vector or three-dimensional direction vector representing a line-of-sight direction of each image capturing device.

8. The determination apparatus according to claim 1 , wherein

the symmetry degree takes a maximum value in a case where the own image capturing device and the other image capturing device are in a positional relationship of two-fold symmetry with respect to an axis passing the specific position and vertical to an image capturing field.

9. A determination apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

acquire image capturing device information for specifying positions and orientations of a plurality of image capturing devices capturing a specific position in an image capturing space from different directions;

acquire positional information on the specific position;

acquire information on a number of image capturing devices caused to have a different parameters among the plurality of image capturing devices;

specify, for each image capturing device of the plurality of image capturing devices, a symmetry degree of an own image capturing device and another image capturing device;

specify, for each image capturing device of the plurality of image capturing devices, a proximity degree of a base line extending from an own image capturing device and passing the specific position and a base line extending from the another image capturing device facing the own image capturing device with the specific position being sandwiched in between; and

determine, based on the acquired image capturing device information, the acquired positional information, the acquired number information, the specified symmetry degree for each image capturing device, and the specified proximity degree for each image capturing device, parameters specifying characteristics of the plurality of image capturing devices, a parameter affecting a resolution of an object in an image captured by a first image capturing device being different from a parameter affecting a resolution of an object in an image captured by a second image capturing device, and the second image capturing device being installed at a position of two-fold symmetry of a position of the second image capturing device with respect to an axis passing the specific position and vertical to an image capturing field or a position closest to the position of two-fold symmetry of the position of the first image capturing device.

10. The determination apparatus according to claim 9 , wherein

the narrower an interval between a base line of an own image capturing device, the base line being taken as a reference, and a base line of another adjacent image capturing device, the higher the proximity degree is.

11. The determination apparatus according to claim 9 , wherein

a reference image capturing device is determined among the plurality of image capturing devices based on the symmetry degree;

at least two image capturing devices existing in close proximity to a position a predetermined reference angle distant from a position of the determined reference image capturing device is detected; and

an image capturing device whose parameter is made different is determined based on the proximity degree from at least two detected image capturing devices.

12. The determination apparatus according to claim 11 , wherein

in order all image capturing devices that can be the reference image capturing device are determined among the plurality of image capturing devices as the reference image capturing device; and

a configuration is determined so that arrangement of image capturing devices whose parameters are made different is the most even within a range in which virtual viewpoint setting is possible.

13. The determination apparatus according to claim 1 , wherein the one or more processors further execute the instructions to change a parameter of an image capturing device determined to be an image capturing device whose parameter is made different.

14. A determination method of an image capturing device in an image capturing system for generating a virtual viewpoint image, wherein

the image capturing system comprises a plurality of image capturing devices capturing a specific position from different directions, the plurality of image capturing devices including at least one pair of image capturing devices including:

a first image capturing device; and

a second capturing device installed at a position of two-fold symmetry of a position of the first image capturing device with respect to an axis passing the specific position and vertical to an image capturing field, or a position closest to the position of two-fold symmetry of the position of the first image capturing device, and

the determination method comprises:

acquiring image capturing device information indicating positions and orientations of the plurality of image capturing devices;

acquiring number information on a number of image capturing devices caused to have a different parameters among the plurality of image capturing devices;

specifying, for each image capturing device of the plurality of image capturing devices, a symmetry degree of an own image capturing device and another image capturing device;

determining the first image capturing device and a second image capturing device among the plurality of image capturing devices; and

setting, based on the acquired image capturing device information, the acquired positional information, the acquired number information and the specified symmetry degree for each image capturing device, parameters to the first image capturing device and the second image capturing device, a parameter affecting a resolution of an object in a captured image by the first image capturing device being different from a parameter affecting a resolution of an object in a captured image by the second image capturing device.

15. A non-transitory computer readable storage medium storing a program for causing a computer to perform a determination method of an image capturing device in an image capturing system for generating a virtual viewpoint image, wherein

the image capturing system comprises a plurality of image capturing devices capturing a specific position from different directions, the plurality of image capturing devices including at least one pair of image capturing devices including:

a first image capturing device; and

a second capturing device installed at a position of two-fold symmetry of a position of the first image capturing device with respect to an axis passing the specific position and vertical to an image capturing field, or a position closest to the position of two-fold symmetry of the position of the first image capturing device, and

the arrangement determination method comprises:

acquiring image capturing device information indicating positions and orientations of the plurality of image capturing devices;

acquiring number information on a number of image capturing devices caused to have a different parameters among the plurality of image capturing devices;

specifying, for each image capturing device of the plurality of image capturing devices, a symmetry degree of an own image capturing device and another image capturing device;

determining the first image capturing device and the second image capturing device among the plurality of image capturing devices; and

setting, based on the acquired image capturing device information, the acquired positional information, the acquired number information and the specified symmetry degree for each image capturing device, parameters to the first image capturing device and the second image capturing device, a parameter affecting a resolution of an object in a captured image by the first image capturing device being different from a parameter affecting a resolution of an object in a captured image by the second image capturing device.

16. A determination apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

acquire image capturing device information for specifying positions and orientations of a plurality of image capturing devices capturing a specific position in an image capturing space from different directions;

acquire positional information on the specific position;

acquire number information on a number of image capturing devices caused to have a different parameters among the plurality of image capturing devices;

specify, for each image capturing device of the plurality of image capturing devices, a symmetry degree of an own image capturing device and another image capturing device; and

determine, based on the acquired image capturing device information, the acquired positional information, the acquired number information and specified symmetry degree for each image capturing device, parameters specifying characteristics of the plurality of image capturing devices, a parameter affecting an image capturing range of a first image capturing device being is different from a parameter affecting an image capturing range of a second image capturing device, and the second image capturing device being installed at a position of two-fold symmetry of a position of the second image capturing device with respect to an axis passing the specific position and vertical to an image capturing field or a position closest to the position of two-fold symmetry of the position of the first image capturing device.

17. A determination apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

acquire image capturing device information for specifying positions and orientations of a plurality of image capturing devices capturing a specific position in an image capturing space from different directions;

acquire positional information on the specific position;

acquire information on a number of image capturing devices caused to have a different parameters among the plurality of image capturing devices;

specify, for each image capturing device of the plurality of image capturing devices, a symmetry degree of an own image capturing device and another image capturing device;

specify, for each image capturing device of the plurality of image capturing devices, a proximity degree of a base line extending from an own image capturing device and passing the specific position and a base line extending from the another image capturing device facing the own image capturing device with the specific position being sandwiched in between; and

determine, based on the acquired image capturing device information, the acquired positional information, the acquired number information, the specified symmetry degree for each image capturing device and the specified proximity degree for each image capturing device, parameters specifying characteristics of the plurality of image capturing devices, a parameter affecting an image capturing range of a first image capturing device being different from a parameter affecting an image capturing range of a second image capturing device, and the second image capturing device being installed at a position of two-fold symmetry of a position of the second image capturing device with respect to an axis passing the specific position and vertical to an image capturing field or a position closest to the position of two-fold symmetry of the position of the first image capturing device.

18. A determination method of an image capturing device in an image capturing system for generating a virtual viewpoint image, wherein

the image capturing system comprises a plurality of image capturing devices capturing a specific position from different directions, the plurality of image capturing devices including at least one pair of image capturing devices including:

a first image capturing device; and

a second capturing device installed at a position of two-fold symmetry of a position of the first image capturing device with respect to an axis passing the specific position and vertical to an image capturing field, or a position closest to the position of two-fold symmetry of the position of the first image capturing device, and

the determination method comprises:

acquiring image capturing device information indicating positions and orientations of the plurality of image capturing devices;

acquire number information on a number of image capturing devices caused to have a different parameters among the plurality of image capturing devices;

specify, for each image capturing device of the plurality of image capturing devices, a symmetry degree of an own image capturing device and another image capturing device;

determining the first image capturing device and a second image capturing device among the plurality of image capturing devices; and

setting, based on the acquired image capturing device information, the acquired positional information, the acquired number information and the specified symmetry degree for each image capturing device, parameters to the first image capturing device and the second image capturing device, a parameter affecting an image capturing range of the first image capturing device being different from a parameter affecting an image capturing range of the second image capturing device.

19. A non-transitory computer readable storage medium storing a program for causing a computer to perform a determination method of an image capturing device in an image capturing system for generating a virtual viewpoint image, wherein

the image capturing system comprises a plurality of image capturing devices capturing a specific position from different directions, the plurality of image capturing devices including at least one pair of image capturing devices including:

a first image capturing device; and

a second capturing device installed at a position of two-fold symmetry of a position of the first image capturing device with respect to an axis passing the specific position and vertical to an image capturing field, or a position closest to the position of two-fold symmetry of the position of the first image capturing device, and

the determination method comprises:

acquiring image capturing device information indicating positions and orientations of the plurality of image capturing devices;

acquire number information on a number of image capturing devices caused to have a different parameters among the plurality of image capturing devices;

specify, for each image capturing device of the plurality of image capturing devices, a symmetry degree of an own image capturing device and another image capturing device;

determining the first image capturing device and a second image capturing device among the plurality of image capturing devices; and

setting, based on the acquired image capturing device information, the acquired positional information, the acquired number information and the specified symmetry degree for each image capturing device, parameters to the first image capturing device and the second image capturing device, a parameter affecting an image capturing range of the first image capturing device being different from a parameter affecting an image capturing range of the second image capturing device.