Image processing apparatus, control method of image processing apparatus, and non-transitory computer-readable storage medium

1. An image processing apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

obtain images based on capturing by a plurality of image capturing apparatuses;

obtain information representing a predetermined position to which the plurality of image capturing apparatuses are directed;

set, based on the obtained information, a region for generating three-dimensional shape data representing a three-dimensional shape of an object, wherein the set region is a part of a region captured by the plurality of image capturing apparatuses, and wherein a size of the set region and a size of each of elements forming a three-dimensional space corresponding to the set region depend on an application purpose of three-dimensional shape data to be generated using some of the elements; and

generate, based on the obtained images, the three-dimensional shape data of the object in the set region,

wherein a size of a set region for a first application purpose is smaller than a size of a set region for a second application purpose and a size of an element forming a three-dimensional space corresponding to the set region for the first application purpose is smaller than a size of an element forming a three-dimensional space corresponding to the set region for the second application purpose.

2. The apparatus according to claim 1 , wherein the set region is a predetermined distance range from the predetermined position.

3. The apparatus according to claim 1 , wherein the set region is a space having a rectangular parallelpiped shape with respect to the predetermined position as a center.

4. The apparatus according to claim 1 , wherein the set region in a case in which a plurality of predetermined positions exist, is set for each predetermined position.

5. The apparatus according to claim 1 , wherein the one or more processors further execute the instructions to obtain application purpose information for specifying application purpose of the three-dimensional shape data.

6. The apparatus according to claim 5 , wherein the application purpose which is not the generation of the image based on a designated virtual viewpoint is motion analysis.

7. The apparatus according to claim 1 , wherein in a case where an application purpose is generation of a virtual viewpoint image based on a designated virtual viewpoint, a size is set smaller than that in a case where the application purpose is not the generation of the virtual viewpoint image.

8. The apparatus according to claim 1 , wherein in accordance with the application purpose, a size of a voxel that forms a three-dimensional space and is used to generate the three-dimensional shape data of the object is changed.

9. The apparatus according to claim 8 , wherein in a case in which an application purpose is generation of a virtual viewpoint image based on a designated virtual viewpoint, the size of the voxel is set to a size smaller than that in a case in which the application purpose is not the generation of the virtual viewpoint image.

10. The apparatus according to claim 1 , wherein three-dimensional shape data of an object outside the set region is generated at a resolution lower than a resolution of the three-dimensional shape data of the object in the set region.

11. The apparatus according to claim 10 , wherein the one or more processors further execute the instructions to generate a virtual viewpoint image based on a designated virtual viewpoint based on the generated three-dimensional shape data,

wherein the virtual viewpoint image is generated based on the generated three-dimensional shape data of the object in the set region.

12. The apparatus according to claim 1 , wherein the one or more processors further execute the instructions to generate a virtual viewpoint image based on a designated virtual viewpoint and based on the generated three-dimensional shape data.

13. The apparatus according to claim 1 , wherein the first application purpose is generation of a virtual viewpoint image based on a designated virtual viewpoint and the second application purpose is not the generation of the virtual viewpoint image.

14. A method of controlling an image processing apparatus, comprising:

obtaining images based on capturing by a plurality of image capturing apparatuses;

obtaining information representing a predetermined position to which the plurality of image capturing apparatuses are directed;

setting, based on the obtained information, a region for generating three-dimensional shape data representing a three-dimensional shape of an object, wherein the set region is a part of a region captured by the plurality of image capturing apparatuses, and wherein a size of the set region and a size of each of elements forming a three-dimensional space corresponding to the set region depend on an application purpose of three-dimensional shape data to be generated using some of the elements; and

generating, based on the obtained images, three-dimensional shape data of the object in the set region,

wherein a size of a set region for a first application purpose is smaller than a size of a set region for a second application purpose and a size of an element forming a three-dimensional space corresponding to the set region for the first application purpose is smaller than a size of an element forming a three-dimensional space corresponding to the set region for the second application purpose.

15. A non-transitory computer-readable storage medium storing a computer program for causing a computer to execute each step of a method of controlling an image processing apparatus, the method comprising:

obtaining images based on capturing by a plurality of image capturing apparatuses;

obtaining information representing a predetermined position to which the plurality of image capturing apparatuses are directed;

setting, based on the obtained information, a region for generating three-dimensional shape data representing a three-dimensional shape of an object, wherein the set region is a part of a region captured by the plurality of image capturing apparatuses, and wherein a size of the set region and a size of each of elements forming a three-dimensional space corresponding to the set region depend on an application purpose of three-dimensional shape data to be generated using some of the elements; and

generating, based on the obtained images, three-dimensional shape data of the object in the set region,

wherein a size of a set region for a first application purpose is smaller than a size of a set region for a second application purpose and a size of an element forming a three-dimensional space corresponding to the set region for the first application purpose is smaller than a size of an element forming a three-dimensional space corresponding to the set region for the second application purpose.

16. An image processing apparatus comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

obtain images based on capturing by a plurality of image capturing apparatuses; and

generate, based on the obtained images, three-dimensional shape data of an object in a set region a size of a set region for a first application purpose being smaller than a size of a set region for a second application purpose and a size of an element forming a three-dimensional space corresponding to the set region for the first application purpose being smaller than a size of an element forming a three-dimensional space corresponding to the set region for the second application purpose.

17. The apparatus according to claim 16 , wherein the one or more processors further execute the instructions to obtain application purpose information for specifying application purpose of the three-dimensional shape data.

18. The apparatus according to claim 16 , wherein the first application purpose is generation of a virtual viewpoint image based on a designated virtual viewpoint and the second application purpose is not the generation of the virtual viewpoint image.

19. The apparatus according to claim 18 , wherein the application purpose which is not the generation of the image based on a designated virtual viewpoint is motion analysis.

20. The apparatus according to claim 16 , wherein the element is a voxel.

21. The apparatus according to claim 16 , wherein three-dimensional shape data of an object outside the set region is generated at a resolution lower than a resolution of the three-dimensional shape data of the object in the set region.

22. The apparatus according to claim 16 , wherein the one or more processors further execute the instructions to generate a virtual viewpoint image based on a designated virtual viewpoint based on the generated three-dimensional shape data.

23. A method of controlling an image processing apparatus, comprising:

obtaining images based on capturing by a plurality of image capturing apparatuses; and generating, based on the obtained images, three-dimensional shape data of an object in a set region, a size of a set region for a first application purpose being smaller than a size of a set region for a second application purpose and a size of an element forming a three-dimensional space corresponding to the set region for the first application purpose being smaller than a size of an element forming a three-dimensional space corresponding to the set region for the second application purpose.

24. A non-transitory computer-readable storage medium storing a computer program for causing a computer to execute each step of a method of controlling an image processing apparatus, the method comprising:

obtaining images based on capturing by a plurality of image capturing apparatuses; and

generating, based on the obtained images, three-dimensional shape data of an object in a set region, a size of a set region for a first application purpose being smaller than a size of a set region for a second application purpose and a size of an element forming a three-dimensional space corresponding to the set region for the first application purpose being smaller than a size of an element forming a three-dimensional space corresponding to the set region for the second application purpose.