Information processing apparatus, information processing method, and storage medium

1. An information processing apparatus comprising:

one or more processors;

wherein the one or more processors function as the following units:

a generation unit configured to generate scene information including type information and time information, the type information indicating a type of a specific event occurring in an image-capturing region in which an image is captured by a plurality of cameras and occurring in a part of the capturing period by the plurality of cameras, the time information indicating a time when the specific event has occurred in the part of the capturing period; and

a provision unit configured to provide an output destination of material data with the scene information generated by the generation unit, the material data being generated from a plurality of captured images obtained by the plurality of cameras capturing images of the image-capturing region from different directions, the material data being used to generate a virtual viewpoint image depending on a position of a virtual viewpoint and a view direction from the virtual viewpoint.

2. The information processing apparatus according to claim 1 , wherein

the generation unit further generates the material data, and

the provision unit further provides the material data.

3. The information processing apparatus according to claim 1 , wherein

the generation unit further generates recommended viewpoint information about the position and the orientation of the virtual viewpoint for viewing the event depending on an occurrence position of the event, and

the provision unit further provides the recommended viewpoint information.

4. The information processing apparatus according to claim 1 , further comprising a detection unit configured to detect an occurrence of a specific event in the image-capturing region by using at least one of audio data and one or more of the plurality of captured images.

5. The information processing apparatus according to claim 1 , wherein the material data includes three-dimensional geometric data on an object detected from the captured images, texture data on the object, three-dimensional geometric data on a background, and texture data on the background.

6. The information processing apparatus according to claim 1 , wherein

the generation unit further generates speed information indicating a recommended moving speed of the virtual viewpoint, and

the provision unit further provides the speed information.

7. The information processing apparatus according to claim 6 , wherein the generation unit determines the recommended moving speed based on at least one of a moving speed of an object in the image-capturing region, a size of the image-capturing region, and a shape of the image-capturing region.

8. The information processing apparatus according to claim 1 , wherein

the generation unit further generates range information indicating a movable range of the virtual viewpoint, and

the provision unit further provides the range information.

9. An information processing apparatus comprising:

an obtainment unit configured to obtain:

scene information including type information and time information, the type information indicating a type of a specific event occurring in an image-capturing region in which an image is captured by a plurality of cameras and occurring in a part of the capturing period by the plurality of cameras, the time information indicating a time when the specific event has occurred in the part of the capturing period; and

material data generated from a plurality of captured images obtained by the plurality of cameras capturing images of the image-capturing region from different directions; and

a generation unit configured to generate, based on the obtained scene information and the obtained material data, a virtual viewpoint image about the specific event represented by the scene information.

10. The information processing apparatus according to claim 9 , wherein

the obtainment unit further obtains recommended viewpoint information about a position of a virtual viewpoint and a view direction from the virtual viewpoint for viewing the specific event represented by the scene information, and

the generation unit generates, based on the obtained recommended viewpoint information, the obtained scene information, and the obtained material data, a virtual viewpoint image representing an appearance of the specific event from a virtual viewpoint depending on the recommended viewpoint information.

11. The information processing apparatus according to claim 10 , further comprising a display control unit configured to cause a first virtual viewpoint image depending on the position of the virtual viewpoint and the view direction from the virtual viewpoint and a second virtual viewpoint image depending on the recommended viewpoint information to be displayed on a setting screen for setting the position and the orientation of the virtual viewpoint.

12. The information processing apparatus according to claim 11 , wherein a space size of the second virtual viewpoint image is smaller than a space size of the first virtual viewpoint image.

13. The information processing apparatus according to claim 10 , further comprising a display control unit configured to cause a timeline to be displayed on a setting screen for setting the position of the virtual viewpoint and the view direction from the virtual viewpoint, wherein

the timeline represents a period of the specific event, and

the display control unit causes a virtual viewpoint image depending on the recommended viewpoint information to be displayed with the timeline.

14. An information processing method, the information processing method comprising:

generating scene information including type information and time information, the type information indicating a type of a specific event occurring in an image-capturing region in which an image is captured by a plurality of cameras and occurring in a part of the capturing period by the plurality of cameras, the time information indicating a time when the specific event has occurred in the part of the capturing period; and

providing a device of an output destination of material data with the scene information generated in the generating, the material data being generated from a plurality of captured images obtained by the plurality of cameras capturing images of the image-capturing region from different directions, the material data being used to generate a virtual viewpoint image depending on a position of a virtual viewpoint and a view direction from the virtual viewpoint.

15. An information processing method, the information processing method comprising:

obtaining scene information including type information and time information, the type information indicating a type of a specific event occurring in an image-capturing region in which an image is captured by a plurality of cameras and occurring in a part of the capturing period by the plurality of cameras, the time information indicating a time when the specific event has occurred in the part of the capturing period; and

material data generated from a plurality of captured images obtained by the plurality of cameras capturing images of the image-capturing region from different directions; and

generating, based on the obtained scene information and the obtained material data, a virtual viewpoint image about the specific event represented by the scene information.

16. A non-transitory computer-readable storage medium storing a program for causing a computer execute an information processing, the method comprising:

generating scene information including type information and time information, the type information indicating a type of a specific event occurring in an image-capturing region in which an image is captured by a plurality of cameras and occurring in a part of the capturing period by the plurality of cameras, the time information indicating a time when the specific event has occurred in the part of the capturing period; and

providing a device of an output destination of material data with the scene information generated in the generating, the material data being generated from a plurality of captured images obtained by the plurality of cameras capturing images of the image-capturing region from different directions, the material data being used to generate a virtual viewpoint image depending on a position of a virtual viewpoint and a view direction from the virtual viewpoint.

17. A non-transitory computer-readable storage medium storing a program for causing a computer that execute an information processing, the method comprising:

obtaining scene information including type information and time information, the type information indicating a type of a specific event occurring in an image-capturing region in which an image is captured by a plurality of cameras and occurring in a part of the capturing period by the plurality of cameras, the time information indicating a time when the specific event has occurred in the part of the capturing period; and

material data generated from a plurality of captured images obtained by the plurality of cameras capturing images of the image-capturing region from different directions; and

generating, based on the obtained scene information and the obtained material data, a virtual viewpoint image about the specific event represented by the scene information.