Information processing apparatus, information processing method, and program
An information processing apparatus generates a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices. The information processing apparatus displays, on a display, a standard image corresponding to the imaging region, a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint, an indicator indicating a reproduction position of the virtual viewpoint video, and a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video.
1. An information processing apparatus that generates a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices, the information processing apparatus comprising:
a processor; and
a memory built in or connected to the processor,
wherein the processor displays, on a display,
a standard image corresponding to the imaging region,
a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint,
an indicator indicating a reproduction position of the virtual viewpoint video, and
a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video,
wherein the processor generates gaze point information representing a gaze point at which the virtual viewpoint included in the virtual viewpoint path gazes in response to a given instruction,
wherein the processor
selects one reference image from among a plurality of the reference images corresponding to the same reproduction position in response to a given instruction,
sets the gaze point corresponding to the one selected reference image as a standard gaze point, and
generates, as other reference images that are not selected, an image based on a virtual viewpoint image showing an aspect of a case of gazing at the standard gaze point from the virtual viewpoint path corresponding to the non-selected other reference images.
2. The information processing apparatus according to claim 1 ,
wherein the processor disposes at least one of the plurality of virtual viewpoint paths at an indicated position in the standard image.
3. The information processing apparatus according to claim 1 ,
wherein the processor changes the reproduction position indicated by the indicator in response to a given instruction.
4. The information processing apparatus according to claim 1 ,
wherein, in a case where the reproduction position is changed, the processor displays the reference image corresponding to the reproduction position after being changed on the display.
5. The information processing apparatus according to claim 4 ,
wherein, in a case where the reproduction position is changed, the processor displays the reference image corresponding to the reproduction position after being changed at a position different from a position of the reference image corresponding to the reproduction position before being changed.
6. The information processing apparatus according to claim 1 ,
wherein the processor displays only one reference image for one virtual viewpoint path.
7. The information processing apparatus according to claim 1 ,
wherein the processor changes the reproduction position in response to an operation of moving the reference image on the standard image.
8. The information processing apparatus according to claim 1 ,
wherein the processor displays two reference images for two adjacent virtual viewpoint paths according to relative positions of the two virtual viewpoint paths.
9. The information processing apparatus according to claim 1 ,
wherein the processor changes at least one of a position, a length, or a shape of the virtual viewpoint path in response to a given instruction.
10. The information processing apparatus according to claim 1 ,
wherein the processor displays at least one of the indicator or the virtual viewpoint path in different aspects before and after the reproduction position.
11. The information processing apparatus according to claim 1 ,
wherein the gaze point information is a gaze point path representing a trajectory of movement of the gaze point, and
the processor disposes a plurality of the gaze point paths in the standard image in response to a given instruction.
12. The information processing apparatus according to claim 1 ,
wherein the processor changes a display aspect of a section including the virtual viewpoint in which a virtual viewpoint image obtained by gazing at the standard gaze point is not generatable in the virtual viewpoint path.
13. The information processing apparatus according to claim 1 ,
wherein the processor displays the plurality of virtual viewpoint paths and the reference image in the single standard image.
14. The information processing apparatus according to claim 1 ,
wherein the processor displays the virtual viewpoint path and the reference image in a plurality of the standard images representing at least a part of the imaging region.
15. The information processing apparatus according to claim 1 ,
wherein the processor displays the reference image corresponding to the virtual viewpoint along the virtual viewpoint path for the plurality of virtual viewpoint paths.
16. The information processing apparatus according to claim 1 ,
wherein the processor
performs a selection combining process of cutting out parts of the plurality of virtual viewpoint paths and combining the cut-out parts in response to a given instruction, and
generates the virtual viewpoint video on the basis of a path obtained by combining the cut-out parts in the selection combining process.
17. An information processing method of generating a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices, the information processing method comprising:
displaying, on a display,
a standard image corresponding to the imaging region,
a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint,
an indicator indicating a reproduction position of the virtual viewpoint video, and
a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video;
generating gaze point information representing a gaze point at which the virtual viewpoint included in the virtual viewpoint path gazes in response to a given instruction;
selecting one reference image from among a plurality of the reference images corresponding to the same reproduction position in response to a given instruction;
setting the gaze point corresponding to the one selected reference image as a standard gaze point; and
generating, as other reference images that are not selected, an image based on a virtual viewpoint image showing an aspect of a case of gazing at the standard gaze point from the virtual viewpoint path corresponding to the non-selected other reference images.
18. A non-transitory computer-readable storage medium storing a program executable by a computer to perform information processing to generate a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices, the information processing comprising:
displaying, on a display,
a standard image showing the imaging region,
a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint,
an indicator indicating a reproduction position of the virtual viewpoint video, and
a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video;
generating gaze point information representing a gaze point at which the virtual viewpoint included in the virtual viewpoint path gazes in response to a given instruction;
selecting one reference image from among a plurality of the reference images corresponding to the same reproduction position in response to a given instruction;
setting the gaze point corresponding to the one selected reference image as a standard gaze point; and
generating, as other reference images that are not selected, an image based on a virtual viewpoint image showing an aspect of a case of gazing at the standard gaze point from the virtual viewpoint path corresponding to the non-selected other reference images.