Information processing apparatus, information processing method, and program
An information processing apparatus generates a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices. The information processing apparatus displays, on a display, a standard image corresponding to the imaging region, a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint, an indicator indicating a reproduction position of the virtual viewpoint video, and a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video.
1 . An information processing apparatus that generates a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices, the information processing apparatus comprising:
a processor; and
a memory built in or connected to the processor,
wherein the processor displays, on a display,
a standard image corresponding to the imaging region,
a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint,
an indicator indicating a reproduction position of the virtual viewpoint video, and
a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video,
wherein the processor generates gaze point information representing a gaze point at which the virtual viewpoint included in the virtual viewpoint path gazes in response to a given instruction,
wherein the processor
selects one reference image from among a plurality of the reference images corresponding to the same reproduction position in response to a given instruction,
sets the gaze point corresponding to the one selected reference image as a standard gaze point, and
generates, as other reference images that are not selected, an image based on a virtual viewpoint image showing an aspect of a case of gazing at the standard gaze point from the virtual viewpoint path corresponding to the non-selected other reference images.
2 . The information processing apparatus according to claim 1 ,
wherein the processor disposes at least one of the plurality of virtual viewpoint paths at an indicated position in the standard image.
3 . The information processing apparatus according to claim 1 ,
wherein the processor changes the reproduction position indicated by the indicator in response to a given instruction.
4 . The information processing apparatus according to claim 1 ,
wherein, in a case where the reproduction position is changed, the processor displays the reference image corresponding to the reproduction position after being changed on the display.
5 . The information processing apparatus according to claim 4 ,
wherein, in a case where the reproduction position is changed, the processor displays the reference image corresponding to the reproduction position after being changed at a position different from a position of the reference image corresponding to the reproduction position before being changed.
6 . The information processing apparatus according to claim 1 ,
wherein the processor displays only one reference image for one virtual viewpoint path.
7 . The information processing apparatus according to claim 1 ,
wherein the processor changes the reproduction position in response to an operation of moving the reference image on the standard image.
8 . The information processing apparatus according to claim 1 ,
wherein the processor displays two reference images for two adjacent virtual viewpoint paths according to relative positions of the two virtual viewpoint paths.
9 . The information processing apparatus according to claim 1 ,
wherein the processor changes at least one of a position, a length, or a shape of the virtual viewpoint path in response to a given instruction.
10 . The information processing apparatus according to claim 1 ,
wherein the processor displays at least one of the indicator or the virtual viewpoint path in different aspects before and after the reproduction position.
11 . The information processing apparatus according to claim 1 ,
wherein the gaze point information is a gaze point path representing a trajectory of movement of the gaze point, and
the processor disposes a plurality of the gaze point paths in the standard image in response to a given instruction.
12 . The information processing apparatus according to claim 1 ,
wherein the processor changes a display aspect of a section including the virtual viewpoint in which a virtual viewpoint image obtained by gazing at the standard gaze point is not generatable in the virtual viewpoint path.
13 . The information processing apparatus according to claim 1 ,
wherein the processor displays the plurality of virtual viewpoint paths and the reference image in the single standard image.
14 . The information processing apparatus according to claim 1 ,
wherein the processor displays the virtual viewpoint path and the reference image in a plurality of the standard images representing at least a part of the imaging region.
15 . The information processing apparatus according to claim 1 ,
wherein the processor displays the reference image corresponding to the virtual viewpoint along the virtual viewpoint path for the plurality of virtual viewpoint paths.
16 . The information processing apparatus according to claim 1 ,
wherein the processor
performs a selection combining process of cutting out parts of the plurality of virtual viewpoint paths and combining the cut-out parts in response to a given instruction, and
generates the virtual viewpoint video on the basis of a path obtained by combining the cut-out parts in the selection combining process.
17 . An information processing method of generating a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices, the information processing method comprising:
displaying, on a display,
a standard image corresponding to the imaging region,
a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint,
an indicator indicating a reproduction position of the virtual viewpoint video, and
a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video;
generating gaze point information representing a gaze point at which the virtual viewpoint included in the virtual viewpoint path gazes in response to a given instruction;
selecting one reference image from among a plurality of the reference images corresponding to the same reproduction position in response to a given instruction;
setting the gaze point corresponding to the one selected reference image as a standard gaze point; and
generating, as other reference images that are not selected, an image based on a virtual viewpoint image showing an aspect of a case of gazing at the standard gaze point from the virtual viewpoint path corresponding to the non-selected other reference images.
18 . A non-transitory computer-readable storage medium storing a program executable by a computer to perform information processing to generate a virtual viewpoint video based on a virtual viewpoint by using a motion picture obtained by imaging an imaging region with a plurality of imaging devices, the information processing comprising:
displaying, on a display,
a standard image showing the imaging region,
a plurality of virtual viewpoint paths disposed in the standard image and representing a trajectory of movement of the virtual viewpoint,
an indicator indicating a reproduction position of the virtual viewpoint video, and
a reference image based on a virtual viewpoint image viewed from the virtual viewpoint corresponding to the reproduction position of the virtual viewpoint path among a plurality of virtual viewpoint images configuring the virtual viewpoint video;
generating gaze point information representing a gaze point at which the virtual viewpoint included in the virtual viewpoint path gazes in response to a given instruction;
selecting one reference image from among a plurality of the reference images corresponding to the same reproduction position in response to a given instruction;
setting the gaze point corresponding to the one selected reference image as a standard gaze point; and
generating, as other reference images that are not selected, an image based on a virtual viewpoint image showing an aspect of a case of gazing at the standard gaze point from the virtual viewpoint path corresponding to the non-selected other reference images.