Information processing device and method
The present disclosure relates to an information processing device and method that enables simultaneous use of a plurality of video components for one object using a scene description. In an extension for the 3D object video defined in a material layer of a scene description file, a component index having a different value for each of video components is set to a video component included in the 3D object video. In addition, the video component is stored in a corresponding buffer on the basis of the component index, the video component is acquired from the buffer on the basis of the component index, and a display image is generated using the acquired video component. The present disclosure can be applied to, for example, an information processing device, an information processing method, or the like.
1 . An information processing device, comprising:
processing circuitry configured to:
store video components included in a 3D object video in a buffer corresponding to the video components on a basis of a component index;
acquire the video components from the buffer on a basis of the component index; and
generate a display image using the acquired video components, wherein
a plurality of the video components is simultaneously usable in one 3D object, and
the component index is set to the video components included in the 3D object video in an extension for the 3D object video defined in a material layer of a scene description and has a different value for each of the video components.
2 . The information processing device according to claim 1 , wherein
the video components each include viewpoint-dependent (VD) texture that is a captured image obtained by capturing the 3D object from a predetermined viewpoint, and
the processing circuitry is configured to
store a plurality of the VD textures having the viewpoints different from each other in the buffer corresponding to each of the VD textures on a basis of the component index,
acquire a VD texture that is desired from the buffer on a basis of the component index, and
map the acquired VD texture on the 3D object.
3 . The information processing device according to claim 2 , wherein the processing circuitry is configured to:
store a camera parameter corresponding to at least one of the VD textures in the buffer corresponding to the VD textures,
acquire the camera parameter corresponding to the VD texture that is desired from the buffer on a basis of the component index, and
map the acquired VD texture on the 3D object using the acquired camera parameter.
4 . The information processing device according to claim 3 , wherein
the processing circuitry is configured to
store each of fields of the camera parameter in the buffer corresponding to the each of the fields on a basis of a field index,
acquire each of the fields of the camera parameter corresponding to the VD texture that is desired from the buffer on a basis of the field index, and
map the acquired VD texture on the 3D object using the acquired camera parameter, and
the field index is set to the fields of the camera parameter in the extension and has a different value for each of the fields.
5 . The information processing device according to claim 1 , wherein
the video components include a packed viewpoint-dependent (VD) texture in which a plurality of VD textures, which are captured images obtained by capturing the 3D object from a predetermined viewpoint, is packed, and
the processing circuitry is configured to
store the packed VD texture in the buffer corresponding to the packed VD texture on a basis of the component index,
acquire the packed VD texture from the buffer on a basis of the component index,
unpack a VD texture that is desired from the acquired packed VD texture, and
map the unpacked VD texture on the 3D object.
6 . The information processing device according to claim 5 , wherein the processing circuitry is configured to:
store a camera parameter and packing metadata corresponding to the packed VD texture in the buffer corresponding to the packed VD texture,
acquire the camera parameter and the packing metadata corresponding to the packed VD texture from the buffer on a basis of the component index,
unpack the VD texture that is desired from the packed VD texture on a basis of the acquired packing metadata, and
map the unpacked VD texture on the 3D object using the acquired camera parameter.
7 . The information processing device according to claim 6 , wherein the processing circuitry is configured to:
store the camera parameter and the packing metadata of each of the VD textures packed in the packed VD texture in the buffer corresponding to the each of the VD textures on a basis of a VD texture index,
acquire the camera parameter and the packing metadata corresponding to the VD texture that is desired from the buffer on a basis of the VD texture index,
unpack the VD texture that is desired from the packed VD texture on a basis of the acquired packing metadata, and
map the unpacked VD texture on the 3D object using the acquired camera parameter, and
the VD texture index is set to the camera parameter and the packing metadata for each of the VD textures in the extension and has a different value for each of the corresponding VD textures.
8 . The information processing device according to claim 6 , wherein the processing circuitry is configured to:
store each of fields of the camera parameter and the packing metadata in the buffer corresponding to the each of the fields on a basis of a field index,
acquire each of fields of the camera parameter and the packing metadata corresponding to the VD texture that is desired from the buffer on a basis of the field index,
unpack the VD texture that is desired from the packed VD texture on a basis of the acquired packing metadata, and
map the unpacked VD texture on the 3D object using the acquired camera parameter, and
the field index is set to the fields of the camera parameter and the packing metadata in the extension and has a different value for each of the fields.
9 . The information processing device according to claim 1 , wherein
the video components include a geometry map in which geometry of a point cloud is packed, an attribute map in which attributes of the point cloud are packed, and an occupancy map corresponding to the geometry map and the attribute map, and
the processing circuitry is configured to
store the geometry map, the attribute map, and the occupancy map in the buffer corresponding to each of the geometry map, the attribute map, and the occupancy map on a basis of the component index,
acquire the geometry map, the attribute map, and the occupancy map from the buffer on a basis of the component index, and
reconstruct the point cloud using the acquired geometry map, the acquired attribute map, and the acquired occupancy map.
10 . An information processing method, comprising:
storing video components included in a 3D object video in a buffer corresponding to the video components on a basis of a component index;
acquiring the video components from the buffer on a basis of the component index; and
generating a display image using the acquired video components, wherein
a plurality of the video components is simultaneously usable in one 3D object, and
the component index is set to the video components included in the 3D object video in an extension for the 3D object video defined in a material layer of a scene description and has a different value for each of the video components.
11 . An information processing device, comprising:
processing circuitry configured to generate a scene description file; and
set a component index to video components included in a 3D object video in an extension for the 3D object video defined in a material layer of the scene description file, the component index having a different value for each of the video components, wherein
a plurality of the video components is simultaneously usable in one 3D object.
12 . The information processing device according to claim 11 , wherein
the video components each include a viewpoint-dependent (VD) texture that is a captured image obtained by capturing the 3D object from a predetermined viewpoint, and
the processing circuitry is configured to set the component index to each of a plurality of the VD textures included in the 3D object video in the extension.
13 . The information processing device according to claim 12 , wherein the processing circuitry is configured to store a camera parameter corresponding to at least one of the VD textures in the extension.
14 . The information processing device according to claim 13 , wherein the processing circuitry is configured to set a field index to each of fields of the camera parameter in the extension, the field index having a different value for each of the fields.
15 . The information processing device according to claim 11 , wherein
the video components include a packed viewpoint-dependent (VD) texture in which a plurality of VD textures, which are captured images obtained by capturing the 3D object from a predetermined viewpoint, is packed, and
the processing circuitry is configured to set the component index to the packed VD texture in the extension.
16 . The information processing device according to claim 15 , wherein the processing circuitry is configured to store a camera parameter and packing metadata corresponding to the packed VD texture in the extension.
17 . The information processing device according to claim 16 , wherein the processing circuitry is configured to set a VD texture index to the camera parameter and the packing metadata for each of the VD textures packed in the packed VD texture in the extension, the VD texture index having a different value for each of the corresponding VD textures.
18 . The information processing device according to claim 16 , wherein the processing circuitry is configured to set a field index to each of fields of the camera parameter and the packing metadata in the extension, the field index having a different value for each of the fields.
19 . The information processing device according to claim 11 , wherein
the video components include a geometry map in which geometry of a point cloud is packed, an attribute map in which attributes of the point cloud are packed, and an occupancy map corresponding to the geometry map and the attribute map, and
the processing circuitry is configured to set the component index having a different value to each of the geometry map, the attribute map, and the occupancy map in the extension.
20 . An information processing method, comprising:
generating a scene description file; and
setting a component index to video components included in a 3D object video in an extension for the 3D object video defined in a material layer of the scene description file, the component index having a different value for each of the video components, wherein
a plurality of the video components is simultaneously usable in one 3D object.