IP Library › Granted Patent US 11,902,555
Granted Patent B2
US 11,902,555 · App. 17/416,907 · Granted Feb 13, 2024

Information processing device and information processing method

Inventors: Mitsuru Katsumata (Tokyo, JP); Ryohei Takahashi (Kanagawa, JP); Mitsuhiro Hirabayashi (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N19/46H04N19/597H04N21/816H04N21/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,902,555
App. No.
17/416,907
Granted
Feb 13, 2024
Kind
B2
Abstract

There is provided an information processing device and an information processing method by which reproduction of a point cloud having no time information can be handled. Metadata that includes reproduction information necessary to reproduce encoded data obtained by encoding one frame of a point cloud by V-PCC or G-PCC and that includes reproduction feasibility information to be used to determine feasibility of reproducing the encoded data is generated. The encoded data and the metadata are stored in a file having a predetermined file structure using the ISOBMFF technology. The present technology is applicable to a data generation device that generates a file into which encoded data of a point cloud having no time information is stored, for example.

Claims (71)

1. An information processing device comprising:

a metadata generation section configured to generate metadata that includes

reproduction information necessary to reproduce a bitstream from among a plurality of bitstreams generated from 3D data having no time information, and

reproduction feasibility information to be used to determine feasibility of reproducing the bitstream generated from the 3D data; and

a file generation section configured to generate a file in which the bitstream generated from the 3D data and the metadata are stored,

wherein the reproduction information includes

bitstream combination information that indicates a combination of bitstreams among the plurality of bitstreams to be used for reproduction, and

reproduction start point information that indicates a reproduction start point,

wherein the reproduction start point information indicates a bitstream among the plurality of bitstreams to be reproduced first,

wherein the reproduction information further includes a V-PCC Unit Header as information for reconstructing the 3D data from the plurality of bitstreams,

wherein the V-PCC Unit Header is signaled using a V-PCC still image format,

wherein the reproduction feasibility information is indicated using a structure of a file configuration of an ItemProperty within the generated file,

wherein the reproduction feasibility information includes information that indicates that each bitstream of the plurality of bitstreams is a part of data forming the 3D data,

wherein the reproduction feasibility information further includes, as determination information for allowing a determination that an item is not able to be singly displayed, information that indicates a hidden image, and

wherein the metadata generation section and the file generation section are each implemented via at least one processor.

2. The information processing device according to claim 1 , wherein

the reproduction feasibility information includes a parameter set for the bitstream.

3. The information processing device according to claim 2 , wherein

the file generation section stores the reproduction feasibility information into Item Property.

4. An information processing method executed by an information processing device, the method comprising:

generating metadata that includes

reproduction information necessary to reproduce a bitstream from among a plurality of bitstreams generated from 3D data having no time information, and

reproduction feasibility information to be used to determine feasibility of reproducing the bitstream generated from the 3D data; and

generating a file in which the bitstream generated from the 3D data and the metadata are stored,

wherein the reproduction information includes

bitstream combination information that indicates a combination of bitstreams among the plurality of bitstreams to be used for reproduction, and

reproduction start point information that indicates a reproduction start point,

wherein the reproduction start point information indicates a bitstream among the plurality of bitstreams to be reproduced first,

wherein the reproduction information further includes a V-PCC Unit Header as information for reconstructing the 3D data from the plurality of bitstreams,

wherein the V-PCC Unit Header is signaled using a V-PCC still image format,

wherein the reproduction feasibility information is indicated using a structure of a file configuration of an ItemProperty within the generated file,

wherein the reproduction feasibility information includes information that indicates that each bitstream of the plurality of bitstreams is a part of data forming the 3D data, and

wherein the reproduction feasibility information further includes, as determination information for allowing a determination that an item is not able to be singly displayed, information that indicates a hidden image.

5. An information processing device comprising:

a metadata generation section configured to generate metadata that includes

reproduction information necessary to reproduce a plurality of bitstreams generated from 3D data having no time information, and

reproduction feasibility information to be used to determine feasibility of reproducing the plurality of bitstreams generated from the 3D data; and

a file generation section configured to generate a file in which the plurality of bitstreams generated from the 3D data and the metadata are stored,

wherein the reproduction information includes

bitstream combination information that indicates a combination of bitstreams among the plurality of bitstreams to be used for reproduction, and

reproduction start point information that indicates a reproduction start point,

wherein the reproduction start point information indicates a bitstream among the plurality of bitstreams to be reproduced first,

wherein the reproduction information further includes a V-PCC Unit Header as information for reconstructing the 3D data from the plurality of bitstreams,

wherein the V-PCC Unit Header is signaled using a V-PCC still image format,

wherein the reproduction feasibility information is indicated using a structure of a file configuration of an ItemProperty within the generated file,

wherein the reproduction feasibility information includes information that indicates that each bitstream of the plurality of bitstreams is a part of data forming the 3D data,

wherein the reproduction feasibility information further includes, as determination information for allowing a determination that an item is not able to be singly displayed, information that indicates a hidden image, and

wherein the metadata generation section and the file generation section are each implemented via at least one processor.

6. The information processing device according to claim 5 , wherein

the reproduction start point information is item_id that indicates the bitstream among the plurality of bitstreams to be reproduced first.

7. The information processing device according to claim 5 , wherein

the V-PCC Unit Header is information for identifying a Type of each bitstream of the plurality of bitstreams.

8. The information processing device according to claim 7 , wherein

the file generation section stores the reproduction feasibility information into the ItemProperty within the generated file.

9. The information processing device according to claim 8 , wherein

the file generation section stores the information that indicates the hidden image into Item InfoEntry.

10. An information processing method executed by an information processing device, the method comprising:

generating metadata that includes

reproduction information necessary to reproduce a plurality of bitstreams generated from 3D data having no time information, and

reproduction feasibility information to be used to determine feasibility of reproducing the plurality of bitstreams generated from the 3D data; and

generating a file in which the plurality of bitstreams generated from the 3D data and the metadata are stored,

wherein the reproduction information includes

bitstream combination information that indicates a combination of bitstreams among the plurality of bitstreams to be used for reproduction, and

reproduction start point information that indicates a reproduction start point,

wherein the reproduction start point information indicates a bitstream among the plurality of bitstreams to be reproduced first,

wherein the reproduction information further includes a V-PCC Unit Header as information for reconstructing the 3D data from the plurality of bitstreams,

wherein the V-PCC Unit Header is signaled using a V-PCC still image format, wherein the reproduction feasibility information is indicated using a structure of a file configuration of an ItemProperty within the generated file,

wherein the reproduction feasibility information includes information that indicates that each bitstream of the plurality of bitstreams is a part of data forming the 3D data, and

wherein the reproduction feasibility information further includes, as determination information for allowing a determination that an item is not able to be singly displayed, information that indicates a hidden image.

11. The information processing device according to claim 1 , wherein

the Item Property is signaled using an Item PropertyContainerBox.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2021
From: KATSUMATA, MITSURU; TAKAHASHI, RYOHEI; HIRABAYASHI, MITSUHIRO
To: SONY GROUP CORPORATION
Reel/Frame 056605/0736 →
Priority Claims (1)
JP 2018-248321 · Dec 28, 2018 · national
Continuity (1)
Related Publication 20220053205A1 · Feb 17, 2022