Granted Patent B2

US 12,425,657 · App. 18/235,685 · Granted Sep 23, 2025

Inventor: Ying Hu (Shenzhen, CN)

Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED

H04N19/70H04N19/132H04N19/136H04N19/174H04N19/186

Abstract

Claims (84)

1. A method for decoding point cloud media, the method comprising:

receiving point cloud media data, the point cloud media data including a plurality of point cloud samples encapsulated in one or more tracks;

obtaining at least a compression unit of a point cloud sample in the plurality of point cloud samples, a media file data box of the point cloud sample including type information that indicates a type of the compression unit, the type of the compression unit being one of a geometry header indicating a parameter set of geometry information, an attribute header indicating a parameter set of attribute information, a geometry slice indicating point cloud slice data of the geometry information, and an attribute slice indicating point cloud slice data of the attribute information, wherein

when one of the one or more tracks is a geometry track for encapsulating geometry data,

slice type information indicates a first value in the media file data box of the point cloud sample, and the first value of the slice type information indicates that a type of the point cloud slice data in the point cloud sample is a point cloud geometry slice, and

attribute slice flag information does not include a second value in a media file data box of a sub-sample of the point cloud sample, and the attribute slice flag information indicating the second value indicates that the sub-sample is a point cloud attribute slice;

determining whether the compression unit is to be decoded according to the type information; and

decoding the compression unit to obtain point cloud data based on the compression unit being determined to be decoded.

2. The method according to claim 1 , wherein the media file data box of the point cloud sample further comprises:

component header number information indicating a number of parameter sets in the point cloud sample; and

slice number information indicating a number of point cloud slices in the point cloud sample.

3. The method according to claim 2 , wherein a parameter set of the point cloud sample is included in decoder configuration information when the component header number information has a value of 0.

4. The method according to claim 2 , wherein the media file data box of the point cloud sample further comprises:

header type information indicating that a type of a parameter set of the point cloud sample is a geometry header or an attribute header;

header length information indicating a length of the parameter set; and

header data information indicating data in the parameter set.

5. The method according to claim 2 , wherein the media file data box of the point cloud sample further comprises:

slice length information indicating a length of the point cloud slice data; and

slice data information including the point cloud slice data.

6. The method according to claim 5 , wherein

the type of the point cloud slice data is a point cloud reflectivity attribute slice when the slice type information indicates a third value; and

the type of the point cloud slice data is a point cloud mixed attribute slice including a color attribute and a reflectivity attribute when the slice type information indicates a fourth value.

7. The method according to claim 2 , wherein

the point cloud slice data includes a slice header and data information; and

the media file data box of the point cloud sample includes:

geometry slice header length information indicating a length of the slice header when the point cloud slice data corresponds to the geometry slice;

geometry slice data length information indicating a length of the data information when the point cloud slice data corresponds to the geometry slice;

attribute slice header length information indicating the length of the slice header when the point cloud slice data corresponds to the attribute slice;

attribute slice data length information indicating the length of the data information when the point cloud slice data corresponds to the attribute slice;

geometry slice header information indicating a point cloud slice header when the point cloud slice data corresponds to the geometry slice;

geometry slice data information including the data information when the point cloud slice data corresponds to the geometry slice;

attribute slice header information indicating the point cloud slice header when the point cloud slice data corresponds to the attribute slice; and

attribute slice data information including the data information when the point cloud slice data corresponds to the attribute slice.

8. The method according to claim 1 , wherein

the point cloud sample includes at least a sub-sample,

a media file data box of the sub-sample includes sub-sample flag information, and

the sub-sample includes the compression unit in the point cloud sample when the sub-sample flag information indicates a value of 0.

9. The method according to claim 8 , wherein the media file data box of the sub-sample further comprises:

geometry header flag information indicating whether the sub-sample is a geometry header parameter set;

attribute header flag information indicating whether the sub-sample is an attribute header parameter set; and

geometry slice flag information indicating whether the sub-sample is a point cloud geometry slice.

10. The method according to claim 9 , wherein the media file data box of the sub-sample further comprises:

attribute type information indicating a type of a point cloud attribute when the sub-sample is the point cloud attribute slice.

11. The method according to claim 10 , wherein

the type of the point cloud attribute is a color attribute when the attribute type information indicates a third value;

the type of the point cloud attribute is a reflectivity attribute when the attribute type information indicates a fourth value; and

the type of the point cloud attribute is the color attribute and the reflectivity attribute when the attribute type information indicates a fifth value.

12. The method according to claim 8 , wherein

the point cloud media data includes the point cloud sample encapsulated in an attribute track for encapsulating attribute data; and

header type information indicates a third value in the media file data box of the point cloud sample, and the header type information indicating the third value indicates that that the type of the parameter set is an attribute header.

13. The method according to claim 1 , wherein

the point cloud media data includes the plurality of point cloud samples encapsulated in a plurality of tracks,

the media file data box of the point cloud sample includes metadata information corresponding to the plurality of tracks, and

the metadata information includes:

component type information indicating component types of point cloud components encapsulated in the plurality of tracks, the component types including an attribute component of attribute data and a geometry component of geometry data;

attribute number information indicating a number of attribute components encapsulated in the plurality of tracks; and

attribute type information indicating types of the attribute component encapsulated in the plurality of tracks.

14. The method according to claim 13 , wherein

the type of the attribute component is a color attribute when the attribute type information of the attribute component indicates a third value;

the type of the attribute component is a reflectivity attribute when the attribute type information of the attribute component indicates a fourth value; and

the type of the attribute component includes the color attribute and the reflectivity attribute when the attribute type information of the attribute component indicates a fifth value.

15. The method according to claim 1 , wherein the receiving the point cloud media data comprises:

parsing a streaming media transmission from a data source to obtain a component descriptor included in the streaming media transmission, the component descriptor indicating type information and attribute information of a point cloud component encapsulated in a track; and

obtaining the point cloud media data according to the component descriptor.

16. A method for encoding point cloud media, the method comprising:

receiving point cloud data, the point cloud data including a plurality of point cloud frames;

encoding the plurality of point cloud frames to obtain at least a compression unit; and

generating point cloud media data that includes at least the compression unit, the point cloud media data including a plurality of point cloud samples encapsulated in one or more tracks, a media file data box of a point cloud sample in the plurality of point cloud samples including type information that indicates a type of the compression unit, the type of the compression unit being one of a geometry header indicating a parameter set of geometry information, an attribute header indicating a parameter set of attribute information, a geometry slice indicating point cloud slice data of the geometry information, and an attribute slice indicating point cloud slice data of the attribute information, wherein

when one of the one or more tracks is a geometry track for encapsulating geometry data,

slice type information indicates a first value in the media file data box of the point cloud sample, and the first value of the slice type information indicates that a type of the point cloud slice data in the point cloud sample is a point cloud geometry slice, and

attribute slice flag information does not include a second value in a media file data box of a sub-sample of the point cloud sample, and the attribute slice flag information indicating the second value indicates that the sub-sample is a point cloud attribute slice.

17. An apparatus for decoding point cloud media, comprising:

processing circuitry configured to:

receive point cloud media data, the point cloud media data including a plurality of point cloud samples encapsulated in one or more tracks;

obtain at least a compression unit of a point cloud sample in the plurality of point cloud samples, a media file data box of the point cloud sample including type information that indicates a type of the compression unit, the type of the compression unit being one of a geometry header indicating a parameter set of geometry information, an attribute header indicating a parameter set of attribute information, a geometry slice indicating point cloud slice data of the geometry information, and an attribute slice indicating point cloud slice data of the attribute information, wherein

when one of the one or more tracks is a geometry track for encapsulating geometry data,

slice type information indicates a first value in the media file data box of the point cloud sample, and the first value of the slice type information indicates that a type of the point cloud slice data in the point cloud sample is a point cloud geometry slice, and

attribute slice flag information does not include a second value in a media file data box of a sub-sample of the point cloud sample, and the attribute slice flag information indicating the second value indicates that the sub-sample is a point cloud attribute slice;

determine whether the compression unit is to be decoded according to the type information; and

decode the compression unit to obtain point cloud data based on the compression unit being determined to be decoded.

18. The apparatus according to claim 17 , wherein the media file data box of the point cloud sample further comprises:

component header number information indicating a number of parameter sets in the point cloud sample; and

slice number information indicating a number of point cloud slices in the point cloud sample.

19. The apparatus according to claim 18 , wherein a parameter set of the point cloud sample is included in decoder configuration information when the component header number information has a value of 0.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (16)