Granted Patent B2

US 12,354,315 · App. 18/001,962 · Granted Jul 8, 2025

Inventors: Wei Zhang (Shaanxi, CN); Mary-Luc Georges Henry Champel (Beijing, CN)

Assignees: Beijing Xiaomi Mobile Software Co., Ltd.; Xidian University

G06T9/40G06T9/001H04N19/61

Abstract

Claims (66)

1. A method for encoding attributes of points of a point cloud to generate a bitstream of compressed point cloud data, wherein the point cloud's geometry is represented by a voxel-based structure with a plurality of nodes having parent-child relationships by recursively splitting a volumetric space containing the point cloud into sub-volumes each associated with a node of the voxel-based structure, the method comprising:

determining a true transform coefficient by applying Region-Adaptive Hierarchal Transform (RAHT), to attributes of a present node;

determining a difference between attributes of a present parent node and each parent node of a first set of parent nodes sharing a face or an edge with the present node, wherein the present parent node is the parent node of the present node;

selecting a second set of parent nodes from the first set of parent nodes according to the difference, wherein the second set of parent nodes includes the present parent node;

determining a predicted value for the attributes of the present node according to attributes of the second set of parent nodes;

determining a predicted transform coefficient by applying the RAHT to the predicted value of the attributes of the present node;

determining a residual from the true transform coefficient and the predicted transform coefficient; and

encoding the residual to produce encoded data of attributes of the point cloud for the bitstream.

2. The method according to claim 1 , wherein determining the difference between the attributes of the present parent node and each parent node of the first set of parent nodes includes:

determining a maximum difference among each parent node of the first set of parent nodes and the present parent node;

providing a first threshold; and

if the maximum difference is smaller than the first threshold, selecting all parent nodes of the first set of parent nodes.

3. The method according to claim 1 , wherein determining the difference between the attributes of the present parent node and each parent node of the first set of parent nodes includes:

determining a difference between the attributes of each of the parent nodes in the first set of parent nodes and the present parent node;

providing a second threshold; and

selecting parent nodes of the first set of parent nodes if the respective difference is smaller than the second threshold.

4. The method according to claim 3 , wherein at least one of the first threshold or the second threshold is fixed.

5. The method according to claim 3 , wherein at least one of the first threshold or the second threshold is determined according to a distribution of the attributes within the complete point cloud.

6. The method according to claim 3 , wherein at least one of the first threshold or the second threshold is determined according to the first set of parent nodes.

7. The method according to claim 3 , wherein the second threshold is a percentage of the first threshold.

8. The method according to claim 3 , wherein at least one of the first threshold and/or or the second threshold is determined according to a ration between the attributes of the present node and the attributes of parent nodes of the first set of parent nodes.

9. The method according to claim 3 , wherein at least one of the first threshold and or the second threshold is included into the bitstream.

10. The method according to claim 9 , wherein at least one of the first threshold or the second threshold is included into the bitstream only at the top of at least one subtree for which the at least one of the first threshold or the second threshold is used and is inherited by all nodes in the subtree for which there is no explicit signaling of another first or second threshold.

11. An encoder for encoding attributes of points of a point cloud to generate a bitstream of compressed point cloud data, wherein the point cloud's geometry is represented by a voxel-based structure with a plurality of nodes having parent-child relationships by recursively splitting a volumetric space containing the point cloud into sub-volumes each associated with a node of the voxel-based structure, the encoder comprising:

a processor; and

a memory storage device storing instructions executable by the processor,

wherein the processor is configured to:

determine a true transform coefficient by applying Region-Adaptive Hierarchal Transform (RAHT) to attributes of a present node;

determine a difference between attributes of a present parent node and each parent node of a first set of parent nodes sharing a face or an edge with the present node, wherein the present parent node is the parent node of the present node;

select a second set of parent nodes from the first set of parent nodes according to the difference, wherein the second set of parent nodes includes the present parent node;

determine a predicted value for the attributes of the present node according to attributes of the second set of parent nodes;

determine a predicted transform coefficient by applying the RAHT to the predicted value of the attributes of the present node;

determine a residual from the true transform coefficient and the predicted transform coefficient; and

encode the residual to produce encoded data of attributes of the point cloud for the bitstream.

12. A decoder for decoding a bitstream of compressed point cloud data to generate attributes of points of a reconstructed point cloud, wherein the point cloud's geometry is represented by a voxel-based structure with a plurality of nodes having parent-child relationships by recursively splitting a volumetric space containing the point cloud into sub-volumes each associated with a node of the voxel-bases structure, the decoder comprising:

a processor; and

a memory storage device storing instructions executable by the processor,

wherein the processor is configured to:

decode a residual of attributes of a present node of the point cloud from the bitstream;

determine a difference between attributes of a present parent node and each parent node of a first set of parent nodes sharing a face or an edge with the present node, wherein the present parent node is the parent node of the present node;

select a second set of parent nodes from the first set of parent nodes according to the difference, wherein the second set of parent nodes includes the present parent node;

determine a predicted value for the attributes of the present node according to attributes of the second set of parent nodes;

determine a predicted transform coefficient by applying Region-Adaptive Hierarchal Transform (RAHT) to the predicted value of the attributes of the present node; and

determine from the residual and the predicted transform coefficient the attributes of the present node by applying an inverse RAHT.

13. A method for decoding a bitstream of compressed point cloud data to generate attributes of points in a reconstructed point cloud, wherein the point cloud's geometry is represented by a voxel-based structure with a plurality of nodes having parent-child relationships by recursively splitting a volumetric space containing the point cloud into sub-volumes each associated with a node of the voxel-bases structure, the method comprising:

decoding a residual of attributes of a present node of the point cloud from the bitstream;

determining a difference between attributes of a present parent node and each parent node of a first set of parent nodes sharing a face or an edge with the present node, wherein the present parent node is the parent node of the present node;

selecting a second set of parent nodes from the first set of parent nodes according to the difference, wherein the second set of parent nodes includes the present parent node;

determining a predicted value for the attributes of the present node according to attributes of the second set of parent nodes;

determining a predicted transform coefficient by applying Region-Adaptive Hierarchal Transform (RAHT) to the predicted value of the attributes of the present node; and

determining from the residual and the predicted transform coefficient the attributes of the present node by applying an inverse RAHT.

14. The method according to claim 13 , wherein determining the difference between the attributes of the present parent node and each parent node of the first set of parent nodes includes:

determining a maximum difference among each parent node of the first set of parent nodes and the present parent node;

providing a first threshold; and

if the maximum difference is smaller than the first threshold, selecting all parent nodes of the first set of parent nodes.

15. The method according to claim 13 , wherein determining the difference between the attributes of the present parent node and each parent node of the first set of parent nodes includes:

determining a difference between the attributes of each of the parent nodes in the first set of parent nodes and the present parent node;

providing a second threshold; and

selecting parent nodes of the first set of parent nodes if the respective difference is smaller than the second threshold.

16. The method according to claim 15 , wherein at least one of the first threshold or the second threshold is fixed.

17. The method according to claim 15 , wherein at least one of the first threshold or the second threshold is determined according to a distribution of the attributes within the complete point cloud.

18. The method according to claim 15 , wherein at least one of the first threshold or the second threshold is determined according to the first set of parent nodes.

19. The method according to claim 15 , wherein the second threshold is a percentage of the first threshold.

20. The method according to claim 15 , wherein at least one of the first threshold or the second threshold is determined according to a ration between the attributes of the present node and the attributes of parent nodes of the first set of parent nodes.

21. The method according to claim 15 , wherein at least one of the first threshold or the second threshold is included into the bitstream.

22. The method according to claim 21 , wherein at least one of the first threshold or the second threshold is included into the bitstream only at the top of at least one subtree for which the at least one of the first threshold or the second threshold is used and is inherited by all nodes in the subtree for which there is no explicit signaling of another first or second threshold.

Assignments (1)

Continuity (1)

References Cited (91)