IP Library Granted Patent US 12,328,448
Granted Patent B2
US 12,328,448 · App. 18/674,330 · Granted Jun 10, 2025

Residual coding for geometry point cloud compression

Inventors: Adarsh Krishnan Ramasubramonian (Irvine, CA); Luong Pham Van (San Diego, CA); Bappaditya Ray (San Diego, CA); Louis Joseph Kerofsky (San Diego, CA); Geert Van der Auwera (San Diego, CA); Marta Karczewicz (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/597H04N19/105H04N19/124H04N19/136H04N19/156H04N19/184H04N19/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,328,448
App. No.
18/674,330
Granted
Jun 10, 2025
Kind
B2
Abstract

A method of decoding point cloud data comprises obtaining a bitstream that is encoded to comply with one or more constraints and decoding the bitstream, wherein decoding the bitstream comprises: determining a residual value of a first component of an attribute of a point; generating a predicted value of a second component of the attribute of the point; and reconstructing the second component as a sum of the predicted value of the second component and a multiplication product of a scale factor for the second component and the residual value of the first component, wherein the constraints include a constraint that limits the first component of the attribute of the point, the residual value of the first component of the attribute of the point, the second component of the attribute, and the residual value of the second component of the attribute of the point to one or more predefined bitdepths.

Claims (48)

1. A method of decoding point cloud data, the method comprising:

obtaining a bitstream that is encoded to comply with one or more constraints; and

decoding the bitstream, wherein decoding the bitstream comprises:

determining, based on data signaled in the bitstream, a residual value of a first component of an attribute of a point of the point cloud data;

generating a predicted value of a second component of the attribute of the point; and

determining, based on the data signaled in the bitstream, a delta scaling value for the predicted value of the second component of the attribute, wherein the one or more constraints limit the delta scaling value to be in a range of a first value to a second value, inclusive; and

determining a scale factor based on a predicted coefficient and the delta scaling value;

reconstructing the second component of the attribute based on a sum of the predicted value of the second component of the attribute and a multiplication product of the scale factor and the residual value for the first component.

2. The method of claim 1 , wherein the second component of the attribute is a last component in a detail layer from the second component of the attribute.

3. The method of claim 1 , wherein the second component of the attribute is a non-primary component in a detail layer from the first component of the attribute.

4. The method of claim 1 , wherein the method further comprises determining, based on compliance of the bitstream with the one or more constraints, whether to decode the point cloud data.

5. The method of claim 1 , wherein determining the residual value of the first component of the point comprises inverse quantizing a signaled value of the first component, wherein the signaled value of the first component is signaled in the bitstream.

6. A method of encoding point cloud data, the method comprising:

obtaining the point cloud data; and

encoding the point cloud data, wherein encoding the point cloud data comprises generating a bitstream that complies with one or more constraints, wherein generating the bitstream comprises:

determining a residual value of a first component of an attribute of a point;

generating a predicted value of a second component of the attribute of the point;

generating a delta scaling value for the predicted value of the second component of the attribute, wherein the one or more constraints limit the delta scaling value to be in a range of a first value to a second value, inclusive; and

reconstructing the second component of the attribute of the point as a sum of the predicted value of the second component of the attribute of the point and the delta scaling value.

7. The method of claim 6 , wherein the second component of the attribute is a last component in a detail layer from the second component of the attribute.

8. The method of claim 6 , wherein the second component of the attribute is a non-primary component in a detail layer from the first component of the attribute.

9. The method of claim 6 , wherein determining the residual value of the first component comprises inverse quantizing a signaled value of the first component, wherein the signaled value of the first component is signaled in the bitstream.

10. The method of claim 6 , further comprising generating the point cloud data.

11. A device comprising:

a memory configured to store point cloud data; and

one or more processors coupled to the memory and implemented in circuitry, the one or more processors configured to:

obtain a bitstream that is encoded to comply with one or more constraints; and

decode the bitstream, wherein the one or more processors are configured to, as part of decoding the bitstream:

determine, based on data signaled in the bitstream, a residual value of a first component of an attribute of a point of the point cloud data;

generate a predicted value of a second component of the attribute of the point;

determine, based on the data signaled in the bitstream, a delta scaling value for the predicted value of the second component of the attribute, wherein the one or more constraints limit the delta scaling value to be in a range of a first value to a second value, inclusive;

determine a scale factor based on a predicted coefficient and the delta scaling value; and

reconstruct the second component of the attribute based on a sum of the predicted value of the second component of the attribute and a multiplication product of the scale factor and the residual value for the first component.

12. The device of claim 11 , wherein the second component of the attribute is a last component in a detail layer from the second component of the attribute.

13. The device of claim 11 , wherein the second component of the attribute is a non-primary component in a detail layer from the first component of the attribute.

14. The device of claim 11 , wherein the one or more processors are further configured to determine, based on compliance of the bitstream with the one or more constraints, whether to decode the point cloud data.

15. The device of claim 11 , wherein the one or more processors are configured to, as part of determining the residual value of the first component, inverse quantize a signaled value of the first component, wherein the signaled value of the first component is signaled in the bitstream.

16. A device comprising:

a memory configured to store point cloud data; and

one or more processors coupled to the memory and implemented in circuitry, the one or more processors configured to encode the point cloud data, wherein the one or more processors are configured to, as part of encoding the point cloud data, generate a bitstream that complies with one or more constraints, wherein the one or more processors are configured to, as part of generating the bitstream:

determine a residual value of a first component of an attribute of a point;

generate a predicted value of a second component of the attribute of the point;

generate a delta scaling value for the predicted value of the second component of the attribute, wherein the delta scaling value is a difference between a predicted coefficient and a scale factor, and the one or more constraints limit the delta scaling value to be in a range of a first value to a second value, inclusive; and

reconstruct the second component of the attribute based on a sum of the predicted value of the second component of the attribute and a multiplication product of the scale factor and the residual value for the first component.

17. The device of claim 16 , wherein the second component of the attribute is a last component in a detail layer from the second component of the attribute.

18. The device of claim 16 , wherein the second component of the attribute is a non-primary component in a detail layer from the first component of the attribute.

19. The device of claim 16 , wherein the one or more processors are configured to, as part of determining the residual value of the first component, inverse quantize a signaled value of the first component, wherein the signaled value of the first component is signaled in the bitstream.

20. The device of claim 16 , further comprising a sensor to generate the point cloud data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2024
From: RAMASUBRAMONIAN, ADARSH KRISHNAN; PHAM VAN, LUONG; RAY, BAPPADITYA; KEROFSKY, LOUIS JOSEPH; VAN DER AUWERA, GEERT; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 067523/0876 →
Continuity (3)
Continuation 17657867 · Apr 4, 2022
Provisional Application 63170999 · Apr 5, 2021
Related Publication 20240314358A1 · Sep 19, 2024
References Cited (24)
US 12003768B2 · Ramasubramonian et al. · 2024 [cited by applicant]
US 20190087979A1 · Mammou et al. · 2019 [cited by applicant]
US 20200099942A1 · Tourapis et al. · 2020 [cited by applicant]
US 20200105024A1 · Mammou et al. · 2020 [cited by applicant]
US 20200302655A1 · Oh · 2020 [cited by applicant]
US 20210029187A1 · Oh · 2021 [cited by applicant]
US 20210104072A1 · Yea et al. · 2021 [cited by applicant]
US 20210203989A1 · Wang et al. · 2021 [cited by applicant]
US 20210258590A1 · Boyce et al. · 2021 [cited by applicant]
US 20220050816A1 · Zhang et al. · 2022 [cited by applicant]
US 20220292730A1 · Gao et al. · 2022 [cited by applicant]
“G-PCC Codec Description”, 132. MPEG Meeting, Oct. 12, 2020-Oct. 16, 2020, Online, (Motion Picture Expert Group Or ISO/IEC JTC1/SC29/WG11), No. n19620, Dec. 31, 2020, 148 Pages, XP030291393, section 3.12.2, Para [3.4.9]. [cited by applicant]
“G-PCC Future Enhancements”, 130, MPEG Meeting, Apr. 20, 2020-Apr. 24, 2020, ALPBACH, (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. n19328, Jul. 21, 2020, XP030289574, 140 Pages. [cited by applicant]
International Search Report and Written Opinion—PCT/US2022/071535—ISA/EPO—Jul. 11, 2022. [cited by applicant]
ITU-T H.265: “Series H: Audiovisual and Multimedia Systems Infrastructure of Audiovisual Services—Coding of Moving Video”, High Efficiency Video Coding, The International Telecommunication Union, Jun. 2019, 696 Pages. [cited by applicant]
itu-T H.266: “Series H: Audiovisual and Multimedia Systems Infrastructure of Audiovisual Services—Coding of Moving Video”, Versatile Video Coding, The International Telecommunication Union, Aug. 2020, 516 pages. [cited by applicant]
Park Y (LGE)., et al., “[G-PCC] [New Proposal] Clipping Real Value RGB”, 132. MPEG Meeting, Oct. 12, 2020-Oct. 16, 2020, Online, (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. m55498, Oct. 13, 2020 (Oct. 1… [cited by applicant]
Ramasubramonian A.K., et al., “[G-PCC] [New Proposal] On Attribute QP Derivation”, 131. MPEG Meeting, Jun. 29, 2020-Jul. 3, 2020, Online, (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. m54698, Jun. 24, 202… [cited by applicant]
Ray B (Qualcomm)., et al., “[G-PCC][New] On Inter-Component Residual Prediction”, 132, MPEG Meeting, Oct. 12, 2020-Oct. 16, 2020, Online, (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. M55373, Oct. 7, 2020… [cited by applicant]
Ray (Qualcomm) B., et al., “[G-PCC][new] Attribute Related High Level Syntax—Fixes and Improvements”, 130. MPEG Meeting, Apr. 20, 2020-Apr. 24, 2020, Alpbach, AT, International Organisation For Standardisation Organisat… [cited by applicant]
“Text of ISO/IEC CD 23090-9 Geometry-Based Point Cloud Compression”, 126. MPEG Meeting, Mar. 25, 2019-Mar. 29, 2019, Geneva, (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. n18478, Jul. 2, 2019 (Jul. 2, 201… [cited by applicant]
Xiu (Interdigital) X., et al., “CE9-Related: Complexity Reduction and Bit-Width Control for Bi-Directional Optical Flow (BIO)”, 12. JVET Meeting, Oct. 3, 2018-Oct. 12, 2018, Macao, (The Joint Video Exploration Team of I… [cited by applicant]
Xiu (Kwai) X., et al., “CE9-Related: On BDOF Precision Alignment for High Internal Bit-depth”, 15. JVET Meeting, Jul. 3, 2019-Jul. 12, 2019, Gothenburg, (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and IT… [cited by applicant]
Xiu (Kwai) X., et al., “Non-CE4: On BDOF and PROF Parameter Derivation”, 16. JVET Meeting, Oct. 1, 2019-Oct. 11, 2019, Geneva, (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16), No. JVET-P0653… [cited by applicant]