IP Library Granted Patent US 11,816,868
Granted Patent B2
US 11,816,868 · App. 17/332,213 · Granted Nov 14, 2023

Coding of multiple-component attributes for point cloud coding

Inventors: Xiang Zhang (Mountain View, CA); Wen Gao (West Windsor, NJ); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
G06T9/001G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,816,868
App. No.
17/332,213
Filed
May 27, 2021
Granted
Nov 14, 2023
Kind
B2
Examiner
SETH, MANAV
Art Unit
2672
USPC
382/232
Abstract

A method, computer program, and computer system is provided for point cloud coding. The method includes receiving, from a bitstream, data corresponding to a point cloud; obtaining from the data a first prediction residual of a first component from among a plurality of components of an attribute associated with the point cloud; reconstructing the first prediction residual; determining a predicted second prediction residual based on the reconstructed first prediction residual and at least one model parameter; obtaining a second prediction residual of a second component from among the plurality of components based on the predicted second prediction residual; reconstructing the second prediction residual; and decoding the data corresponding to the point cloud based on the reconstructed first prediction residual and the reconstructed second prediction residual.

Claims (78)

1. A method of point cloud coding, executable by a processor, comprising:

receiving, from a bitstream, data corresponding to a point cloud;

obtaining from the data a first prediction residual of a first component from among a plurality of components of an attribute associated with the point cloud;

reconstructing the first prediction residual;

determining a predicted second prediction residual based on the reconstructed first prediction residual and at least one model parameter;

obtaining a second prediction residual of a second component from among the plurality of components based on the predicted second prediction residual;

reconstructing the second prediction residual; and

decoding the data corresponding to the point cloud based on the reconstructed first prediction residual and the reconstructed second prediction residual.

2. The method of claim 1 , wherein a model corresponding to the at least one model parameter comprises at least one of a linear model, a quadratic model, and a polynomial model.

3. The method of claim 1 , further comprising:

determining a predicted third prediction residual based on the reconstructed first prediction residual, the reconstructed second prediction residual, and the at least one model parameter;

obtaining a third prediction residual of a third component from among the plurality of components based on the predicted third prediction residual;

reconstructing the third prediction residual; and

decoding the data corresponding to the point cloud based on the reconstructed first prediction residual, the reconstructed second prediction residual, and the reconstructed third prediction residual.

4. The method of claim 3 , wherein the predicted second prediction residual is determined using a following first equation:

p 1 =α 0 R 0 ,

wherein the predicted third prediction residual is determined using a following second equation:

p 2 =α 1 R 0 +β 1 R 1 , and

wherein R 0 represents the reconstructed first prediction residual, p 1 represents the predicted second prediction residual, R 1 represents the reconstructed second prediction residual, p 2 represents the predicted third prediction residual, and

wherein α 0 , α 1 , and β 1 represent model parameters of the at least one model parameter.

5. The method of claim 3 , wherein the predicted second prediction residual is determined using a following first equation:

p 1 =α 0 R 0 ,

wherein the predicted third prediction residual is determined using a following second equation:

p 2 =α 1 R 0 , and

wherein R 0 represents the reconstructed first prediction residual, p 1 represents the predicted second prediction residual, p 2 represents the predicted third prediction residual, and

wherein α 0 and α 1 represent model parameters of the at least one model parameter.

6. The method of claim 3 , wherein the predicted second prediction residual is determined using a following first equation:

p 1 =α 0 R 0 ,

wherein the predicted third prediction residual is determined using a following second equation:

p 2 =β 1 R 1 , and

wherein R 0 represents the reconstructed first prediction residual, p 1 represents the predicted second prediction residual, R 1 represents the reconstructed second prediction residual, p 2 represents the predicted third prediction residual, and

wherein α 0 and β 1 represent model parameters of the at least one model parameter.

7. The method of claim 3 , wherein the predicted second prediction residual is determined using a following first equation:

p 1 =α 0 R 0 ,

wherein the predicted third prediction residual is determined using a following second equation:

p 2 =α 0 R 0 ,

wherein R 0 represents the reconstructed first prediction residual, p 1 represents the predicted second prediction residual, and p 2 represents the predicted third prediction residual, and

wherein α 0 represents a model parameter of the at least one model parameter.

8. The method of claim 3 , wherein the predicted second prediction residual is determined using a following first equation:

p 1 =α 0 R 0 ,

wherein the predicted third prediction residual is determined using a following second equation:

p 2 =α 0 R 1 , and

wherein R 0 represents the reconstructed first prediction residual, p 1 represents the predicted second prediction residual, R 1 represents the reconstructed second prediction residual, p 2 represents the predicted third prediction residual, and

wherein α 0 represents a model parameter of the at least one model parameter.

9. The method of claim 1 , wherein the at least one model parameter is signaled in the data.

10. The method of claim 1 , wherein the at least one model parameter is a predetermined model parameter.

11. The method of claim 1 , wherein the at least one model parameter is adaptively learned based on at least one of the reconstructed first prediction residual and the reconstructed second prediction residual.

12. The method of claim 1 , wherein the first component is associated with a first context model, and

wherein the second component is associated with a second context model different from the first context model.

13. A computer system for point cloud coding, the computer system comprising:

one or more computer-readable non-transitory storage media configured to store computer program code; and

one or more processors configured to access the computer program code and operate as instructed by the computer program code, said computer program code including:

receiving code configured to cause the one or more processors to receive, from a bitstream, data corresponding to a point cloud;

first obtaining code configured to cause the one or more processors to obtain, from the data a first prediction residual of a first component from among a plurality of components of an attribute associated with the point cloud;

first reconstructing code configured to cause the one or more processors to reconstruct the first prediction residual;

first determining code configured to cause the one or more processors to determine a predicted second prediction residual based on the reconstructed first prediction residual and at least one model parameter;

second obtaining code configured to cause the one or more processors to obtain a second prediction residual of a second component from among the plurality of components based on the predicted second prediction residual;

second reconstructing code configured to cause the one or more processors to reconstruct the second prediction residual; and

first decoding code configured to cause the one or more processors to decode the data corresponding to the point cloud based on the reconstructed first prediction residual and the reconstructed second prediction residual.

14. The computer system of claim 13 , wherein a model corresponding to the at least one model parameter comprises at least one of a linear model, a quadratic model, and a polynomial model.

15. The computer system of claim 13 , wherein the computer program code further includes:

third determining code configured to cause the one or more processors to determine a predicted third prediction residual based on the reconstructed first prediction residual, the reconstructed second prediction residual, and the at least one model parameter;

third obtaining code configured to cause the one or more processors to obtain a third prediction residual of a third component from among the plurality of components based on the predicted third prediction residual;

third reconstructing code configured to cause the one or more processors to reconstruct the third prediction residual; and

second decoding code configured to cause the one or more processors to decode the data corresponding to the point cloud based on the reconstructed first prediction residual, the reconstructed second prediction residual, and the reconstructed third prediction residual.

16. The computer system of claim 13 , wherein the at least one model parameter is signaled in the data.

17. The computer system of claim 13 , wherein the at least one model parameter is a predetermined model parameter.

18. The computer system of claim 13 , wherein the at least one model parameter is adaptively learned based on at least one of the reconstructed first prediction residual and the reconstructed second prediction residual.

19. The computer system of claim 13 , wherein the first component is associated with a first context model, and

wherein the second component is associated with a second context model different from the first context model.

20. A non-transitory computer readable medium having stored thereon a computer program for point cloud coding, the computer program configured to cause one or more computer processors to:

receive, from a bitstream, data corresponding to a point cloud;

obtain, from the data a first prediction residual of a first component from among a plurality of components of an attribute associated with the point cloud;

reconstruct the first prediction residual;

determine a predicted second prediction residual based on the reconstructed first prediction residual and at least one model parameter;

obtain a second prediction residual of a second component from among the plurality of components based on the predicted second prediction residual;

reconstruct the second prediction residual; and

decode the data corresponding to the point cloud based on the reconstructed first prediction residual and the reconstructed second prediction residual.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2021
From: ZHANG, XIANG; GAO, WEN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 056373/0576 →
Continuity (2)
Provisional Application 63066121 · Aug 14, 2020
Related Publication 20220051447A1 · Feb 17, 2022
Cited By (1)
US 12,406,404