IP Library Granted Patent US 11,671,576
Granted Patent B2
US 11,671,576 · App. 17/496,035 · Granted Jun 6, 2023

Method and apparatus for inter-channel prediction and transform for point-cloud attribute coding

Inventors: Sehoon Yea (Palo Alto, CA); Arash Vosoughi (San Jose, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N13/161G06T9/001H04N19/176H04N19/597H04N19/85G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,671,576
App. No.
17/496,035
Filed
Oct 7, 2021
Granted
Jun 6, 2023
Kind
B2
Art Unit
2484
USPC
375/240.12
Abstract

A method of interframe point cloud attribute decoding of video data is performed by at least one processor and includes: obtaining a first reconstructed residual; obtaining a quantization index of a second reconstructed residual; obtaining the second reconstructed residual, based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual; and obtaining a color attribute of a point of a point cloud by decoding the obtained second reconstructed residual or decoding a transform residual based on the obtained second reconstructed residual. The first reconstructed residual and the second reconstructed residual are each a reconstructed residual of a respective channel of the color attribute.

Claims (65)

1. A method of interframe point cloud attribute decoding of video data, the method being performed by at least one processor, and the method comprising:

obtaining a first reconstructed residual;

obtaining a quantization index of a second reconstructed residual;

obtaining the second reconstructed residual, based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual; and

obtaining a color attribute of a point of a point cloud by decoding the obtained second reconstructed residual or decoding a transform residual based on the obtained second reconstructed residual,

wherein the first reconstructed residual and the second reconstructed residual are each a reconstructed residual of a respective channel of the color attribute.

2. The method of claim 1 , wherein the obtaining the quantization index of the second reconstructed residual comprises entropy decoding a coded version of the quantization index of the second reconstructed residual to obtain the quantization index of the second reconstructed residual.

3. The method of claim 1 , wherein the obtaining the second reconstructed residual comprises:

inverse quantizing the obtained quantization index; and

adding the inverse quantized quantization index to the obtained first reconstructed residual, to obtain the second reconstructed residual.

4. The method of claim 1 , further comprising:

applying a backward YCoCg-R transform to the obtained first reconstructed residual and the obtained second reconstructed residual, to obtain the transform residual,

wherein the backward YCoCg-R transform is expressed by:

t=Y −( Cg>> 1)

G=Cg+t

B=t −( Co>> 1)

R=B+Co

where Y is a luma value, Co is a chrominance orange value, Cg is a chrominance green value, R is a red value, G is a green value, and B is a blue value, and

the obtaining the color attribute of the point of the point cloud comprises decoding the transform residual to obtain the color attribute.

5. The method of claim 4 , further comprising determining whether to apply the backward YCoCg-R transform, based on a conditional check.

6. The method of claim 1 , further comprising determining whether to obtain the second reconstructed residual based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual, based on a conditional check.

7. The method of claim 6 , wherein a condition of the conditional check is a degree of interchannel correlation.

8. An apparatus for interframe point cloud attribute decoding of video data, the apparatus comprising:

at least one memory configured to store computer program code; and

at least one processor configured to access the at least one memory and operate according to the computer program code, the computer program code comprising:

first obtaining code configured to cause the at least one processor to obtain a first reconstructed residual;

second obtaining code configured to cause the at least one processor to obtain a quantization index of a second reconstructed residual;

third obtaining code configured to cause the at least one processor to obtain the second reconstructed residual, based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual; and

fourth obtaining code configured to cause the at least one processor to obtain a color attribute of a point of a point cloud by decoding the obtained second reconstructed residual or decoding a transform residual based on the obtained second reconstructed residual,

wherein the first reconstructed residual and the second reconstructed residual are each a reconstructed residual of a respective channel of the color attribute.

9. The apparatus of claim 8 , wherein the second obtaining code is further configured to cause the at least one processor to entropy decode a coded version of the quantization index of the second reconstructed residual to obtain the quantization index.

10. The apparatus of claim 8 , wherein the third obtaining code is further configured to cause the at least one processor to:

inverse quantize the obtained quantization index; and

add the inverse quantized quantization index to the obtained first reconstructed residual, to obtain the second reconstructed residual.

11. The apparatus of claim 8 , further comprising applying code configured to cause the at least one processor to apply a backward YCoCg-R transform to the obtained first reconstructed residual and the obtained second reconstructed residual, to obtain the transform value,

wherein the backward YCoCg-R transform is expressed by:

t=Y −( Cg>> 1)

G=Cg+t

B=t −( Co>> 1)

R=B+Co

where Y is a luma value, Co is a chrominance orange value, Cg is a chrominance green value, R is a red value, G is a green value, and B is a blue value, and

the fourth obtaining code is configured to cause the at least one processor to obtain the color attribute of the point of the point cloud by decoding the transform residual.

12. The apparatus of claim 11 , further comprising determining code configured to cause the at least one processor to determine whether to apply the backward YCoCg-R transform, based on a conditional check.

13. The apparatus of claim 8 , further comprising determining code configured to cause the at least one processor to determine whether to obtain the second reconstructed residual based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual, based on a conditional check.

14. The apparatus of claim 13 , wherein a condition of the conditional check is a degree of interchannel correlation.

15. A non-transitory computer-readable storage medium storing instructions that cause at least one processor to:

obtain a first reconstructed residual from video data;

obtain a quantization index of a second reconstructed residual;

obtain the second reconstructed residual from the video data, based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual; and

obtain a color attribute of a point of a point cloud by decoding the obtained second reconstructed residual or decoding a transform residual based on the obtained second reconstructed residual,

wherein the first reconstructed residual and the second reconstructed residual are each a reconstructed residual of a respective channel of the color attribute.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further cause the at least one processor to entropy decode a coded version of the quantization index of the second reconstructed residual to obtain the quantization index of the second reconstructed residual.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further cause the at least one processor to:

inverse quantize the obtained quantization index; and

add the inverse quantized quantization index to the obtained first reconstructed residual, to obtain the second reconstructed residual.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further cause the at least one processor to apply a backward YCoCg-R transform to the obtained first reconstructed residual and the obtained second reconstructed residual, to obtain the transform value,

wherein the backward YCoCg-R transform is expressed by:

t=Y −( Cg>> 1)

G=Cg+t

B=t −( Co>> 1)

R=B+Co

where Y is a luma value, Co is a chrominance orange value, Cg is a chrominance green value, R is a red value, G is a green value, and B is a blue value, and

the color attribute of the point of the point cloud is obtained by decoding the transform residual.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the instructions further cause the at least one processor to determine whether to apply the backward YCoCg-R transform, based on a conditional check.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further cause the at least one processor to determine whether to obtain the second reconstructed residual based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual, based on a conditional check.

Continuity (3)
Continuation 16917107 · Jun 30, 2020
Provisional Application 62871081 · Jul 5, 2019
Related Publication 20220030211A1 · Jan 27, 2022
Cited By (1)
US 12,406,404