IP Library Granted Patent US 11,202,054
Granted Patent B2
US 11,202,054 · App. 16/917,107 · Granted Dec 14, 2021

Method and apparatus for inter-channel prediction and transform for point-cloud attribute coding

Inventors: Sehoon Yea (Palo Alto, CA); Arash Vosoughi (San Jose, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N13/161G06T9/001H04N19/176H04N19/597H04N19/85G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,202,054
App. No.
16/917,107
Granted
Dec 14, 2021
Kind
B2
Abstract

A method of interframe point cloud attribute decoding of video data is performed by at least one processor and includes: obtaining a first reconstructed residual; obtaining a quantization index of a second reconstructed residual; obtaining the second reconstructed residual, based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual; and obtaining a color attribute of a point of a point cloud by decoding the obtained second reconstructed residual or decoding a transform residual based on the obtained second reconstructed residual.

Claims (74)

1. A method of interframe point cloud attribute decoding of video data, the method being performed by at least one processor, and the method comprising:

obtaining a first reconstructed residual;

obtaining a quantization index of a second reconstructed residual;

obtaining the second reconstructed residual, based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual;

obtaining a color attribute of a point of a point cloud by decoding the obtained second reconstructed residual or decoding a transform residual based on the obtained second reconstructed residual; and

determining whether to obtain the second reconstructed residual based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual, based on a conditional check.

2. The method of claim 1 , wherein the obtaining the quantization index of the second reconstructed residual comprises entropy decoding a coded version of the quantization index of the second reconstructed residual to obtain the quantization index of the second reconstructed residual.

3. The method of claim 1 , wherein the obtaining the second reconstructed residual comprises:

inverse quantizing the obtained quantization index; and

adding the inverse quantized quantization index to the obtained first reconstructed residual, to obtain the second reconstructed residual.

4. The method of claim 1 , wherein a condition of the conditional check is a degree of interchannel correlation.

5. A method of interframe point cloud attribute decoding of video data, the method being performed by at least one processor, and the method comprising:

obtaining a first reconstructed residual;

obtaining a second reconstructed residual;

applying a backward YCoCg-R transform to the obtained first reconstructed residual and the obtained second reconstructed residual, to obtain a transform residual; and

obtaining a color attribute of a point of a point cloud by decoding the transform residual,

wherein the backward YCoCg-R transform is expressed by:

t=Y −( Cg>> 1)

G=Cg+t

B=t −( Co>> 1)

R=B+Co

where Y is a luma value, Co is a chrominance orange value, Cg is a chrominance green value, R is a red value, G is a green value, and B is a blue value.

6. The method of claim 5 , further comprising determining whether to apply the backward YCoCg-R transform, based on a conditional check.

7. An apparatus for interframe point cloud attribute decoding of video data, the apparatus comprising:

at least one memory configured to store computer program code; and

at least one processor configured to access the at least one memory and operate according to the computer program code, the computer program code comprising:

first obtaining code configured to cause the at least one processor to obtain a first reconstructed residual;

second obtaining code configured to cause the at least one processor to obtain a quantization index of a second reconstructed residual;

third obtaining code configured to cause the at least one processor to obtain the second reconstructed residual, based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual;

fourth obtaining code configured to cause the at least one processor to obtain a color attribute of a point of a point cloud by decoding the obtained second reconstructed residual or decoding a transform residual based on the obtained second reconstructed residual; and

determining code configured to cause the at least one processor to determine whether to obtain the second reconstructed residual based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual, based on a conditional check.

8. The apparatus of claim 7 , wherein the second obtaining code is further configured to cause the at least one processor to entropy decode a coded version of the quantization index of the second reconstructed residual to obtain the quantization index.

9. The apparatus of claim 7 , wherein the third obtaining code is further configured to cause the at least one processor to:

inverse quantize the obtained quantization index; and

add the inverse quantized quantization index to the obtained first reconstructed residual, to obtain the second reconstructed residual.

10. The apparatus of claim 7 , wherein a condition of the conditional check is a degree of interchannel correlation.

11. An apparatus for interframe point cloud attribute decoding of video data, the apparatus comprising:

at least one memory configured to store computer program code; and

at least one processor configured to access the at least one memory and operate according to the computer program code, the computer program code comprising:

first obtaining code configured to cause the at least one processor to obtain a first reconstructed residual;

second obtaining code configured to cause the at least one processor to obtain a second reconstructed residual;

applying code configured to cause the at least one processor to apply a backward YCoCg-R transform to the obtained first reconstructed residual and the obtained second reconstructed residual, to obtain a transform residual; and

third obtaining code configured to cause the at least one processor to obtain a color attribute of a point of a point cloud by decoding the transform residual,

wherein the backward YCoCg-R transform is expressed by:

t=Y −( Cg>> 1)

G=Cg+t

B=t −( Co>> 1)

R=B+Co

where Y is a luma value, Co is a chrominance orange value, Cg is a chrominance green value, R is a red value, G is a green value, and B is a blue value.

12. The apparatus of claim 11 , further comprising determining code configured to cause the at least one processor to determine whether to apply the backward YCoCg-R transform, based on a conditional check.

13. A non-transitory computer-readable storage medium storing instructions that cause at least one processor to:

obtain a first reconstructed residual from video data;

obtain a quantization index of a second reconstructed residual;

obtain the second reconstructed residual from the video data, based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual;

obtain a color attribute of a point of a point cloud by decoding the obtained second reconstructed residual or decoding a transform residual based on the obtained second reconstructed residual; and

determine whether to obtain the second reconstructed residual based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual, based on a conditional check.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the instructions further cause the at least one processor to entropy decode a coded version of the quantization index of the second reconstructed residual to obtain the quantization index of the second reconstructed residual.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the instructions further cause the at least one processor to:

inverse quantize the obtained quantization index;

add the inverse quantized quantization index to the obtained first reconstructed residual, to obtain the second reconstructed residual.

16. A non-transitory computer-readable storage medium storing instructions that cause at least one processor to:

obtain a first reconstructed residual from video data;

obtain a quantization index of a second reconstructed residual;

obtain the second reconstructed residual from the video data, based on the obtained quantization index of the second reconstructed residual and the obtained first reconstructed residual; and

to apply a backward YCoCg-R transform to the obtained first reconstructed residual and the obtained second reconstructed residual, to obtain the transform value; and

obtain a color attribute of a point of a point cloud by decoding the transform residual,

wherein the backward YCoCg-R transform is expressed by:

t=Y −( Cg>> 1)

G=Cg+t

B=t −( Co>> 1)

R=B+Co

where Y is a luma value, Co is a chrominance orange value, Cg is a chrominance green value, R is a red value, G is a green value, and B is a blue value, and

the color attribute of the point of the point cloud is obtained by decoding the transform residual.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions further cause the at least one processor to determine whether to apply the backward YCoCg-R transform, based on a conditional check.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2020
From: YEA, SEHOON; VOSOUGHI, ARASH; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 053100/0091 →
Continuity (2)
Provisional Application 62871081 · Jul 5, 2019
Related Publication 20210006765A1 · Jan 7, 2021
Cited By (5)
US 12,219,141 US 12,262,013 US 12,289,450 US 12,406,404 US 12,684,126