IP Library Granted Patent US 11,095,921
Granted Patent B2
US 11,095,921 · App. 16/523,258 · Granted Aug 17, 2021

Method and apparatus for video encoding or decoding

Inventors: Liang Zhao (Sunnyvale, CA); Xin Zhao (San Diego, CA); Xiang Li (Los Gatos, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/80H04N19/105H04N19/117H04N19/124H04N19/132H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,095,921
App. No.
16/523,258
Granted
Aug 17, 2021
Kind
B2
Abstract

A method and apparatus for encoding or decoding a video sequence includes applying a Cross-Component Linear Model (CCLM) to a video sequence, and applying an interpolation filter in the Cross-Component Linear Model (CCLM), wherein the interpolation filter is dependent upon a YUV format of the video sequence.

Claims (51)

1. A method for encoding or decoding a video sequence, the method comprising:

applying a Cross-Component Linear Model (CCLM) to a video sequence, and

applying an interpolation filter in the Cross-Component Linear Model (CCLM),

obtaining an absolute difference between maximum and minimum values of a plurality of neighboring samples of a first one among a luma block and related to the video sequence;

dividing the obtained absolute difference into intervals;

performing a non-uniform quantization of the obtained absolute difference;

obtaining a floor value by using, in a look-up table, the absolute difference of which the non-uniform quantization is performed;

obtaining a derived value by using the absolute difference, the intervals, and different step sizes based on the look-up table, and

predicting a sample of a different one among a chroma block related to the video sequence, based on the value

wherein the interpolation filter is dependent upon a YUV format of the video sequence.

2. The method of claim 1 , wherein in applying the interpolation filter in the Cross-Component Linear Model (CCLM), the method further comprises using taps of the interpolation filter that are dependent upon the YUV format of the video sequence.

3. The method of claim 2 , wherein the method further comprises using taps of the interpolation filter used in the Cross-Component Linear Model (CCLM) that are in the same form as the YUV format of the video sequence.

4. The method of claim 1 , wherein applying the interpolation filter in the Cross-Component Linear Model (CCLM), the method further comprises setting the format of the interpolation filter to be the same for the format of the video sequence when the video sequence includes a YUV format of 4:4:4: or 4:2:2, and setting the format of the interpolation filter to be different than the format of the video sequence when the video sequence includes a YUV format of 4:2:0.

5. The method of claim 1 , wherein in applying the interpolation filter in the Cross-Component Linear Model (CCLM), the method further comprises using taps of the interpolation filter which are different for different YUV formats of the video sequence.

6. The method of claim 1 , wherein in applying the interpolation filter in the Cross-Component Linear Model (CCLM), the method further comprises setting the interpolation filter to be different for top and left neighboring luma reconstructed samples.

7. The method of claim 6 , wherein the method further comprises setting the interpolation filter, which is applied to the top and left neighboring luma reconstructed samples to be dependent on the YUV format of the video sequence.

8. The method of claim 1 , wherein the method further comprises setting a number of lines in top neighboring luma samples and a number of columns in left neighboring luma samples used in the Cross-Component Linear Model (CCLM) to be dependent on the YUV format of the video sequence.

9. The method of claim 8 , the method further comprising using at least one of one row in a top neighboring region and one column in a left neighboring region in the Cross-Component Linear Model (CCLM) for video sequences having one of a YUV format of 4:4:4 or 4:2:2.

10. The method of claim 8 , the method further comprises using at least one of one row in a top neighboring region and at least two columns in a left neighboring region in the Cross-Component Linear Model (CCLM) for video sequences having a YUV format of 4:2:2.

11. The method of claim 1 , further comprising obtaining the maximum and minimum values, using N neighboring sample pairs of the luma block and the chroma block, N being a positive integer of one among 4, 8 and 16,

wherein each of the N neighboring sample pairs comprises a first neighboring sample at a first location neighboring the first one among the luma block and the chroma block, and a second neighboring sample at a second location neighboring the second one among the luma block and the chroma block and corresponding to the first location neighboring the first one among the luma block and the chroma block.

12. The method of claim 11 , further comprising selecting the first neighboring sample by scanning the plurality of neighboring samples from bottom to top and/or from right to left.

13. The method of claim 1 , further comprising:

obtaining a scaling factor and an offset of a linear model for local illumination compensation (LIC) of a current block, using N neighboring sample pairs of the current block and a reference block, N being a positive integer of one among 4, 8 and 16,

wherein each of the N neighboring sample pairs comprises a first neighboring sample at a first location neighboring the current block, and a second neighboring sample at a second location neighboring the reference block and corresponding to the first location neighboring the current block; and

performing the LIC of the current block, using the obtained scaling factor and the obtained offset.

14. The method of claim 13 , wherein N is dependent on a block size of the current block.

15. A device for encoding or decoding a video sequence, the device comprising:

at least one memory configured to store program code;

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

first encoding or decoding code configured to cause the at least one processor to apply a Cross-Component Linear Model (CCLM) to a video sequence and apply an interpolation filter in the Cross-Component Linear Model (CCLM),

first obtaining code configured to cause the at least one processor to obtain an absolute difference between maximum and minimum values of a plurality of neighboring samples of a first one among a luma block and related to the video sequence;

performing code configured to cause the at least one processor to perform a non- uniform quantization of the obtained absolute difference;

second obtaining code configured to cause the at least one processor to obtain a floor value by using, in a look-up table, the absolute difference of which the non-uniform quantization is performed;

predicting code configured to cause the at least one processor to predict a sample of a different one among a chroma block related to the video sequence, based on the obtained floor value

first dividing code configured to cause the at least one processor to divide the obtained absolute difference into intervals; and

second dividing code configured to cause the at least one processor to divide the intervals respectively by different step sizes,

wherein the interpolation filter is dependent upon a YUV format of the video sequence, and

wherein the second obtaining code is configured to cause the at least one processor to obtain the floor value by using, in the look-up table, the intervals respectively divided by the different step sizes.

16. The device of claim 15 , wherein the first encoding or decoding code further comprises code configured to cause the at least one processor to use taps of the interpolation filter applied, in the Cross-Component Linear Model (CCLM), that are dependent upon the YUV format of the video sequence.

17. The device of claim 15 , wherein the first encoding or decoding code further comprises code configured to cause the at least one processor to set the format of the interpolation filter, applied in the Cross-Component Linear Model (CCLM), to be the same for the format of the video sequence when the video sequence includes a YUV format of 4:4:4: or 4:2:2, and set the format of the interpolation filter to be different than the format of the video sequence when the video sequence includes a YUV format of 4:2:0.

18. A non-transitory computer-readable medium storing program code, the program code comprising one or more instructions that, when executed by one or more processors of a device, cause the one or more processors to:

apply a Cross-Component Linear Model (CCLM) to a video sequence and apply an interpolation filter in the Cross-Component Linear Model (CCLM),

obtain an absolute difference between maximum and minimum values of a plurality of neighboring samples of a first one among a luma block and related to the video sequence;

perform a non-uniform quantization of the obtained absolute difference;

obtain a floor value by using, in a look-up table, the absolute difference of which the non-uniform quantization is performed;

predict a sample of a different one among a chroma block related to the video sequence, based on the obtained floor value

divide the obtained absolute difference into intervals; and

divide the intervals respectively by different step sizes,

wherein the interpolation filter is dependent upon a YUV format of the video sequence, and

wherein the floor value is obtained by using, in the look-up table, the intervals respectively divided by the different step sizes.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: ZHAO, LIANG
To: TENCENT AMERICA LLC
Reel/Frame 053872/0138 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: ZHAO, XIN
To: TENCENT AMERICA LLC
Reel/Frame 053872/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: LI, XIANG
To: TENCENT AMERICA LLC
Reel/Frame 053872/0432 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 053872/0749 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 26, 2019
From: ZHAO, LIANG; ZHAO, XIN; LI, XIANG; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 049873/0269 →
Continuity (5)
Provisional Application 62789992 · Jan 8, 2019
Provisional Application 62788729 · Jan 4, 2019
Provisional Application 62785678 · Dec 27, 2018
Provisional Application 62781316 · Dec 18, 2018
Related Publication 20200195976A1 · Jun 18, 2020