IP Library › Granted Patent US 11,523,138
Granted Patent B2
US 11,523,138 · App. 17/214,126 · Granted Dec 6, 2022

Method and apparatus for cross component filtering

Inventors: Mohammed Golam Sarwer (Cupertino, CA); Jiancong Luo (Skillman, NJ); Yan Ye (San Diego, CA)
Assignee: Alibaba Group Holding Limited
H04N19/82H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,523,138
App. No.
17/214,126
Granted
Dec 6, 2022
Kind
B2
Abstract

Methods and apparatuses for video processing include: filtering a luma sample using a first filter in a video coding process, the first filter being represented as a cross shape; filtering a chroma sample associated with the luma sample using a second filter in the video coding process; determining, based on the filtered luma sample, a residual correction value corresponding to the chroma sample; and determining a corrected chroma sample based on the residual correction value and the filtered chroma sample.

Claims (45)

1. A non-transitory computer-readable medium storing a set of instructions that is executable by at least one processor of an apparatus to cause the apparatus to perform a method, the method comprising:

filtering a luma sample using a first filter in a video coding process, wherein the first filter is an N-tap X×Y cross-shape loop filter, wherein N, X, and Y are integers, and the first filter has a total of N-taps where N=X+Y−1;

filtering a chroma sample associated with the luma sample using a second filter in the video coding process;

determining, based on the filtered luma sample, a residual correction value corresponding to the chroma sample; and

determining a corrected chroma sample based on the residual correction value and the filtered chroma sample.

2. The non-transitory computer-readable medium of claim 1 , wherein the first filter is one of an 8-tap 5×4 cross-shape loop filter, a 9-tap 5×5 cross-shape loop filter, a 13-tap 7×7 cross-shape loop filter, a 7-tap 5×3 cross-shape loop filter, a 7-tap 3×5 cross-shape loop filter, or a 17-tap 9×9 cross-shape loop filter.

3. The non-transitory computer-readable medium of claim 1 , wherein the set of instructions that is executable by the at least one processor of the apparatus causes the apparatus to further perform:

receiving a parameter from a parameter set associated with the luma sample;

in response to the parameter having a first value, determining that the chroma sample is not vertically shifted from the luma sample; and

in response to the parameter having a second value, determining that the chroma sample is vertically shifted from the luma sample for a distance.

4. The non-transitory computer-readable medium of claim 3 , wherein filtering the luma sample using the first filter in the video coding process comprises:

in response to determining that the chroma sample is vertically shifted from the luma sample, filtering the luma sample using a non-cross-shape filter; and

in response to determining that the chroma sample is not vertically shifted from the luma sample, filtering the luma sample using the first filter.

5. The non-transitory computer-readable medium of claim 4 , wherein the non-cross-shape filter is an 8-tap hexagon-shape loop filter, and the first filter is one of a 7-tap 5×3 cross-shape loop filter or an 8-tap 5×4 cross-shape loop filter.

6. The non-transitory computer-readable medium of claim 1 , wherein a shifting parameter value of the first filter is the same as a shifting parameter value of the second filter.

7. The non-transitory computer-readable medium of claim 6 , wherein the shifting parameter value of the first filter is 10.

8. The non-transitory computer-readable medium of claim 6 , wherein the first filter comprises N first clipping operation, the second filter comprises N second clipping operation, and N is an integer greater than or equal to one.

9. The non-transitory computer-readable medium of claim 1 , wherein the first filter comprises N first clipping operation, the second filter comprises N second clipping operation, and N is an integer greater than or equal to one.

10. The non-transitory computer-readable medium of claim 9 , wherein N is equal to one.

11. The non-transitory computer-readable medium of claim 1 , wherein the first filter is a cross component adaptive loop filter (CCALF), and the second filter is an adaptive loop filter (ALF).

12. An apparatus, comprising:

a memory configured to store a set of instructions; and

one or more processors communicatively coupled to the memory and configured to execute the set of instructions to cause the apparatus to perform:

filtering a luma sample using a first filter in a video coding process, wherein the first filter is an N-tap X×Y cross-shape loop filter,

wherein N, X, and Y are integers, and the first filter has a total of N-taps where N=X+Y−1;

filtering a chroma sample associated with the luma sample using a second filter in the video coding process;

determining, based on the filtered luma sample, a residual correction value corresponding to the chroma sample; and

determining a corrected chroma sample based on the residual correction value and the filtered chroma sample.

13. The apparatus of claim 12 , wherein the first filter is one of an 8-tap 5×4 cross-shape loop filter, a 9-tap 5×5 cross-shape loop filter, a 13-tap 7×7 cross-shape loop filter, a 7-tap 5×3 cross-shape loop filter, a 7-tap 3×5 cross-shape loop filter, or a 17-tap 9×9 cross-shape loop filter.

14. The apparatus of claim 12 , wherein the one or more processors are further configured to execute the set of instructions to cause the apparatus to perform:

receiving a parameter from a parameter set associated with the luma sample;

in response to the parameter having a first value, determining that the chroma sample is not vertically shifted from the luma sample; and

in response to the parameter having a second value, determining that the chroma sample is vertically shifted from the luma sample for a distance.

15. The apparatus of claim 14 , wherein filtering the luma sample using the first filter in the video coding process comprises:

in response to determining that the chroma sample is vertically shifted from the luma sample, filtering the luma sample using a non-cross-shape filter; and

in response to determining that the chroma sample is not vertically shifted from the luma sample, filtering the luma sample using the first filter.

16. The apparatus of claim 15 , wherein the non-cross-shape filter is an 8-tap hexagon-shape loop filter, and the first filter is one of a 7-tap 5×3 cross-shape loop filter or an 8-tap 5×4 cross-shape loop filter.

17. The apparatus of claim 12 , wherein a shifting parameter value of the first filter is the same as a shifting parameter value of the second filter.

18. The apparatus of claim 17 , wherein the first filter comprises N first clipping operation, the second filter comprises N second clipping operation, and N is an integer greater than or equal to one.

19. The apparatus of claim 12 , wherein the first filter comprises N first clipping operation, the second filter comprises N second clipping operation, and N is an integer greater than or equal to one.

20. A computer-implemented method, comprising:

filtering a luma sample using a first filter in a video coding process, wherein the first filter is an N-tap X×Y cross-shape loop filter, wherein N, X, and Y are integers, and the first filter has a total of N-taps where N=X+Y−1;

filtering a chroma sample associated with the luma sample using a second filter in the video coding process;

determining, based on the filtered luma sample, a residual correction value corresponding to the chroma sample; and

determining a corrected chroma sample based on the residual correction value and the filtered chroma sample.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: LUO, JIANCONG
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 056411/0701 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2021
From: SARWER, MOHAMMED GOLAM; YE, YAN; LUO, JIANCONG
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 056140/0202 →
Continuity (2)
Provisional Application 63000451 · Mar 26, 2020
Related Publication 20210306673A1 · Sep 30, 2021