IP Library › Granted Patent US 12,563,191
Granted Patent B2
US 12,563,191 · App. 18/905,627 · Granted Feb 24, 2026

Cross-component sample offset

Inventors: Yixin Du (Los Altos, CA); Xin Zhao (San Jose, CA); Shan Liu (San Jose, CA)
Assignee: Tencent America LLC
H04N19/117H04N19/124H04N19/132H04N19/186H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,563,191
App. No.
18/905,627
Granted
Feb 24, 2026
Kind
B2
Abstract

In a method for filtering in video decoding, a first combination of filter tap values is determined based on reconstructed sample values of reconstructed samples of a first color component within a filter support region. Based on a lookup table (LUT) indicating a mapping that associates offset values with different combinations of filter tap values, a first offset value of the offset values in the mapping that is associated with the first combination of filter tap values is determined. The first offset value on a to-be filtered sample of a second color component in the filter support region is applied to determine a filtered sample of the second color component.

Claims (65)

1 . A method for filtering in video decoding, the method comprising:

determining a first combination of filter tap values based on reconstructed sample values of reconstructed samples of a first color component within a filter support region;

determining, based on a lookup table (LUT) that includes offset values and different combinations of filter tap values that are associated with the offset values, a first offset value of the offset values that is associated with the first combination of filter tap values; and

applying the first offset value on a to-be filtered sample of a second color component in the filter support region to determine a filtered sample of the second color component.

2 . The method of claim 1 , wherein

the reconstructed samples of the first color component within the filter support region include (i) a collocated sample located at a same relative position as the to-be filtered sample of the second color component and (ii) surrounding reconstructed samples that surround the collocated sample, and

the determining the first combination of filter tap values includes:

calculating delta values that are differences between the respective surrounding reconstructed samples and the collocated sample; and

quantizing the delta values based on a quantization step size N to determine the first combination of filter tap values.

3 . The method of claim 2 , wherein for each delta value, the quantized delta value is one of −1, 0, and 1 based on a comparison of the respective delta value and the quantization step size N.

4 . The method of claim 3 , wherein

N is a positive integer, and

for each delta value,

the quantized delta value is −1 when the respective delta value<−N;

the quantized delta value is 0 when −N≤the respective delta value≤N; and

the quantized delta value is 1 when the respective delta value>N.

5 . The method of claim 4 , wherein the LUT associates the offset values with a complete domain of combinations for the reconstructed samples of the first color component within the filter support region, and the LUT includes the complete domain of combinations.

6 . The method of claim 5 , wherein

the reconstructed samples of the first color component within the filter support region include (i) a collocated sample located at a same relative position as the to-be filtered sample of the second color component and (ii) four surrounding reconstructed samples that surround the collocated sample in four respective directions, and

the complete domain of combinations in the LUT are 81 different combinations.

7 . The method of claim 1 , wherein the filter support region of the to-be filtered sample includes a sample position collocated with the to-be filtered sample of the second color component and at least two surrounding sample positions that surround the collocated sample position.

8 . The method of claim 1 , further comprising:

adding the first offset value to the to-be filtered sample of the second color component to determine an intermediate filtered sample; and

clipping the intermediate filtered sample based on a maximum value and a minimum value to determine the filtered sample value of the second color component.

9 . A method for filtering in video encoding, the method comprising:

determining a first combination of filter tap values based on reconstructed sample values of reconstructed samples of a first color component within a filter support region;

determining, based on a lookup table (LUT) that includes offset values and different combinations of filter tap values that are associated with the offset values, a first offset value of the offset values that is associated with the first combination of filter tap values; and

applying the first offset value on a to-be filtered sample of a second color component in the filter support region to determine a filtered sample of the second color component.

10 . The method of claim 9 , wherein

the reconstructed samples of the first color component within the filter support region include (i) a collocated sample located at a same relative position as the to-be filtered sample of the second color component and (ii) surrounding reconstructed samples that surround the collocated sample, and

the determining the first combination of filter tap values includes:

calculating delta values that are differences between the respective surrounding reconstructed samples and the collocated sample; and

quantizing the delta values based on a quantization step size N to determine the first combination of filter tap values.

11 . The method of claim 10 , wherein for each delta value, the quantized delta value is one of −1, 0, and 1 based on a comparison of the respective delta value and the quantization step size N.

12 . The method of claim 11 , wherein

N is a positive integer, and

for each delta value,

the quantized delta value is −1 when the respective delta value<−N;

the quantized delta value is 0 when −N≤the respective delta value≤N; and

the quantized delta value is 1 when the respective delta value>N.

13 . The method of claim 12 , wherein the LUT associates the offset values with a complete domain of combinations for the reconstructed samples of the first color component within the filter support region, and the LUT includes the complete domain of combinations.

14 . The method of claim 13 , wherein

the reconstructed samples of the first color component within the filter support region include (i) a collocated sample located at a same relative position as the to-be filtered sample of the second color component and (ii) four surrounding reconstructed samples that surround the collocated sample in four respective directions, and

the complete domain of combinations in the LUT are 81 different combinations.

15 . The method of claim 9 , wherein the filter support region of the to-be filtered sample includes a sample position collocated with the to-be filtered sample of the second color component and at least two surrounding sample positions that surround the collocated sample position.

16 . The method of claim 9 , further comprising:

adding the first offset value to the to-be filtered sample of the second color component to determine an intermediate filtered sample; and

clipping the intermediate filtered sample based on a maximum value and a minimum value to determine the filtered sample value of the second color component.

17 . A non-transitory computer-readable storage medium storing instructions which when executed by a processor cause the processor to perform a method of encoding a bitstream comprising:

determining a first combination of filter tap values based on reconstructed sample values of reconstructed samples of a first color component within a filter support region;

determining, based on a lookup table (LUT) that includes offset values and different combinations of filter tap values that are associated with the offset values, a first offset value of the offset values that is associated with the first combination of filter tap values;

applying the first offset value on a to-be filtered sample of a second color component in the filter support region to determine a filtered sample of the second color component; and

encoding and transmitting the bitstream indicating the filtered sample.

18 . The method of claim 17 , wherein

the reconstructed samples of the first color component within the filter support region include (i) a collocated sample located at a same relative position as the to-be filtered sample of the second color component and (ii) surrounding reconstructed samples that surround the collocated sample, and

the determining the first combination of filter tap values includes:

calculating delta values that are differences between the respective surrounding reconstructed samples and the collocated sample; and

quantizing the delta values based on a quantization step size N to determine the first combination of filter tap values.

19 . The method of claim 18 , wherein for each delta value, the quantized delta value is one of −1, 0, and 1 based on a comparison of the respective delta value and the quantization step size N.

20 . The method of claim 19 , wherein

N is a positive integer, and

for each delta value,

the quantized delta value is −1 when the respective delta value<−N;

the quantized delta value is 0 when −N≤the respective delta value≤N; and

the quantized delta value is 1 when the respective delta value>N.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2024
From: DU, YIXIN; ZHAO, XIN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 068784/0400 →
Continuity (5)
Continuation 17993538 · Nov 23, 2022
Continuation 17240812 · Apr 26, 2021
Provisional Application 63121081 · Dec 3, 2020
Provisional Application 63086548 · Oct 1, 2020
Related Publication 20250030850A1 · Jan 23, 2025
References Cited (36)
US 11595644B2 · Du et al. · 2023 [cited by applicant]
US 12143579B2 · Du et al. · 2024 [cited by applicant]
US 20130114696A1 · Liu · 2013 [cited by applicant]
US 20140301487A1 · Laroche et al. · 2014 [cited by applicant]
US 20140355667A1 · Lei et al. · 2014 [cited by applicant]
US 20150049821A1 · Chen et al. · 2015 [cited by applicant]
US 20150350652A1 · Nellore et al. · 2015 [cited by applicant]
US 20160127747A1 · Hsiang et al. · 2016 [cited by applicant]
US 20180063527A1 · Chen · 2018 [cited by examiner]
US 20190246128A1 · Xu et al. · 2019 [cited by applicant]
US 20200236355A1 · Zhao et al. · 2020 [cited by applicant]
US 20210368171A1 · Zhang et al. · 2021 [cited by applicant]
US 20220150490A1 · Kuo · 2022 [cited by examiner]
JP H06195206A · 1994 [cited by applicant]
JP H1103210A · 1999 [cited by applicant]
JP 2013138395A · 2013 [cited by applicant]
JP 2015181308A · 2015 [cited by applicant]
JP 2016201824A · 2016 [cited by applicant]
JP 2017112637A · 2017 [cited by applicant]
WO 2005122588A1 · 2005 [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1 /SC 29/WG 11, JVET-K1001-v6, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018 (140 pages). [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1 /SC 29/WG 11, JVET-O2001-vE, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019 (461 pages). [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1 /SC 29/WG 11, JVET-P2001-vE, 16th Meeting: Geneva, CH, Oct. 1-11, 2019 (494 pages). [cited by applicant]
Chia-Yang Tsai et al., “TE10 Subtest2: Coding Unit Synchronous Picture Quadtree-based Adaptive Loop Filter”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-C143, 3r… [cited by applicant]
Debargha Mukherjee et al., “A Switchable Loop-Restoration with Side-Information Framework for the Emerging AV1 Video Codec”, IEEE, 2017 (5 pages). [cited by applicant]
Extended European Search Report and Search Opinion received for European Application No. 21876146.8, mailed on Dec. 5, 2022, 11 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2021/034559, mailed on Aug. 31, 2021, 10 pages. [cited by applicant]
Jonathan Taquet et al., “CE5: Results of tests CE5-3.1 to CE5-3.4 on Non-Linear Adaptive Loop Filter.”, Joint Video Experts Team (JVET) of Itu-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0242, 14th Meeting: Geneva… [cited by applicant]
Kiran Misra et al., “CE5-related: On the design of CC-ALF”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P1008-v2, 16th Meeting: Geneva, CH, Oct. 1-11, 2019 (6 pages). [cited by applicant]
Misra et al., “Cross-Component Adaptive Loop Filter for chroma”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, JVET-O0636, No. m48779, XP030222219, Jul. … [cited by applicant]
Office Action received for Japanese Patent Application No. 2022-539317, mailed on Mar. 26, 2024, 11 pages (7 pages of English Translation and 4 pages of Original Document). [cited by applicant]
Office Action received for Japanese Patent Application No. 2022-539317, mailed on Oct. 3, 2022, 13 pages (8 pages of English Translation and 5 pages of Original Document). [cited by applicant]
Steinar Midtskogen et al., “The AV1 Constrained Directional Enhancement Filter (CDEF)”, Oct. 28, 2017 (5 pages). [cited by applicant]
Thomas J. Daede et al.,“Daala: A Perceptually-Driven Next Generation Video Codec”, Mar. 10, 2016 (10 pages). [cited by applicant]
Tsung-Chuan et al., “CE5-related: Joint clip operation for CCALF and chroma ALF,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, Document:… [cited by applicant]
Ma et al., “CE5-related: Joint clip operation for CCALF and chroma ALF”, Joint Experts Team (JVET) of ITU-T 2 SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, Document: JVET-00494, … [cited by applicant]