IP Library › Granted Patent US 12,627,796
Granted Patent B2
US 12,627,796 · App. 18/466,603 · Granted May 12, 2026

Adaptive cross-component sample offset filtering parameters

Inventors: Xin Zhao (San Jose, CA); Samruddhi Yashwant Kahu (Laguna Hills, CA); Shan Liu (San Jose, CA)
Assignee: Tencent America LLC
H04N19/117H04N19/124H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,627,796
App. No.
18/466,603
Granted
May 12, 2026
Kind
B2
Abstract

This disclosure describes a set of advanced video coding technologies and is particular related to cross-component sample offset (CCSO) filtering of reconstructed samples. For example, CCSO filter parameters may be allowed to vary from a filtering unit to another filtering unit. A filtering unit may be a filtering block or a filtering region containing multiple spatially adjacent filtering blocks in a reconstructed frame. Corresponding allowed options of CCSO filter parameter combinations may be specified. Each filtering unit may select from the allowed combination options. The selected combination options may be signaled in the bitstream or derived in some other manners. Allowing such CCSO filter parameter variation within a frame may provide filtering quality gain that outweighs a cost of overhead in signaling.

Claims (40)

1 . A method for in-loop filtering of a video bitstream, comprising:

reconstructing a frame from the video bitstream to generate reconstructed samples of at least a first color component and a second color component;

selecting, for a filtering unit at a level lower than the reconstructed frame, a combination of cross-component sample offset (CCSO) filtering parameters among a plurality of predefined candidate combinations of CCSO filtering parameters for the filtering unit in the reconstructed frame, each combination of the plurality of predefined candidate combinations of CCSO filtering parameters comprises a plurality of filtering parameters with specific parameter values;

determining a CCSO filter according to the selected combination of CCSO filtering parameters; and

applying the CCSO filter to the reconstructed samples of the first color component in the filtering unit to generate offsets to apply to the reconstructed samples of the second color component in the filtering unit.

2 . The method of claim 1 , wherein each of the plurality of predefined candidate combinations of CCSO filtering parameters comprise:

a filter shape parameter indicating a number of CCSO filter taps and tap positions;

a quantization step size for discretizing cross component tap-to-sample deltas; and

a number of bands indicating a number of sample amplitude bands within an allowed range of sample values.

3 . The method of claim 2 , wherein the plurality of predefined candidate combinations of CCSO filtering parameters consist of four candidate combinations.

4 . The method of claim 3 , wherein the four candidate combinations differ in both the filter shape parameter and the number of bands.

5 . Method of claim 3 , wherein the four candidate combinations share a same filter shape parameter.

6 . The method of claim 3 , wherein the four candidate combinations share a same quantization step size.

7 . The method of claim 2 , wherein the combination of CCSO filtering parameter among the plurality of predefined candidate combinations of CCSO filtering parameters is selected according to a syntax element explicitly signaled in the video bitstream.

8 . The method of claim 2 , wherein the CCSO filter comprises a CCSO lookup table for determining cross component sample offsets for the filtering unit.

9 . The method of claim 8 , wherein each of the plurality of predefined candidate combinations of CCSO filtering parameters is associated with at least one CCSO lookup table.

10 . The method of claim 9 , wherein CCSO lookup table for each of the plurality of predefined candidate combinations of CCSO filtering parameters is signaled in the video bitstream.

11 . The method of claim 2 , wherein the plurality of predefined candidate combinations of CCSO filtering parameters are the same among all filtering units in the reconstructed frame.

12 . The method of claim 2 , wherein the plurality of predefined candidate combinations of CCSO filtering parameters differ between at least two different filtering units in the reconstructed frame.

13 . (v) The method of claim 12 , wherein the plurality of predefined candidate combinations of CCSO filtering parameters are associated with combination set identifiers.

14 . The method of claim 13 , wherein a combination set identifier for the filtering unit to select the combination of CCSO filtering parameters is signaled in the video bitstream.

15 . The method of claim 13 , wherein the filtering unit comprises a filtering block or a filtering region comprising a plurality of spatially adjacent filtering blocks.

16 . The method of claim 2 , wherein values of CCSO filtering parameters for the plurality of predefined candidate combinations of CCSO filtering parameters are signaled in high level syntax in a sequence, frame, slice, or tile header.

17 . An electronic device comprising a memory for storing instructions and a processor for executing the instructions to:

reconstruct a frame from a video bitstream to generate reconstructed samples of at least a first color component and a second color component;

select, for a filtering unit at a level lower than the reconstructed frame, a combination of cross-component sample offset (CCSO) filtering parameters among a plurality of predefined candidate combinations of CCSO filtering parameters for the filtering unit in the reconstructed frame, each combination of the plurality of predefined candidate combinations of CCSO filtering parameters comprises a plurality of filtering parameters with specific parameter values;

determine a CCSO filter according to the selected combination of CCSO filtering parameters; and

apply the CCSO filter to the reconstructed samples of the first color component in the filtering unit to generate offsets to apply to the reconstructed samples of the second color component in the filtering unit.

18 . The electronic device of claim 17 , wherein each of the plurality of predefined candidate combinations of CCSO filtering parameters comprise:

a filter shape parameter indicating a number of CCSO filter taps and tap positions;

a quantization step size for discretizing cross component tap-to-sample deltas; and

a number of bands indicating a number of sample amplitude bands within an allowed range of sample values.

19 . The electronic device of claim 17 , wherein the combination of CCSO filtering parameter among the plurality of predefined candidate combinations of CCSO filtering parameters is selected according to a syntax element explicitly signaled in the video bitstream.

20 . A non-transitory computer-readable storage medium for storing computer instructions, wherein the computer instructions, when executed by at least one processor of an electronic device, are configured to cause the electronic device to generate a video bitstream of a video by:

reconstructing a frame post encoding to generate reconstructed samples of at least a first color component and a second color component of the frame;

selecting, for a filtering unit at a level lower than the reconstructed frame, a combination of cross-component sample offset (CCSO) filtering parameters among a plurality of predefined candidate combinations of CCSO filtering parameters for the filtering unit in the reconstructed frame, each combination of the plurality of predefined candidate combinations of CCSO filtering parameters comprises a plurality of filtering parameters with specific parameter values;

determining a CCSO filter according to the selected combination of CCSO filtering parameters;

applying the CCSO filter to the reconstructed samples of the first color component in the filtering unit to generate offsets to apply to the reconstructed samples of the second color component in the filtering unit to generate filtered second color component of the filtering unit;

using the filtered second components of the filtering unit to encode another portion of the video into the video bitstream; and

signaling the selected combination of cross component CCSO filtering parameters for the filtering unit in the video bitstream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2023
From: ZHAO, XIN; KAHU, SAMRUDDHI YASHWANT; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 064909/0856 →
Continuity (2)
Provisional Application 63447308 · Feb 21, 2023
Related Publication 20240283926A1 · Aug 22, 2024
References Cited (48)
US 11595644B2 · Du et al. · 2023 [cited by applicant]
US 11683530B2 · Du et al. · 2023 [cited by applicant]
US 20130336383A1 · Xu · 2013 [cited by applicant]
US 20170127078A1 · Kobayashi · 2017 [cited by applicant]
US 20190045186A1 · Zhang et al. · 2019 [cited by applicant]
US 20190045209A1 · Ramasubramonian · 2019 [cited by examiner]
US 20190052877A1 · Zhang · 2019 [cited by applicant]
US 20190182482A1 · Vanam et al. · 2019 [cited by applicant]
US 20210051320A1 · Tourapis · 2021 [cited by applicant]
US 20220101095A1 · Li · 2022 [cited by applicant]
US 20220109848A1 · Wang · 2022 [cited by applicant]
US 20220248007A1 · Misra · 2022 [cited by applicant]
US 20220272335A1 · Liu · 2022 [cited by applicant]
US 20220272347A1 · Zhu · 2022 [cited by applicant]
US 20220272348A1 · Zhang · 2022 [cited by applicant]
US 20220279176A1 · Sarwer · 2022 [cited by applicant]
US 20220286674A1 · Wang · 2022 [cited by applicant]
US 20220295054A1 · Zhao · 2022 [cited by examiner]
US 20220303586A1 · Du · 2022 [cited by examiner]
US 20220321919A1 · Deshpande · 2022 [cited by applicant]
US 20220337853A1 · Li · 2022 [cited by applicant]
US 20220343547A1 · Moguillansky · 2022 [cited by examiner]
US 20230143147A1 · Du · 2023 [cited by examiner]
CN 104702963B · 2017 [cited by applicant]
WO WO2015163046A1 · 2015 [cited by applicant]
WO WO2020259538A · 2020 [cited by applicant]
WO WO2022040428A1 · 2022 [cited by applicant]
Office Action issued on European Application 22760638.1 on Jun. 9, 2023, 16p. [cited by applicant]
Bross, Benjamin et al., “Working Draft 5 of Versatile Video Coding”, JVET, International Organization for Standardization, ISO/IEC JTC 1/SC29/WG11 N18370, Coding of Moving Pictures and Audio, Mar. 2019, 406p, CH. [cited by applicant]
Bhat, Madhukar et al., “AHG10: Adaptive Coding Sub-set for encoder optimization”, Input Document to JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15 [cited by applicant]
Bross, B. et al.; “Versatile Video Coding (Draft 6)”; Document: JVET-O2001-vE; Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019; 460 pages. [cited by applicant]
Bross, B. et al.; “Versatile Video Coding (Draft 7)”; Document: JVET-P2001-vE; Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019; 485 pages. [cited by applicant]
Bross, B. et al.; “Versatile Video Coding (Draft 8)”; Document: JVET-Q2001-vE; Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020; 510 pages. [cited by applicant]
Chen, Y. et al.; “An Overview of Core Coding Tools in the AV1 Video Codec”; In2018 picture coding symposium (PCS); Alliance for Open Media; Jun. 24, 2018; 5 pages. [cited by applicant]
Daede, T.J. et al.; “Daala: A Perceptually-Driven Next Generation Video Codec”; arXiv preprint arXiv: 1603.03129; Mar. 10, 2016; 10 pages. [cited by applicant]
de Rivaz, P. et al.; “AV1 Bitstream & Decoding Process Specification”; Version 1.0.0 eith Errata 1; The Alliance for Open Media; Jan. 8, 2019; 681 pages. [cited by applicant]
Du, Y. et al.; “Cross-Component Sample Offset for Image and Video Coding”; 2021 International Conference on Visual Communications and Image Processing (VCIP); IEEE; Dec. 5, 2021; 5 pages. [cited by applicant]
Midtskogen, S. et al.; “The AV1 Constrained Directional Enhancement Filter (CDEF)”; In2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); IEEE; Apr. 15, 2018; 5 pages. [cited by applicant]
Midtskogen, S. et al.; “Integrating Thor Tools into the Emerging AV1 Codec”; IEEE International Conference on Image Processing (ICIP); Sep. 17, 2017; pp. 930-933. [cited by applicant]
Misra, K. et al.; “Cross-Component Adaptive Loop Filter for Chroma”; Document: JVET-O0636_r1; Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2… [cited by applicant]
Misra, K. et al.; “CE5-related: On the design of CC-ALF”; Document: JVET-P1008-v2; Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019; 6 pages. [cited by applicant]
Mukherjee, D. et al.; “A Switchable Loop-Restoration with Side-Information Framework for the Emerging AV1 Video Codec”; In2017 IEEE International Conference on Image Processing (ICIP); IEEE; Sep. 17, 2017; pp. 265-269. [cited by applicant]
Taquet, J. et al.; “CE5: Results of Tests CE5-3.1 to CE5-3.4 on Non-Linear Adaptive Loop Filter”; Document: JVET-N0242; Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Ge… [cited by applicant]
Tsai, C-Y. et al.; “TE10 Subtest2: Coding Unit Synchronous Picture Quadtree-based Adaptive Loop Filter”; Document: JCTVC-C143; Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP3 and ISO/IEC JTC1/SC 29/… [cited by applicant]
Zhao, X. et al.; “CWG-B099: Improved CCSO with luma extension and band feature”; Jan. 11, 2022; 5 pages. [cited by applicant]
International Search Report mailed May 3, 2022 for International Application No. PCT/US2022/014255. [cited by applicant]
Written Opinion mailed May 3, 2022 for International Application No. PCT/US2022/014255. [cited by applicant]
International Search Report and Written Opinion mailed Jan.2024 for International Application No. PCT/US23/33260. [cited by applicant]