IP Library › Granted Patent US 12,278,978
Granted Patent B2
US 12,278,978 · App. 18/641,136 · Granted Apr 15, 2025

Adaptive quantization step size in CCSO filtering

Inventors: Yixin Du (Los Altos, CA); Xin Zhao (San Jose, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/44H04N19/117H04N19/124H04N19/132H04N19/176H04N19/186H04N19/30H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,278,978
App. No.
18/641,136
Granted
Apr 15, 2025
Kind
B2
Abstract

Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that determines reconstructed samples of a first color component in a filter support region of a current picture that is a part of a coded video sequence. The processing circuitry performs a filter process on the reconstructed samples of the first color component in the filter support region. A quantization step size of the filter process is separately set per one of a coding block, a video frame, and a video sequence. The processing circuitry reconstructs samples of a second color component in the filter support region based on an output value of the filter process. The second color component is different from the first color component.

Claims (35)

1. A method of video encoding, comprising:

determining reconstructed samples of a first color component in a filter support region of a current block;

determining a quantization step size of a cross-component sample offset (CCSO) filter corresponding to the filter support region, wherein the quantization step size is separately set for each coding block, each video frame, or each video sequence; and

generating a coded video bitstream by encoding the current block and by signaling the determined quantization step size in the coded video bitstream.

2. The method of claim 1 , wherein an offset value determined by the CCSO filter is scaled based on difference values between a center reconstructed sample of the first color component of the filter support region and each of plural surrounding reconstructed samples of the first color component of the filter support region.

3. The method of claim 1 , wherein an offset value determined by the CCSO filter is scaled based on the determined quantization step size of the CCSO filter.

4. The method of claim 3 , wherein the scaling the offset value includes scaling the offset value based on a ratio of (i) an average of absolute values of difference values between a center reconstructed sample of the first color component of the filter support region and each of plural surrounding reconstructed samples of the first color component to (ii) the quantization step size of the CCSO filter.

5. The method of claim 4 , wherein the scaling the offset value includes scaling the offset value by max (1, the ratio).

6. The method of claim 5 , wherein each of the plural surrounding reconstructed samples of the first color component used to calculate the difference values has a non-zero value.

7. The method of claim 1 , further comprising including, in the coded video bitstream, a syntax element indicating whether scaling an offset value determined by the CCSO filter is enabled.

8. The method of claim 7 , wherein the syntax element is signaled for one of: each block, each frame, each slice, each tile, each coding tree unit (CTU), or each sequence.

9. An apparatus for video decoding, comprising:

processing circuitry configured to

determine reconstructed samples of a first color component in a filter support region of a current block;

determine a quantization step size of a cross-component sample offset (CCSO) filter corresponding to the filter support region, wherein the quantization step size is separately set for each coding block, each video frame, or each video sequence;

apply the CCSO filter to the reconstructed samples of the first color component in the filter support region, the CCSO filter having the determined quantization step size; and

reconstruct samples of a second color component in the filter support region based on an output of the CCSO filter.

10. The apparatus of claim 9 , wherein the processing circuitry is further configured to scale an offset value determined by the CCSO filter based on difference values between a center reconstructed sample of the first color component of the filter support region and each of plural surrounding reconstructed samples of the first color component of the filter support region.

11. The apparatus of claim 9 , wherein the processing circuitry is further configured to scale an offset value determined by the CCSO filter based on the determined quantization step size of the CCSO filter.

12. The apparatus of claim 11 , wherein the processing circuitry is further configured to scale the offset value based on a ratio of (i) an average of absolute values of difference values between a center reconstructed sample of the first color component of the filter support region and each of plural surrounding reconstructed samples of the first color component to (ii) the quantization step size of the CCSO filter.

13. The apparatus of claim 12 , wherein the processing circuitry is further configured to scale the offset value by max (1, the ratio).

14. The apparatus of claim 13 , wherein each of the plural surrounding reconstructed samples of the first color component used to calculate the difference values has a non-zero value.

15. The apparatus of claim 9 , wherein the processing circuitry is further configured to:

determine whether to scale an offset value determined by the CCSO filter based on a syntax element indicating whether scaling the offset value of the CCSO filter is enabled.

16. The apparatus of claim 15 , wherein the syntax element is signaled for one of: each block, each frame, each slice, each tile, each coding tree unit (CTU), or each sequence.

17. A method of processing visual media data, the method comprising:

processing a bitstream of the visual media data according to a format rule, wherein

the bitstream includes coded information of a current block,

the format rule specifies that reconstructed samples of a first color component in a filter support region of the current block are determined;

the format rule specifies that a quantization step size of a cross-component sample offset (CCSO) filter corresponding to the filter support region is determined, wherein the quantization step size is separately set for each coding block, each video frame, or each video sequence;

the format rule specifies that the CCSO filter is applied to the reconstructed samples of the first color component in the filter support region, the CCSO filter having the determined quantization step size; and

the format rule specifies that samples of a second color component in the filter support region are reconstructed from the bitstream based on an output of the CCSO filter.

18. The method of claim 17 , wherein an offset value determined by the CCSO filter is scaled based on difference values between a center reconstructed sample of the first color component of the filter support region and each of plural surrounding reconstructed samples of the first color component of the filter support region.

19. The method of claim 17 , wherein an offset value determined by the CCSO filter is scaled based on the determined quantization step size of the CCSO filter.

20. The method of claim 19 , wherein the scaling the offset value includes scaling the offset value based on a ratio of (i) an average of absolute values of difference values between a center reconstructed sample of the first color component of the filter support region and each of plural surrounding reconstructed samples of the first color component to (ii) the quantization step size of the CCSO filter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2024
From: DU, YIXIN; ZHAO, XIN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 068227/0755 →
Continuity (4)
Continuation 18070315 · Nov 28, 2022
Continuation 17360865 · Jun 28, 2021
Provisional Application 63113125 · Nov 12, 2020
Related Publication 20240267548A1 · Aug 8, 2024
References Cited (27)
US 5923376A · Pullen · 1999 [cited by examiner]
US 20180063527A1 · Chen · 2018 [cited by examiner]
US 20200037003A1 · Kang · 2020 [cited by examiner]
US 20210044834A1 · Li · 2021 [cited by examiner]
US 20210385498A1 · Zhang · 2021 [cited by examiner]
US 20220248006A1 · Lim · 2022 [cited by examiner]
JP H04273687A · 1992 [cited by applicant]
JP 2007506293A · 2007 [cited by applicant]
JP 2017512439A · 2017 [cited by applicant]
WO 2020216175A1 · 2020 [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Document: JVTE-O2001-vE, 461 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, Document: JVTE-P2001-vE, 492 pages. [cited by applicant]
Chen J et al: “Algorithm description for Versatile Video Coding and Test Model 10 (VTM 10)”, 19. JVET Meeting; Jun. 22, 2020-Jul. 1, 2020; Teleconference; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and … [cited by applicant]
Daede et al., “A Perceptually-Driven Next Generation Video Codec,” arXiv:1603.03129v1 [cs.MM], Mar. 10, 2016, 10 pages. [cited by applicant]
International Search Report dated Oct. 5, 2021 in Application No. PCT/US2021/040044, pp. 1-11. [cited by applicant]
Japanese Office Action issued Sep. 26, 2023 in Application No. 2022-550942, p. 1-14. [cited by applicant]
Jonathan Taquet, et al., CE5: Results of tests CE5-3.1 to CE5-3.4 on Non-Linear Adaptive Loop Filter, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14 Meeting: Geneva, CH, Mar. 19-27… [cited by applicant]
K. Misra, et al., CE5-related: On the design of CC-ALF, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16.SUP.th .Meeting: Geneva, CH, Oct. 1-11, 2019, Document JVET-P1008-v2, 6 pgs. [cited by applicant]
Kiran Misra, et al., Cross-Component Adaptive Loop Filter for chroma, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1 /SC 29/WG/11, 15.SUP.th .Meeting: Gothenburg, SE, Jul. 3-12, 2019, Document JVE… [cited by applicant]
Midtskogen et al., “The AV1 Constrained Directional Enhancement Filter (CDEF),” arXiv:1602.05975v3 [cs.MM], Oct. 28, 2017, 5 pages. [cited by applicant]
Misra et al., “Cross-Component Adaptive Loop Filter for chroma”, 127. MPEG Meeting; Jul. 8, 2019-Jul. 12, 2019; Gothenburg; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. m48779, Jun. 26, 2019, pp. 1-16. [cited by applicant]
Misra K et al: “Cross-Component Adaptive Loop Filter for chroma”, 15. JVET Meeting; Jul. 3, 2019-Jul. 12, 2019; Gothenburg; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16 ), No. JVET-O0636 … [cited by applicant]
Misra Kiran et al: “On Cross Component Adaptive Loop Filter for Video Compression”, 2019 Picture Coding Symposium (PCS), IEEE, Nov. 12, 2019, pp. 1-5. [cited by applicant]
Mukherjee et al., “A Switchable loop-restoration with side-information framework for the emerging AV1 video codec,” IEEE International Conference on Image Processing (ICIP), Sep. 17-20, 2017, pp. 265-269. [cited by applicant]
Supplementary European Search Report issued Jan. 3, 2023 in Application No. 21892503.0, p. 1-11. [cited by applicant]
Taquet et al., “CE5: Results of test CE5-3.1 to CE5-3.4 on Non-Linear Adaptive Loop Filter.” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019,… [cited by applicant]
Tsai et al., “TE10 Subtest2: Coding Unit Synchronous Picture Quadtree-based Adaptive Loop Filter,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Guangz… [cited by applicant]