IP Library Granted Patent US 12,225,192
Granted Patent B2
US 12,225,192 · App. 17/941,738 · Granted Feb 11, 2025

Separate constrained directional enhancement filter

Inventors: Yixin Du (Los Altos, CA); Liang Zhao (Sunnyvale, CA); Xin Zhao (San Diego, CA); Shan Liu (San Diego, CA)
Assignee: TENCENT AMERICA LLC
H04N19/117H04N19/139H04N19/176H04N19/186H04N19/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,225,192
App. No.
17/941,738
Granted
Feb 11, 2025
Kind
B2
Abstract

A method, a non-transitory computer readable medium, and a computer system is provided for encoding or decoding video data. The method may include: receiving video data comprising a chroma component and a luma component; parsing, deriving or selecting a number of presets for the chroma component in one frame, and a number of presets for the luma component in the one frame; and decoding the video data. The method may further comprise: performing a separate Constrained Directional Enhancement Filter (CDEF) process of filtering luma and chroma components independent from each other based on the number of presets for the chroma component in one frame, and the number of presets for the luma component in the one frame.

Claims (39)

1. A method of video decoding, executable by one or more processors, the method comprising:

receiving video data comprising a plurality of frames, including a current frame having a chroma component and a luma component;

determining that a semi decoupled partitioning (SDP) mode is enabled for the current frame; and

in accordance with the SDP mode being enabled for the current frame:

applying a first Constrained Directional Enhancement Filter (CDEF) process to the chroma component of the current frame;

applying a second CDEF process to the luma component of the current frame, wherein the first CDEF process is different than the second CDEF process;

deriving a first number of presets for the first CDEF process and a second number of presets for the second CDEF process; and

reconstructing the current frame in accordance with the first CDEF process and the second CDEF process.

2. The method of claim 1 , wherein the first CDEF process and the second CDEF process are selected based on the chroma component having a different partitioning than the luma component.

3. The method of claim 1 , wherein a first input to the first CDEF process comprises one or more reconstructed samples of the chroma component, and wherein a second input to the second CDEF process comprises one or more reconstructed samples of the luma component.

4. The method of claim 3 , wherein the method further comprises:

deriving a filtering strength of the second CDEF process based on a size of the luma component.

5. The method of claim 1 , wherein the second number of presets is a positive integer, and the first number of presets is fixed as 1 .

6. The method of claim 1 , wherein deriving the first number of presets is separate and independent from deriving the second number of presets.

7. The method of claim 1 , wherein the method further comprises obtaining a same intermediate output for the first CDEF process and the second CDEF process.

8. The method of claim 1 , wherein the first CDEF process and the second CDEF process are selected based on a size of the luma component.

9. The method of claim 1 , wherein the first CDEF process and the second CDEF process are selected based on a size of the chroma component.

10. A method of video encoding, executable by one or more processors, the method comprising:

receiving video data comprising a plurality of frames, including a current frame having a chroma component and a luma component;

determining that a semi decoupled partitioning (SDP) mode is enabled for the current frame; and

in accordance with the SDP mode being enabled for the current frame:

selecting a first Constrained Directional Enhancement Filter (CDEF) process to the chroma component of the current frame;

selecting a second CDEF process to the luma component of the current frame, wherein the first CDEF process is different than the second CDEF process;

selecting a first number of presets for the first CDEF process and a second number of presets for the second CDEF process; and

signaling the first CDEF process and the second CDEF process in a video bitstream.

11. The method of claim 10 , wherein the first CDEF process and the second CDEF process are selected based on the chroma component having a different partitioning than the luma component.

12. The method of claim 10 , wherein a first input to the first CDEF process comprises one or more samples of the chroma component, and wherein a second input to the second CDEF process comprises one or more samples of the luma component.

13. The method of claim 10 , further comprising deriving a filtering strength of the second CDEF process based on a size of the luma component.

14. The method of claim 10 , wherein selecting the first number of presets is separate and independent from selecting the second number of presets.

15. The method of claim 10 , wherein the first CDEF process and the second CDEF process are selected based on a size of the luma component or a size of the chroma component.

16. A method of processing visual media data, the method comprising:

obtaining video data comprising a plurality of frames, including a first frame; and

performing a conversion between the video data and a bitstream of encoded video data, wherein the bitstream comprises:

a plurality of encoded frames, including an encoded first frame corresponding to the first frame;

an indication that a semi decoupled partitioning (SDP) mode is enabled for the encoded first frame;

indication of a first Constrained Directional Enhancement Filter (CDEF) process used for a chroma component of the encoded first frame; [and]

indication of a second CDEF process used for a luma component of the encoded first frame; and

indication of a first number of presets for the first CDEF process and indication of a second number of presets for the second CDEF process.

17. The method of claim 16 , wherein the first number of presets is signaled separately in the bitstream from the second number of presets.

Continuity (3)
Continuation 17091759 · Nov 6, 2020
Provisional Application 63040856 · Jun 18, 2020
Related Publication 20230016219A1 · Jan 19, 2023
References Cited (28)
US 7437013B2 · Anderson · 2008 [cited by examiner]
US 7565020B2 · Wu · 2009 [cited by examiner]
US 10652535B1 · Chen · 2020 [cited by examiner]
US 11303936B2 · Du · 2022 [cited by examiner]
US 11558631B2 · Joshi · 2023 [cited by examiner]
US 11750846B2 · Du · 2023 [cited by examiner]
US 11812065B2 · Du · 2023 [cited by examiner]
US 20070230578A1 · Shi · 2007 [cited by examiner]
US 20190045186A1 · Zhang · 2019 [cited by examiner]
US 20190052877A1 · Zhang · 2019 [cited by examiner]
US 20190052911A1 · Zhang · 2019 [cited by examiner]
US 20200162731A1 · Kim · 2020 [cited by examiner]
US 20200314452A1 · Zhang · 2020 [cited by examiner]
US 20210203929A1 · Leleannec · 2021 [cited by examiner]
US 20210329261A1 · Ma · 2021 [cited by examiner]
US 20220086439A1 · Tsai · 2022 [cited by examiner]
International Search Report dated Apr. 15, 2021 from the International Searching Authority in International Application No. PCT/US 21/16202. [cited by applicant]
Written Opinion dated Apr. 15, 2021 from the International Bureau in International Application No. PCT/US 21/16202. [cited by applicant]
Benjamin Bross, “Versatile Video Coding (Draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P2001-vE, Oct. 1-11, 2019, pp. 1-489, 16th Meeting, Geneva, CH. [cited by applicant]
K. Misra et al., “CE5-related: On the design of CC-ALF”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P1008-v2, Oct. 1-11, 2019, pp. 1-6, 16th Meeting, Geneva, CH. [cited by applicant]
Kiran Misra et al., “Cross-Component Adaptive Loop Filter for chroma”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O0636_r1, Jul. 3-12, 2019, pp. 1-9, 15th Meeting, Gothenburg… [cited by applicant]
Jonathan Taquet et al., “CE5: Results of tests CE5-3.1 to CE5-3.4 on Non-Linear Adaptive Loop Filter”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0242, Mar. 19-27, 2019, pp.… [cited by applicant]
Chia-Yang Tsai et al., “TE10 Subtest2: Coding Unit Synchronous Picture Quadtree-based Adaptive Loop Filter”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-C143, Oc… [cited by applicant]
Thomas J. Daede et al., “Daala: a Perceptually-Driven Next Generation Video Codec” arXiv:1603.03129v1 [cs.MM] Mar. 10, 2016, pp. 1-10. [cited by applicant]
Benjamin Bross, “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O2001-vE, Jul. 3-12, 2019, pp. 1-460, 15th Meeting, Gothenburg, SE. [cited by applicant]
John Canny, “A Computational Approach to Edge Detection”, IEEE Transactions On Pattern Analysis and Machine Intelligence, Nov. 1986, pp. 679-698, vol. PAMI-8, No. 6. [cited by applicant]
Debargha Mukherjee et al., “A Switchable Loop-Restoration With Side-Information Framework for the Emerging AV1 Video Codec”, ICIP 2017, pp. 265-269. [cited by applicant]
Steinar Midtskogen et al., “The AV1 Constrained Directional Enhancement Filter (CDEF)”, arXiv:1602.05975v3 [cs.MM] Oct. 28, 2017, pp. 1-5. [cited by applicant]