IP Library › Granted Patent US 12,739,369
Granted Patent B2
US 12,739,369 · App. 18/773,562 · Granted Sep 15, 2026

In-loop filtering method and device

Inventors: Siwei Ma (Beijing, CN); Xuewei Meng (Beijing, CN); Xiaozhen Zheng (Shenzhen, CN); Shanshe Wang (Beijing, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
H04N19/117H04N19/132H04N19/176H04N19/186H04N19/70H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,739,369
App. No.
18/773,562
Granted
Sep 15, 2026
Kind
B2
Abstract

A video processing method including determining a target CC-ALF filter for a chrominance component of a current block of an image from a plurality of CC-ALF filters, determining target CC-ALF filter coefficients for the chrominance component according to the chrominance component after ALF and a luminance component of the current block without ALF, filtering the chrominance component after ALF according to the target CC-ALF filter and the target CC-ALF filter coefficients, determining a filtered chrominance component of the current block according to the chrominance component after being filtered with the target CC-ALF filter coefficients and the chrominance component after the ALF, and encoding the filtered chrominance component, including encoding using a total number of the plurality of CC-ALF filters, an index of the target CC-ALF filter, and the target CC-ALF filter coefficients as syntax elements.

Claims (47)

1 . A video processing method comprising:

determining a target cross-component adaptive loop filtering (ALF) filter for a chrominance component of a current block of an image from a plurality of cross-component ALF filters;

determining target cross-component ALF filter coefficients for the chrominance component of the current block according to the chrominance component after ALF and a luminance component of the current block without ALF;

filtering the chrominance component after ALF according to the target cross-component ALF filter and the target cross-component ALF filter coefficients;

determining a filtered chrominance component of the current block according to the chrominance component after being filtered with the target cross-component ALF filter coefficients and the chrominance component after the ALF, a weighted average of seven pixels around a pixel of the chrominance component of the current block being used to obtain a filtering result of the pixel of the chrominance component of the current block; and

encoding the filtered chrominance component of the current block, including encoding using a total number of the plurality of cross-component ALF filters, an index of the target cross-component ALF filter, and the target cross-component ALF filter coefficients as syntax elements.

2 . The method according to claim 1 , wherein:

a syntax element for indicating the total number of the plurality of cross-component ALF filters is located in an adaptation parameter set syntax of the image but is not present in an image header and/or a slice header.

3 . The method according to claim 1 , wherein:

the chrominance component after ALF is the chrominance component after sample adaptive offset (SAO) filtering and ALF sequentially.

4 . The method according to claim 1 , wherein:

the luminance component without ALF is the luminance component after sample adaptive offset (SAO) and without ALF.

5 . The method according to claim 1 , wherein encoding using the total number of the plurality of cross-component ALF filters as a syntax element includes:

encoding the total number of the plurality of cross-component ALF filters using a truncated binary code.

6 . The method according to claim 1 , wherein encoding using the index of the target cross-component ALF filter as a syntax element includes:

encoding the index of the target cross-component ALF filter using a truncated binary code.

7 . The method according to claim 1 , wherein a 3×4 diamond shape is used in the target cross-component ALF filter.

8 . A video processing method comprising:

decoding a total number of cross-component adaptive loop filtering (ALF) filters and an index of a target cross-component ALF filter from a stream, the target cross-component ALF filter being a cross-component ALF filter adopted by a chrominance component of a current block of an image;

decoding target cross-component ALF filter coefficients for the chrominance component of the current block from the stream, the target cross-component ALF filter coefficients being coefficients in the target cross-component ALF filter and being determined at an encoding side according to the chrominance component after ALF and a luminance component of the current block without ALF;

performing filtering on the chrominance component after ALF according to the target cross-component ALF filter and the target cross-component ALF filter coefficients; and

determining a filtered chrominance component of the current block according to the chrominance component filtered with the target cross-component ALF filter coefficients and the chrominance component after ALF, a weighted average of seven pixels around a pixel of the chrominance component of the current block being used to obtain a filtering result of the pixel of the chrominance component of the current block.

9 . The method according to claim 8 , wherein:

a syntax element for indicating the total number of the plurality of cross-component ALF filters is located in an adaptation parameter set syntax of the image but is not present in an image header and/or a slice header.

10 . The method according to claim 8 , wherein:

the chrominance component after ALF is the chrominance component after sample adaptive offset (SAO) filtering and ALF sequentially.

11 . The method according to claim 8 , wherein:

the luminance component without ALF is the luminance component after sample adaptive offset (SAO) and without ALF.

12 . The method according to claim 8 , wherein decoding the total number of the plurality of cross-component ALF filters from the stream includes:

decoding the total number of the plurality of cross-component ALF filters using a truncated binary code.

13 . The method according to claim 8 , wherein decoding the index of the target cross-component ALF filter from the stream includes:

decoding the index of the target cross-component ALF filter using a truncated binary code.

14 . The method according to claim 8 , wherein a 3×4 diamond shape is used in the target cross-component ALF filter.

15 . A stream generating method comprising:

determining a target cross-component adaptive loop filtering (ALF) filter for a chrominance component of a current block of an image from a plurality of cross-component ALF filters;

determining target cross-component ALF filter coefficients for the chrominance component of the current block according to the chrominance component after ALF and a luminance component of the current block without ALF;

filtering the chrominance component after ALF according to the target cross-component ALF filter and the target cross-component ALF filter coefficients;

determining a filtered chrominance component of the current block according to the chrominance component after being filtered with the target cross-component ALF filter coefficients and the chrominance component after the ALF, a weighted average of seven pixels around a pixel of the chrominance component of the current block being used to obtain a filtering result of the pixel of the chrominance component of the current block; and

encoding the filtered chrominance component of the current block, including encoding using a total number of the plurality of cross-component ALF filters, an index of the target cross-component ALF filter, and the target cross-component ALF filter coefficients as syntax elements to generate a stream.

16 . The method according to claim 15 , wherein:

a syntax element for indicating the total number of the plurality of cross-component ALF filters is located in an adaptation parameter set syntax of the image but is not present in an image header and/or a slice header.

17 . The method according to claim 15 , wherein:

the chrominance component after ALF is the chrominance component after sample adaptive offset (SAO) filtering and ALF sequentially.

18 . The method according to claim 15 , wherein:

the luminance component without ALF is the luminance component after sample adaptive offset (SAO) and without ALF.

19 . The method according to claim 15 , wherein at least one of the total number of the plurality of cross-component ALF filters and the index of the target cross-component ALF filter is encoded using a truncated binary code.

20 . The method according to claim 15 , wherein a 3×4 diamond shape is used in the target cross-component ALF filter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2024
From: MA, SIWEI; MENG, XUEWEI; ZHENG, XIAOZHEN; WANG, SHANSHE
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 068025/0468 →
Continuity (3)
Continuation 17853906 · Jun 29, 2022
Continuation PCTCN2019130954 · Dec 31, 2019
Related Publication 20240373002A1 · Nov 7, 2024
References Cited (45)
US 11863779B2 · Hu et al. · 2024 [cited by applicant]
US 12041231B2 · Ma · 2024 [cited by examiner]
US 20120051438A1 · Chong et al. · 2012 [cited by applicant]
US 20180041779A1 · Zhang et al. · 2018 [cited by applicant]
US 20180063527A1 · Chen et al. · 2018 [cited by applicant]
US 20180288441A1 · Zhang et al. · 2018 [cited by applicant]
US 20210044834A1 · Li et al. · 2021 [cited by applicant]
US 20210076032A1 · Hu et al. · 2021 [cited by applicant]
US 20210084295A1 · Chen et al. · 2021 [cited by applicant]
US 20210084340A1 · Li et al. · 2021 [cited by applicant]
US 20210092370A1 · Hu et al. · 2021 [cited by applicant]
US 20210152841A1 · Hu et al. · 2021 [cited by applicant]
US 20210160513A1 · Hu et al. · 2021 [cited by applicant]
US 20210176501A1 · Chen et al. · 2021 [cited by applicant]
US 20220264106A1 · Zhang et al. · 2022 [cited by applicant]
US 20220345698A1 · Misra et al. · 2022 [cited by applicant]
US 20220408085A1 · Lim et al. · 2022 [cited by applicant]
US 20230023387A1 · Ström et al. · 2023 [cited by applicant]
US 20230090421A1 · Sun · 2023 [cited by examiner]
CN 103891293A · 2014 [cited by applicant]
CN 104683819A · 2015 [cited by applicant]
CN 104735450A · 2015 [cited by applicant]
CN 109479130A · 2019 [cited by applicant]
CN 109691102A · 2019 [cited by applicant]
CN 114586347A · 2022 [cited by applicant]
CN 114586350A · 2022 [cited by applicant]
GB 201911952D0 · 2019 [cited by applicant]
KR 20130020511A · 2013 [cited by applicant]
WO 2012047047A2 · 2012 [cited by applicant]
WO 2014189300A1 · 2014 [cited by applicant]
WO 2019060443A1 · 2019 [cited by applicant]
WO 2019189344A1 · 2019 [cited by applicant]
The World Intellectual Property Organization (WIPO) International Search Report for PCT/CN2019/130954 Aug. 27, 2020 5 Pages. [cited by applicant]
Lidong Luo, et al., “A low Complexity Adaptive Loop Filter Algorithm for Multi-View Video Coding”, Journal of Optoelectronics. Laser, vol. 25, No. 2, Feb. 15, 2014. [cited by applicant]
Siwei Ma, et al., “Kernel technologies and applications of AVS2 video coding standard”, Telecommunications Science, Aug. 20, 2017. [cited by applicant]
Tsai C Y, Chen C Y, Yamakage T, et al. Adaptive loop filtering for video coding[J]. IEEE Journal of Selected Topics in Signal Processing. 7(6). Jul. 2013: 934-945. [cited by applicant]
M. Karczewicz, L. Zhang, W.-J. Chien, and X. Li, “Geometry transformation-based adaptive in-loop filter,” in Picture Coding Symposium (PCS), 2016. IEEE, 2016, pp. 1-5. [cited by applicant]
Kiran Misra et al., “Cross-Component Adaptive Loop Filter for chroma,” Joint Video Experts Team ( JVET ) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/5C /WG 11, 15th Meeting, Jul. 7, 2019 (9 pages). [cited by applicant]
Jonathan Taquet et al., “«Joint Video Experts Team ( JVET ) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/5C /WG 11»”, “«Non-CE5 : Parsability of ALF Chroma Filter alternative signaling»”, Sep. 25, 2019 (Sep. 25, 2019). [cited by applicant]
Kiran Misra et al., CES-related: On the design of CC-ALF, Joint Video Experts Team (JVET) Document: JVET-P1008-v2 of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, pp. 1-6. [cited by applicant]
Benjamin Bross, Versatile Video Coding (Draft 6), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, pp. 1-460. [cited by applicant]
Nan Hu et al. , Non-CE5: Using truncated binary codes for ALF filter indices , Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019 , JVET-P0553_v2,… [cited by applicant]
Benjamin Bross et al. , Versatile Video Coding (Draft 7) , Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019 , JVET-P2001-vE , Dec. 30, 2019, pp. … [cited by applicant]
Nan Hu et al., CE5-related: Removing Number of filters for CC-ALF in slice and picture header, JVET Meeting—17th Meeting of the Joint Video Exploration Team (JVET), Dec. 2019. [cited by applicant]
Hua Yang, Yuwen He, Hongyu Li, CE5-related: Joint chroma cross-component adaptive loop filtering, Joint Video Experts Team (JVET) of ITUT SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 20… [cited by applicant]