IP Library › Granted Patent US 12,457,332
Granted Patent B2
US 12,457,332 · App. 18/671,457 · Granted Oct 28, 2025

System and method for video coding

Inventors: Jing Ya Li (Singapore, SG); Chong Soon Lim (Singapore, SG); Hai Wei Sun (Singapore, SG); Han Boon Teo (Singapore, SG); Che Wei Kuo (Singapore, SG); Chu Tong Wang (Singapore, SG); Kiyofumi Abe (Osaka, JP); Takahiro Nishi (Nara, JP); Tadamasa Toma (Osaka, JP); Yusuke Kato (Osaka, JP)
Assignee: Panasonic Intellectual Property Corporation of America
H04N19/117H04N19/105H04N19/119H04N19/124H04N19/13H04N19/18H04N19/186H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,457,332
App. No.
18/671,457
Granted
Oct 28, 2025
Kind
B2
Abstract

An encoder includes circuitry and memory. The circuitry, in operation, generates a first coefficient value by applying a CCALF (cross component adaptive loop filtering) process to a first reconstructed image sample of a luma component. The circuitry generates a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component. The circuitry generates a third coefficient value by adding the first coefficient value to the second coefficient value, and encodes a third reconstructed image sample of the chroma component using the third coefficient value. In the CCALF process, in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−1), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), and (2x, 2y+2).

Claims (54)

1. An encoder, comprising:

circuitry; and

memory coupled to the circuitry;

wherein the circuitry, in operation:

generates a first coefficient value by applying a CCALF (cross component adaptive loop filtering) filter to first reconstructed image samples of a luma component;

clips the first coefficient value to be within a range of −2 7 to 2 7 −1;

generates a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generates a third coefficient value by adding the clipped first coefficient value to the second coefficient value, and

encodes a third reconstructed image sample of the chroma component using the third coefficient value:

wherein in applying the CCALF filter,

in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−1), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), and (2x, 2y+2).

2. A decoder, comprising:

circuitry; and

memory coupled to the circuitry;

wherein the circuitry, in operation:

generates a first coefficient value by applying a CCALF (cross component adaptive loop filtering) filter to first reconstructed image samples of a luma component;

clips the first coefficient value to be within a range of −2 7 to 2 7 −1;

generates a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generates a third coefficient value by adding the clipped first coefficient value to the second coefficient value, and

decodes a third reconstructed image sample of the chroma component using the third coefficient value:

wherein in applying the CCALF filter,

in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−1), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), and (2x, 2y+2).

3. An encoding method, comprising:

generating a first coefficient value by applying a CCALF (cross component adaptive loop filtering) filter to first reconstructed image samples of a luma component;

clipping the first coefficient value to be within a range of −2 7 to 2 7 −1;

generating a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generating a third coefficient value by adding the clipped first coefficient value to the second coefficient value, and

encoding a third reconstructed image sample of the chroma component using the third coefficient value:

wherein in applying the CCALF filter,

in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−1), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), and (2x, 2y+2).

4. A decoding method, comprising:

generating a first coefficient value by applying a CCALF (cross component adaptive loop filtering) filter to first reconstructed image samples of a luma component;

clipping the first coefficient value to be within a range of −2 7 to 2 7 −1;

generating a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generating a third coefficient value by adding the clipped first coefficient value to the second coefficient value, and

decoding a third reconstructed image sample of the chroma component using the third coefficient value:

wherein in applying the CCALF filter,

in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−1), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), and (2x, 2y+2).

5. A non-transitory computer readable medium storing a bitstream containing information according to which an encoder performs an encoding process, wherein in the encoding process:

a first coefficient value is generated by applying a CCALF (cross component adaptive loop filtering) filter to first reconstructed image samples of a luma component;

the first coefficient value is clipped to be within a range of −2 7 to 2 7 −1;

a second coefficient value is generated by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

a third coefficient value is generated by adding the clipped first coefficient value to the second coefficient value, and

a third reconstructed image sample of the chroma component is encoded using the third coefficient value:

wherein in applying the CCALF filter,

in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−1), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), and (2x, 2y+2).

6. A non-transitory computer readable medium storing a bitstream containing information according to which a decoder performs a decoding process, wherein in the decoding process:

a first coefficient value is generated by applying a CCALF (cross component adaptive loop filtering) filter to first reconstructed image samples of a luma component;

the first coefficient value is clipped to be within a range of −2 7 to 2 7 −1;

a second coefficient value is generated by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

a third coefficient value is generated by adding the clipped first coefficient value to the second coefficient value, and

a third reconstructed image sample of the chroma component is decoded using the third coefficient value:

wherein in applying the CCALF filter,

in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−1), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), and (2x, 2y+2).

Continuity (5)
Continuation 18071365 · Nov 29, 2022
Continuation 17667871 · Feb 9, 2022
Continuation PCTJP2020034381 · Sep 10, 2020
Provisional Application 62898845 · Sep 11, 2019
Related Publication 20240314311A1 · Sep 19, 2024
References Cited (50)
US 9025675B2 · Sadafale · 2015 [cited by applicant]
US 9313505B2 · Horowitz · 2016 [cited by applicant]
US 10419757B2 · Chen et al. · 2019 [cited by applicant]
US 11115671B2 · Kuo et al. · 2021 [cited by applicant]
US 11197030B2 · Li · 2021 [cited by examiner]
US 11234010B2 · Hu · 2022 [cited by examiner]
US 11438613B2 · Xu et al. · 2022 [cited by applicant]
US 11496734B2 · Nam et al. · 2022 [cited by applicant]
US 11528508B2 · Wang · 2022 [cited by examiner]
US 11546590B2 · Sun · 2023 [cited by examiner]
US 11546591B2 · Li · 2023 [cited by examiner]
US 11979566B2 · Misra et al. · 2024 [cited by applicant]
US 12028519B2 · Li · 2024 [cited by examiner]
US 12034925B2 · Li · 2024 [cited by examiner]
US 20110228841A1 · Suzuki et al. · 2011 [cited by applicant]
US 20110274158A1 · Fu et al. · 2011 [cited by applicant]
US 20120183081A1 · Liu et al. · 2012 [cited by applicant]
US 20140198840A1 · Huang et al. · 2014 [cited by applicant]
US 20180063527A1 · Chen et al. · 2018 [cited by applicant]
US 20180220138A1 · He et al. · 2018 [cited by applicant]
US 20180295364A1 · Liu et al. · 2018 [cited by applicant]
US 20180359480A1 · Xiu et al. · 2018 [cited by applicant]
US 20200329239A1 · Hsiao et al. · 2020 [cited by applicant]
US 20210218962A1 · Lim et al. · 2021 [cited by applicant]
US 20210297680A1 · Wang et al. · 2021 [cited by applicant]
US 20210360238A1 · Chen et al. · 2021 [cited by applicant]
US 20220182641A1 · Nam et al. · 2022 [cited by applicant]
US 20220201294A1 · Nam et al. · 2022 [cited by applicant]
EP 3720129A1 · 2020 [cited by applicant]
WO WO2018070914A1 · 2018 [cited by applicant]
WO WO2019107994A1 · 2019 [cited by applicant]
USPTO Library—NPL search query—2022; (Year: 2022). [cited by examiner]
CCALF coefficient derivation using combined neighbors; Jul. 2020; (Year: 2020). [cited by examiner]
Cross component adaptive loop filter for chroma; Kiran—Jul. 2019; (Year: 2019). [cited by examiner]
Hu et al., “CE5-related: Dynamic range reduction for coefficients of cross component adaptive loop filter,” JVET-P0555-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting:… [cited by applicant]
International Search Report and Written Opinion, mailed Nov. 11, 2020, for International Patent Application No. PCT/JP2020/030507. (19 pages). [cited by applicant]
International Search Report, mailed Dec. 2, 2020, for International Patent Application No. PCT/JP2020/034381. (4 pages). [cited by applicant]
International Search Report, mailed Nov. 11, 2020, for International Patent Application No. PCT/JP2020/030512. (4 pages). [cited by applicant]
Li et al., “AHG16/Non-CE5: Cross component ALF simplification,” JVET-P0173-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, Switzerland, Oct. 1-11, 2019. (9 pa… [cited by applicant]
Li et al., “Non-SCE4: Simplification of chroma enhancement for inter layer reference picture generation,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JC… [cited by applicant]
Ma et al., “CE5-related: Joint clip operation for CCALF and chroma ALF,” JVET-Q0494_r1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, Belgium, Jan. 7-17, 2020… [cited by applicant]
Misra et al., “CE5-Related: Reducing multiplier count in CCALF,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-P0468-v3, 16th Meeting: Geneva, CH, Oct. 1-11, 2019. (5 … [cited by applicant]
Misra et al., “Cross-Component Adaptive Loop Filter for chroma,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-O0636_r1, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019,… [cited by applicant]
Office Action, issued Dec. 6, 2023, for U.S. Appl. No. 18/071,370. (13 pages). [cited by applicant]
Office Action, issued Jun. 24, 2022, for U.S. Appl. No. 17/582,937. (10 pages). [cited by applicant]
Panusopane et al., “CCALF Coefficient Derivation Using Combined Neighbors,” 2020 IEEE International Conference on Image Processing (ICIP), Abu Dhabi, United Arab Emirates, Oct. 25-28, 2020, pp. 1133-1136. [cited by applicant]
Taquet et al., “Non-Linear Adaptive Loop Filter,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-M0385, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. (5 pages). [cited by applicant]
USPTO Library, “NPL search query,” Jul. 16, 2022. (3 pages). [cited by applicant]
Zhang et al., “CE5-related: On the CC-ALF filtering process,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-Q0165-v1, 17th Meeting: Brussels, BE, Jan. 7-17, 2020. (7 p… [cited by applicant]
Notice of Allowance, dated May 19, 2025, for U.S. Appl. No. 18/669,047. (10 pages). [cited by applicant]