IP Library Granted Patent US 12,407,828
Granted Patent B2
US 12,407,828 · App. 18/669,047 · Granted Sep 2, 2025

System and method for video coding

Inventors: Jing Ya Li (Singapore, SG); Chong Soon Lim (Singapore, SG); Hai Wei Sun (Singapore, SG); Han Boon Teo (Singapore, SG); Che Wei Kuo (Singapore, SG); Chu Tong Wang (Singapore, SG); Kiyofumi Abe (Osaka, JP); Takahiro Nishi (Nara, JP); Tadamasa Toma (Osaka, JP); Yusuke Kato (Osaka, JP)
Assignee: Panasonic Intellectual Property Corporation of America
H04N19/117H04N19/105H04N19/119H04N19/124H04N19/13H04N19/18H04N19/186H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,828
App. No.
18/669,047
Granted
Sep 2, 2025
Kind
B2
Abstract

An encoder includes circuitry and memory. The circuitry, in operation, generates a first coefficient value by applying a CCALF (cross component adaptive loop filtering) process to a first reconstructed image sample of a luma component. The circuitry generates a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component. The circuitry generates a third coefficient value by adding the first coefficient value to the second coefficient value, and encodes a third reconstructed image sample of the chroma component using the third coefficient value. In the CCALF process, in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−1), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), and (2x, 2y+2).

Claims (20)

1. A method of transmitting a bitstream, the method comprising:

generating the bitstream, wherein the bitstream is generated by:

generating a first coefficient value by applying a CCALF (cross component adaptive loop filtering) filter to first reconstructed image samples of a luma component;

generating a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generating a third coefficient value by adding the first coefficient value to the second coefficient value, and

encoding a third reconstructed image sample of the chroma component using the third coefficient value into the bitstream,

wherein in applying the CCALF filter, in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−2), (2x−1, 2y−1), (2x, 2y−1), (2x+1, 2y−1), (2x−2, 2y), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x+2, 2y), (2x−2, 2y+1), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), (2x+2, 2y+1), (2x−1, 2y+2), (2x, 2y+2), (2x+1, 2y+2), and (2x, 2y+3); and

transmitting the bitstream.

2. The method of claim 1 , wherein, the CCALF filter is 16 taps filter having a 5×6 diamond shape.

3. The method of claim 1 , wherein, the first coefficient value is generated by multiplying a filter coefficient value of the CCALF filter to a result of subtraction of a value of one of the first reconstructed image samples (2x, 2y−2), (2x−1, 2y−1), (2x, 2y−1), (2x+1, 2y−1), (2x−2, 2y), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x+2, 2y), (2x−2, 2y+1), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), (2x+2, 2y+1), (2x−1, 2y+2), (2x, 2y+2), (2x+1, 2y+2), and (2x, 2y+3) and a value of the first reconstructed image sample located at (2x, 2y).

4. A method of storing a bitstream, the method comprising:

receiving the bitstream; and

storing the bitstream, wherein the stored bitstream is used for:

generating, based on the bitstream, a first coefficient value by applying a CCALF (cross component adaptive loop filtering) filter to first reconstructed image samples of a luma component;

generating, based on the bitstream, a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generating a third coefficient value by adding the first coefficient value to the second coefficient value, and

decoding a third reconstructed image sample of the chroma component using the third coefficient value,

wherein in applying the CCALF filter, in response to a coordinate of the second reconstructed image sample being (x, y), coordinates of the first reconstructed image samples are (2x, 2y−2), (2x−1, 2y−1), (2x, 2y−1), (2x+1, 2y−1), (2x−2, 2y), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x+2, 2y), (2x−2, 2y+1), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), (2x+2, 2y+1), (2x−1, 2y+2), (2x, 2y+2), (2x+1, 2y+2), and (2x, 2y+3).

5. The method of claim 4 , wherein, the CCALF filter is 16 taps filter having a 5×6 diamond shape.

6. The method of claim 4 , wherein, the first coefficient value is generated by multiplying a filter coefficient value of the CCALF filter to a result of subtraction of a value of one of the first reconstructed image samples (2x, 2y−2), (2x−1, 2y−1), (2x, 2y−1), (2x+1, 2y−1), (2x−2, 2y), (2x−1, 2y), (2x, 2y), (2x+1, 2y), (2x+2, 2y), (2x−2, 2y+1), (2x−1, 2y+1), (2x, 2y+1), (2x+1, 2y+1), (2x+2, 2y+1), (2x−1, 2y+2), (2x, 2y+2), (2x+1, 2y+2), and (2x, 2y+3) and a value of the first reconstructed image sample located at (2x, 2y).

Continuity (5)
Continuation 18071370 · Nov 29, 2022
Continuation 17667871 · Feb 9, 2022
Continuation PCTJP2020034381 · Sep 10, 2020
Provisional Application 62898845 · Sep 11, 2019
Related Publication 20240314310A1 · Sep 19, 2024
References Cited (48)
US 9025675B2 · Sadafale · 2015 [cited by applicant]
US 9313505B2 · Horowitz · 2016 [cited by applicant]
US 10419757B2 · Chen · 2019 [cited by examiner]
US 11115671B2 · Kuo et al. · 2021 [cited by applicant]
US 11197030B2 · Li · 2021 [cited by examiner]
US 11234010B2 · Hu · 2022 [cited by examiner]
US 11438613B2 · Xu et al. · 2022 [cited by applicant]
US 11496734B2 · Nam · 2022 [cited by examiner]
US 11528508B2 · Wang et al. · 2022 [cited by applicant]
US 11546590B2 · Sun et al. · 2023 [cited by applicant]
US 11546591B2 · Li · 2023 [cited by examiner]
US 11979566B2 · Misra · 2024 [cited by examiner]
US 12028519B2 · Li · 2024 [cited by examiner]
US 20110228841A1 · Suzuki et al. · 2011 [cited by applicant]
US 20110274158A1 · Fu et al. · 2011 [cited by applicant]
US 20120183081A1 · Liu et al. · 2012 [cited by applicant]
US 20140198840A1 · Huang et al. · 2014 [cited by applicant]
US 20180063527A1 · Chen et al. · 2018 [cited by applicant]
US 20180220138A1 · He et al. · 2018 [cited by applicant]
US 20180295364A1 · Liu et al. · 2018 [cited by applicant]
US 20180359480A1 · Xiu et al. · 2018 [cited by applicant]
US 20200329239A1 · Hsiao et al. · 2020 [cited by applicant]
US 20210218962A1 · Lim et al. · 2021 [cited by applicant]
US 20210297680A1 · Wang et al. · 2021 [cited by applicant]
US 20210360238A1 · Chen et al. · 2021 [cited by applicant]
US 20220182641A1 · Nam et al. · 2022 [cited by applicant]
US 20220201294A1 · Nam et al. · 2022 [cited by applicant]
EP 3720129A1 · 2020 [cited by applicant]
WO WO2018070914A1 · 2018 [cited by applicant]
WO WO2019107994A1 · 2019 [cited by applicant]
USPTO Library—NPL search query—2022; (Year: 2022). [cited by examiner]
CCALF coefficient derivation using combined neighbors; Jul. 2020; (Year: 2020). [cited by examiner]
Cross component adaptive loop filter for chroma; Kiran—Jul. 2019; (Year: 2019). [cited by examiner]
Hu et al., “CE5-related: Dynamic range reduction for coefficients of cross component adaptive loop filter,” JVET-P0555-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting:… [cited by applicant]
International Search Report and Written Opinion, mailed Nov. 11, 2020, for International Patent Application No. PCT/JP2020/030507. (19 pages). [cited by applicant]
International Search Report, mailed Dec. 2, 2020, for International Patent Application No. PCT/JP2020/034381. (4 pages). [cited by applicant]
International Search Report, mailed Nov. 11, 2020, for International Patent Application No. PCT/JP2020/030512. (4 pages). [cited by applicant]
Li et al., “AHG16/Non-CE5: Cross component ALF simplification,” JVET-P0173-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, Switzerland, Oct. 1-11, 2019. (9 pa… [cited by applicant]
Li et al., “Non-SCE4: Simplification of chroma enhancement for inter layer reference picture generation,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JC… [cited by applicant]
Ma et al., “CE5-related: Joint clip operation for CCALF and chroma ALF,” JVET-Q0494_r1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, Belgium, Jan. 7-17, 2020… [cited by applicant]
Misra et al., “CE5-Related: Reducing multiplier count in CCALF,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-P0468-v3, 16th Meeting: Geneva, CH, Oct. 1-11, 2019. (5 … [cited by applicant]
Misra et al., “Cross-Component Adaptive Loop Filter for chroma,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-O0636_r1, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019,… [cited by applicant]
Office Action, issued Jun. 24, 2022, for U.S. Appl. No. 17/582,937. (10 pages). [cited by applicant]
Office Action, issued Nov. 21, 2023, for U.S. Appl. No. 18/071,365. (10 pages). [cited by applicant]
Panusopane et al., “CCALF Coefficient Derivation Using Combined Neighbors,” 2020 IEEE International Conference on Image Processing (ICIP), Abu Dhabi, United Arab Emirates, Oct. 25-28, 2020, pp. 1133-1136. [cited by applicant]
Taquet et al., “Non-Linear Adaptive Loop Filter,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-M0385, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. (5 pages). [cited by applicant]
USPTO Library, “NPL search query,” Jul. 16, 2022. (3 pages). [cited by applicant]
Zhang et al., “CE5-related: On the CC-ALF filtering process,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-Q0165-v1, 17th Meeting: Brussels, BE, Jan. 7-17, 2020. (7 p… [cited by applicant]