IP Library Granted Patent US 12,262,004
Granted Patent B2
US 12,262,004 · App. 17/582,950 · Granted Mar 25, 2025

System and method for video coding

Inventors: Che-Wei Kuo (Singapore, SG); Chong Soon Lim (Singapore, SG); Jing Ya Li (Singapore, SG); Han Boon Teo (Singapore, SG); Hai Wei Sun (Singapore, SG); Chu Tong Wang (Singapore, SG); Tadamasa Toma (Osaka, JP); Takahiro Nishi (Nara, JP); Kiyofumi Abe (Osaka, JP); Yusuke Kato (Osaka, JP)
Assignee: Panasonic Intellectual Property Corporation of America
H04N19/117H04N19/132H04N19/159H04N19/176H04N19/186H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,004
App. No.
17/582,950
Granted
Mar 25, 2025
Kind
B2
Abstract

An encoder includes circuitry which generates a first coefficient value by applying a CCALF process to a first reconstructed image sample of a luma component; generates a second coefficient value by applying an ALF process to a second reconstructed image sample of a chroma component; generates a third coefficient value by adding the first coefficient value to the second coefficient value; and encodes a third reconstructed image sample of the chroma component using the third coefficient value. The circuitry writes a first parameter into a sequence parameter set; writes a second parameter into a parameter set of a picture in response to a value of the first parameter being 1; writes a third parameter into a slice header in response to the value of the first parameter being 1; and writes a fourth parameter into a coding tree unit in response to a value of the third parameter being 1.

Claims (88)

1. An encoder, comprising:

circuitry; and

memory coupled to the circuitry;

wherein the circuitry, in operation:

generates a first coefficient value by applying a CCALF (cross component adaptive loop filtering) process to a first reconstructed image sample of a luma component;

determines whether the first coefficient value is less than 64;

sets the first coefficient value to zero in response to determining the first coefficient value is less than 64;

generates a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generates a third coefficient value by adding the first coefficient value to the second coefficient value;

encodes a third reconstructed image sample of the chroma component using the third coefficient value;

writes a first parameter into a sequence parameter set;

writes a second parameter into a picture header in response to a value of the first parameter being 1;

writes a third parameter into a slice header in response to the value of the first parameter being 1; and

writes a fourth parameter into a coding tree unit in response to a value of the third parameter being 1, the fourth parameter indicating a filter to be used in the CCALF process.

2. An encoder, comprising:

a block splitter, which, in operation, splits a first image into a plurality of blocks;

an intra predictor, which, in operation, predicts blocks included in the first image, using reference blocks included in the first image;

an inter predictor, which, in operation, predicts blocks included in the first image, using reference blocks included in a second image different from the first image;

a loop filter, which, in operation, filters blocks included in the first image;

a transformer, which, in operation, transforms a prediction error between an original signal and a prediction signal generated by the intra predictor or the inter predictor, to generate transform coefficients;

a quantizer, which, in operation, quantizes the transform coefficients to generate quantized coefficients; and

an entropy encoder, which, in operation, variably encodes the quantized coefficients to generate an encoded bitstream including the encoded quantized coefficients and control information,

wherein the loop filter performs:

generating a first coefficient value by applying a CCALF (cross component adaptive loop filtering) process to a first reconstructed image sample of a luma component;

determining whether the first coefficient value is less than 64;

setting the first coefficient value to zero in response to determining the first coefficient value is less than 64;

generating a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generating a third coefficient value by adding the first coefficient value to the second coefficient value;

encoding a third reconstructed image sample of the chroma component using the third coefficient value;

writing a first parameter into a sequence parameter set;

writing a second parameter into a picture header in response to a value of the first parameter being 1;

writing a third parameter into a slice header in response to the value of the first parameter being 1; and

writing a fourth parameter into a coding tree unit in response to a value of the third parameter being 1, the fourth parameter indicating a filter to be used in the CCALF process.

3. A decoder, comprising:

circuitry; and

memory coupled to the circuitry;

wherein the circuitry, in operation:

parses a first parameter from a sequence parameter set;

parses a second parameter from a picture header in response to a value of the first parameter being 1;

parses a third parameter from a slice header in response to the value of the first parameter being 1;

parses a fourth parameter from a coding tree unit in response to a value of the third parameter being 1, the fourth parameter indicating a filter to be used in a CCALF (cross component adaptive loop filtering) process;

generates a first coefficient value by applying the CCALF process to a first reconstructed image sample of a luma component;

determines whether the first coefficient value is less than 64;

sets the first coefficient value to zero in response to determining the first coefficient value is less than 64;

generates a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generates a third coefficient value by adding the first coefficient value to the second coefficient value; and

decodes a third reconstructed image sample of the chroma component using the third coefficient value.

4. A decoding apparatus, comprising:

a decoder, which, in operation, decodes an encoded bitstream to output quantized coefficients;

an inverse quantizer, which, in operation, inverse quantizes the quantized coefficients to output transform coefficients;

an inverse transformer, which, in operation, inverse transforms the transform coefficients to output a prediction error;

an intra predictor, which, in operation, predicts blocks included in a first image, using a reference blocks included in the first image;

an inter predictor, which, in operation, predicts blocks included in the first image, using reference blocks included in a second image different from the first image;

a loop filter, which, in operation, filters blocks included in the first image; and

an output, which, in operation, outputs a picture including the first image,

wherein the loop filter performs:

parsing a first parameter from a sequence parameter set;

parsing a second parameter from a picture header in response to a value of the first parameter being 1;

parsing a third parameter from a slice header in response to the value of the first parameter being 1;

parsing a fourth parameter from a coding tree unit in response to a value of the third parameter being 1, the fourth parameter indicating a filter to be used in a CCALF (cross component adaptive loop filtering) process;

generating a first coefficient value by applying the CCALF process to a first reconstructed image sample of a luma component;

determining whether the first coefficient value is less than 64;

setting the first coefficient value to zero in response to determining the first coefficient value is less than 64;

generating a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generating a third coefficient value by adding the first coefficient value to the second coefficient value; and

decoding a third reconstructed image sample of the chroma component using the third coefficient value.

5. An encoding method, comprising:

generating a first coefficient value by applying a CCALF (cross component adaptive loop filtering) process to a first reconstructed image sample of a luma component;

determining whether the first coefficient value is less than 64;

setting the first coefficient value to zero in response to determining the first coefficient value is less than 64;

generating a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generating a third coefficient value by adding the first coefficient value to the second coefficient value;

encoding a third reconstructed image sample of the chroma component using the third coefficient value;

writing a first parameter into a sequence parameter set;

writing a second parameter into a picture header in response to a value of the first parameter being 1;

writing a third parameter into a slice header in response to the value of the first parameter being 1; and

writing a fourth parameter into a coding tree unit in response to a value of the third parameter being 1, the fourth parameter indicating a filter to be used in the CCALF process.

6. A decoding method, comprising:

parsing a first parameter from a sequence parameter set;

parsing a second parameter from a picture header in response to a value of the first parameter being 1;

parsing a third parameter from a slice header in response to the value of the first parameter being 1;

parsing a fourth parameter from a coding tree unit in response to a value of the third parameter being 1, the fourth parameter indicating a filter to be used in a CCALF (cross component adaptive loop filtering) process;

generating a first coefficient value by applying the CCALF process to a first reconstructed image sample of a luma component;

determining whether the first coefficient value is less than 64;

setting the first coefficient value to zero in response to determining the first coefficient value is less than 64;

generating a second coefficient value by applying an ALF (adaptive loop filtering) process to a second reconstructed image sample of a chroma component;

generating a third coefficient value by adding the first coefficient value to the second coefficient value; and

decoding a third reconstructed image sample of the chroma component using the third coefficient value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2022
From: KUO, CHE-WEI; LIM, CHONG SOON; LI, JING YA; TEO, HAN BOON; SUN, HAI WEI; WANG, CHU TONG; TOMA, TADAMASA; NISHI, TAKAHIRO; ABE, KIYOFUMI; KATO, YUSUKE
To: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
Reel/Frame 059964/0527 →
Continuity (3)
Continuation PCTJP2020030518 · Aug 7, 2020
Provisional Application 62884412 · Aug 8, 2019
Related Publication 20220150483A1 · May 12, 2022
References Cited (37)
US 9313505B2 · Horowitz · 2016 [cited by applicant]
US 11528508B2 · Wang et al. · 2022 [cited by applicant]
US 20120183081A1 · Liu · 2012 [cited by examiner]
US 20130044809A1 · Chong et al. · 2013 [cited by applicant]
US 20130322523A1 · Huang et al. · 2013 [cited by applicant]
US 20140010278A1 · Lou et al. · 2014 [cited by applicant]
US 20140369426A1 · Li et al. · 2014 [cited by applicant]
US 20160234492A1 · Li · 2016 [cited by examiner]
US 20180220138A1 · He · 2018 [cited by examiner]
US 20190349582A1 · Bordes et al. · 2019 [cited by applicant]
US 20210044834A1 · Li et al. · 2021 [cited by applicant]
US 20210092370A1 · Hu et al. · 2021 [cited by applicant]
US 20210160513A1 · Hu et al. · 2021 [cited by applicant]
US 20220150483A1 · Kuo et al. · 2022 [cited by applicant]
US 20220159307A1 · Wang et al. · 2022 [cited by applicant]
US 20220159308A1 · Li et al. · 2022 [cited by applicant]
US 20220182641A1 · Nam et al. · 2022 [cited by applicant]
US 20220201294A1 · Nam et al. · 2022 [cited by applicant]
US 20220201338A1 · Nam et al. · 2022 [cited by applicant]
US 20220248007A1 · Misra · 2022 [cited by examiner]
US 20220312006A1 · Taquet et al. · 2022 [cited by applicant]
US 20220337823A1 · Choi et al. · 2022 [cited by applicant]
US 20220337841A1 · Choi et al. · 2022 [cited by applicant]
US 20220345697A1 · Choi et al. · 2022 [cited by applicant]
US 20230353790A1 · Wang et al. · 2023 [cited by applicant]
EP 3349459A1 · 2018 [cited by applicant]
International Search Report, mailed Nov. 11, 2020, for International Application No. PCT/JP2020/030513, 4 pages. [cited by applicant]
Misra et al., Sharp Labs of America, Sharp Electronics of Canada, “Cross-Component Adaptive Loop Filter for chroma,” JVET-O0636_rl, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15 [cited by applicant]
Han Boon Teo, et al., Panasonic, “Non-CE5: On SEI for ALF,” JVET-Q0319-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, 9 pages. [cited by applicant]
Bross, et al., “Versatile Video Coding (Draft 6),” JVET-O2001-vE, Joint Video Experts 1 Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages. [cited by applicant]
International Preliminary Report on Patentability, for Application No. 2 PCT/JP2020/0033343, issued Mar. 8, 2022. (9 pages). [cited by applicant]
International Search Report, mailed Nov. 11, 2020, for International Application No. 3 PCT/JP2020/030518, 16 pages. [cited by applicant]
International Search Report, mailed Nov. 11, 2020, for International Application No. 4 PCT/JP2020/030519, 4 pages. [cited by applicant]
International Search Report, mailed Nov. 26, 2020, for International Application No. 5 PCT/JP2020/033343, 4 pages. [cited by applicant]
Kotra et al., “CE5-2: Loop filter line buffer reduction,” Joint Video Experts Team (JVET) 6 of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-N0180-v2, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 9 pages. [cited by applicant]
Li et al., Panasonic Corporation, “AHG16/Non-CE5: Cross component ALF simplification,” JVET-P **- v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 7 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting, Geneva, CH, Oct. 1… [cited by applicant]
Misra et al., “CE5-2.1, CE5-2.2: Cross Component Adaptive Loop Filter,” Joint Video 8 Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-P0080, 16th Meeting: Geneva, CH, Oct. 1-11, 201… [cited by applicant]