IP Library Granted Patent US 11,962,767
Granted Patent B2
US 11,962,767 · App. 17/639,264 · Granted Apr 16, 2024

Apparatus and method for coding image

Inventors: Jangwon Choi (Seoul, KR); Junghak Nam (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/117H04N19/132H04N19/174H04N19/176H04N19/18H04N19/186H04N19/1883H04N19/50H04N19/70H04N19/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,962,767
App. No.
17/639,264
Granted
Apr 16, 2024
Kind
B2
Abstract

According to one embodiment of the present document, an in-loop filtering procedure in an image/video coding procedure may comprise a cross-component adaptive loop filtering procedure. CCALF, according to the present embodiment, can increase the accuracy of in-loop filtering.

Claims (94)

1. A method for image decoding performed by a decoding apparatus, the method comprising:

acquiring image information including prediction-related information and residual information through a bit stream;

deriving transform coefficients based on the residual information;

generating residual samples based on the transform coefficients;

generating prediction samples based on the prediction-related information; and

generating reconstructed samples based on the prediction samples and the residual samples, the reconstructed samples including reconstructed luma samples and reconstructed chroma samples;

deriving adaptive loop filter (ALF) coefficients for an ALF process of the reconstructed chroma samples;

generating filtered reconstructed chroma samples based on the reconstructed chroma samples and the ALF filter coefficients;

deriving cross-component filter coefficients for cross-component filtering; and

generating modified filtered reconstructed chroma samples based on the reconstructed luma samples, the filtered reconstructed chroma samples, and the cross-component filter coefficients,

wherein

the image information includes a sequence parameter set (SPS), and slice header information,

the SPS includes ALF enabled flag related to whether the ALF process is enabled,

based on a value of the ALF enabled flag being 1, the SPS includes a cross-component adaptive loop filter (CCALF) enabled flag related to whether the cross-component filtering is available,

based on a determination that a value of the ALF enabled flag in the SPS is 1, the slice header information includes an ALF enabled flag related to whether the ALF is enabled,

based on a determination that a value of the ALF enabled flag included in the slice header information is 1 and a value of the CCALF enabled flag included in the SPS is 1, the slice header information includes information on whether the CCALF is enabled for the filtered reconstructed chroma samples, and

based on a value of the information on whether the CCALF is enabled for the filtered reconstructed chroma samples being 1, the slice header information includes identification (ID) information of an adaptation parameter set (APS) associated with the CCALF for the filtered reconstructed chroma samples,

ALF data included in the APS includes information related to a number of the cross-component filters for the Cb color component and information related to a number of cross-component filters for the Cr component,

based on the information related to the number of the cross-component filters for the Cb color component, the ALF data includes information on absolute values of the cross-component filter coefficients for the Cb color component and information on signs of the cross-component filter coefficients for the Cb color component, and

based on information related to the number of the cross-component filters for the Cr color component, the ALF data includes information on absolute values of the cross-component filter coefficients for the Cr color component and information on signs of the cross-component filter coefficients for the Cr color component.

2. The method of claim 1 ,

wherein based on a determination that a value of the CCALF enabled flag is 1, the slice header information includes a first flag related to whether the CCALF is enabled for the Cb color component of the filtered reconstructed chroma samples and a second flag related to whether the CCALF is enabled for a Cr color component of the filtered reconstructed chroma samples.

3. The method of claim 2 , wherein

based on a value of the first flag being 1, the slice header information includes ID information of a first APS including first ALF data used for deriving cross-component filter coefficients for the Cb color component of the filtered reconstructed chroma samples and

based on a value of the first flag being 1, the slice header information includes ID information of a second APS including second ALF data used for deriving cross-component filter coefficients for the Cr color component of the filtered reconstructed chroma samples.

4. The method of claim 1 , wherein

the cross-component filter coefficients for the Cb color component are derived based on the information on the absolute values of the cross-component filter coefficients for the Cb color component and the information on the signs of the cross-component filter coefficients for the Cb color component, and

the cross-component filter coefficients for the Cr color component are derived based on information on the absolute values of the cross-component filter coefficients for the Cr color component and information on the signs of the cross-component filter coefficients for the Cr color component.

5. The method of claim 1 , wherein

the image information includes information on a coding tree unit, and

the information on the coding tree unit includes:

information on whether a cross-component filter is applied to the current block of a Cb color component; and

information on whether a cross-component filter is applied to the current block of a Cr color component.

6. The method of claim 1 , wherein

the image information includes information on a coding tree unit, and

the information on the coding tree unit includes:

information on a filter set index of a cross-component filter applied to the current block of a Cb color component; and

information on a filter set index of a cross-component filter applied to the current block of a Cr color component.

7. A method of image encoding performed by an encoding apparatus, the method comprising:

deriving prediction samples for a current block;

generating prediction-related information based on the prediction samples;

generating residual samples for the current block;

deriving transform coefficients based on a transform process for the residual samples;

generating residual information based on the transform coefficients;

generating reconstructed samples based on the residual samples and the prediction samples, the reconstructed samples including reconstructed luma samples and reconstructed chroma samples;

generating information related to an adaptive loop filter (ALF) and information related to a cross-component ALF (CCALF) for the reconstructed samples; and

encoding image information including the residual information, the prediction-related information, the ALF related information, and the CCALF related information,

wherein

the image information includes a sequence parameter set (SPS) and slice header information,

the SPS includes ALF enabled flag related to whether the ALF process is enabled,

based on a value of the ALF enabled flag being 1, the SPS includes a CCALF enabled flag related to whether the CCALF is available,

based on a determination that a value of the ALF enabled flag in the SPS is 1, the slice header information includes an ALF enabled flag related to whether the ALF is enabled,

based on a determination that a value of the ALF enabled flag included in the slice header information is 1 and a value of the CCALF enabled flag included in the SPS is 1, the slice header information includes information on whether the CCALF is enabled for the filtered reconstructed chroma samples, and

based on a value of the information on whether the CCALF is enabled for the filtered reconstructed chroma samples being 1, the slice header information includes identification (ID) information of an adaptation parameter set (APS) associated with the CCALF for the filtered reconstructed chroma samples,

ALF data included in the APS includes information related to a number of the cross-component filters for the Cb color component and information related to a number of cross-component filters for the Cr component,

based on the information related to the number of the cross-component filters for the Cb color component, the ALF data includes information on absolute values of the cross-component filter coefficients for the Cb color component and information on signs of the cross-component filter coefficients for the Cb color component, and

based on information related to the number of the cross-component filters for the Cr color component, the ALF data includes information on absolute values of the cross-component filter coefficients for the Cr color component and information on signs of the cross-component filter coefficients for the Cr color component.

8. The method of claim 7 ,

wherein based on a determination that a value of the CCALF enabled flag is 1, the slice header information includes a first flag related to whether the CCALF is enabled for the Cb color component of the filtered reconstructed chroma samples and a second flag related to whether the CCALF is enabled for a Cr color component of the filtered reconstructed chroma samples.

9. The method of claim 8 , wherein

based on a value of the first flag being 1, the slice header information includes ID information of a first APS including first ALF data used for deriving cross-component filter coefficients for the Cb color component of the filtered reconstructed chroma samples and

based on a value of the second flag being 1, the slice header information includes ID information of a second APS including second ALF data used for deriving cross-component filter coefficients for the Cr color component of the filtered reconstructed chroma samples.

10. The method of claim 9 , wherein

the cross-component filter coefficients for the Cb color component are derived based on the information on the absolute values of the cross-component filter coefficients for the Cb color component and the information on the signs of the cross-component filter coefficients for the Cb color component, and

the cross-component filter coefficients for the Cr color component are derived based on the information on the absolute values of the cross-component filter coefficients for the Cr color component and the information on the signs of the cross-component filter coefficients for the Cr color component.

11. The method of claim 7 , wherein

the image information includes information on a coding tree unit, and

the information on the coding tree unit includes:

information on whether a cross-component filter is applied to the current block of a Cb color component; and

information on whether a cross-component filter is applied to the current block of a Cr color component.

12. The method of claim 7 , wherein

the image information includes information on a coding tree unit, and

the information on the coding tree unit includes:

information on a filter set index of a cross-component filter applied to the current block of a Cb color component; and

information on a filter set index of a cross-component filter applied to the current block of a Cr color component.

13. A non-transitory computer-readable storage medium storing a bitstream generated by an image encoding method, the image encoding method comprising:

deriving prediction samples for a current block;

generating prediction-related information based on the prediction samples;

generating residual samples for the current block;

deriving transform coefficients based on a transform process for the residual samples;

generating residual information based on the transform coefficients;

generating reconstructed samples based on the residual samples and the prediction samples, the reconstructed samples including reconstructed luma samples and reconstructed chroma samples;

generating information related to an adaptive loop filter (ALF) and information related to a cross-component ALF (CCALF) for the reconstructed samples; and

encoding image information to generate the bitstream, wherein the image information includes the residual information, the prediction-related information, the ALF related information, and the CCALF related information,

wherein

the image information includes a sequence parameter set (SPS) and slice header information,

the SPS includes ALF enabled flag related to whether the ALF process is enabled,

based on a value of the ALF enabled flag being 1, the SPS includes a CCALF enabled flag related to whether the CCALF is available,

based on a determination that a value of the ALF enabled flag in the SPS is 1, the slice header information includes an ALF enabled flag related to whether the ALF is enabled,

based on a determination that a value of the ALF enabled flag included in the slice header information is 1 and a value of the CCALF enabled flag included in the SPS is 1, the slice header information includes information on whether the CCALF is enabled for the filtered reconstructed chroma samples, and

based on a value of the information on whether the CCALF is enabled for the filtered reconstructed chroma samples being 1, the slice header information includes identification (ID) information of an adaptation parameter set (APS) associated with the CCALF for the filtered reconstructed chroma samples,

ALF data included in the APS includes information related to a number of the cross-component filters for the Cb color component and information related to a number of cross-component filters for the Cr component,

based on the information related to the number of the cross-component filters for the Cb color component, the ALF data includes information on absolute values of the cross-component filter coefficients for the Cb color component and information on signs of the cross-component filter coefficients for the Cb color component, and

based on information related to the number of the cross-component filters for the Cr color component, the ALF data includes information on absolute values of the cross-component filter coefficients for the Cr color component and information on signs of the cross-component filter coefficients for the Cr color component.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2026
From: LG ELECTRONICS INC.
To: HONOR DEVICE CO., LTD.
Reel/Frame 075870/0234 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2022
From: CHOI, JANGWON; NAM, JUNGHAK
To: LG ELECTRONICS INC.
Reel/Frame 060859/0249 →
Continuity (2)
Provisional Application 62893757 · Aug 29, 2019
Related Publication 20220345697A1 · Oct 27, 2022