IP Library Granted Patent US 11,582,457
Granted Patent B2
US 11,582,457 · App. 17/682,744 · Granted Feb 14, 2023

In-loop filtering-based image coding apparatus and method

Inventors: Junghak Nam (Seoul, KR); Jangwon Choi (Seoul, KR)
Assignee: LG Electionics Inc.
H04N19/132H04N19/117H04N19/176H04N19/186H04N19/1883H04N19/46H04N19/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,582,457
App. No.
17/682,744
Granted
Feb 14, 2023
Kind
B2
Abstract

According to an embodiment of the present document, a method for increasing the accuracy of in-loop filtering is proposed. In an example, the filtering accuracy of chroma blocks can be improved on the basis of luma blocks by performing a cross component adaptive loop filtering process.

Claims (87)

1. An image decoding method performed by a decoding apparatus, comprising:

obtaining image information including residual information through a bitstream;

deriving quantized transform coefficients based on the residual information;

deriving transform coefficients based on a dequantization process for the quantized transform coefficients;

deriving residual samples based on an inverse transform process for the transform coefficients;

generating reconstructed samples based on the residual samples, wherein the reconstructed samples include reconstructed lima samples and reconstructed chroma samples;

deriving ALF filter coefficients for an adaptive loop filtering (ALF) process of the reconstructed chroma samples;

generating filtered reconstructed chroma samples based on the reconstructed chroma samples and the ALF filter coefficients;

deriving cross-component filter coefficients for cross-component filtering; and

generating modified filtered reconstructed chroma samples based on the reconstructed luma samples, the filtered reconstructed chroma samples, and the cross-component filter coefficients,

wherein the image information includes header information and an adaptation parameter set (APS) including ALF data,

wherein the cross-component filter coefficients are derived based on the ALF data,

wherein the header information includes a first flag related to whether a cross-component adaptive loop filter (CCALF) is enabled for a Cb color component of the filtered reconstructed chroma samples,

wherein based on the determination that a value of the first flag is 1, the header information includes information related to an identifier of the APS for deriving the cross-component filter coefficients for the Cb color component,

wherein the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include a Cb filter signal flag related to whether the cross-component filters for the Cb color component are signaled,

wherein based on the Cb filter signal flag, the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include information related to the number of cross-component filters for the Cb color component,

wherein based on the information related to the number of cross-component filters for the Cb color component, the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include information on absolute values of the cross-component filter coefficients for the Cb color component and information on signs of the cross-component filter coefficients for the Cb color component, and

wherein the cross-component filter coefficients for the Cb color component are derived based on the information on the absolute values of the cross-component filter coefficients for the Cb color component and the information on the signs of the cross-component filter coefficients for the Cb color component.

2. The image decoding method of claim 1 , wherein the image information includes a sequence parameter set (SPS), and

wherein the SPS includes a CCALF enable flag related to whether the cross-component filtering is enabled.

3. The image decoding method of claim 2 , wherein the image information includes general constraint information,

wherein the general constraint information includes a CCALF constraint flag for constraining the cross-component filtering based on the value of the CCALF enable flag.

4. The image decoding method of claim 1 , wherein the header information further includes a second flag related to whether the CCALF is enabled for a Cr color component of the filtered reconstructed chroma samples.

5. The image decoding method of claim 1 , wherein the information related to the number of cross-component filters for the Cb color component is zero-order exponential Golomb coded.

6. The image decoding method of claim 1 , wherein the image information includes information on a coding tree unit, and

the information on the coding tree unit includes:

information on whether the cross-component filter is applied to a current block of a Cb color component; and

information on whether the cross-component filter is applied to a current block of a Cr color component.

7. The image decoding method of claim 1 , wherein the image information includes information on a coding tree unit, and

the information on the coding tree unit includes:

information on a filter set index of the cross-component filter is applied to a current block of a Cb color component; and

information on the filter set index of the cross-component filter is applied to a current block of a Cr color component.

8. An image encoding method performed by an encoding apparatus, comprising:

generating residual samples for a current block;

deriving transform coefficients based on a transform process for the residual samples;

deriving quantized transform coefficients based on a quantization process for the transform coefficients;

generating residual information indicating the quantized transform coefficients;

generating reconstructed samples based on the residual information;

generating adaptive loop filter (ALF)-related information and cross-component ALF (CCALF)-related information for the reconstructed samples; and

encoding the image information including the residual information, the ALF-related information, and the CCALF-related information,

wherein the image information includes header information and an adaptation parameter set (APS) including ALF data,

wherein the header information includes a first flag related to whether the CCALF is enabled for a Cb color component of the filtered reconstructed chroma samples,

wherein the cross-component filter coefficients are represented based on the ALF data,

wherein based on the determination that a value of the first flag is 1, the header information includes information related to an identifier of the APS for deriving the cross-component filter coefficients for the Cb color component,

wherein the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include a Cb filter signal flag related to whether the cross-component filters for the Cb color component are signaled,

wherein based on the Cb filter signal flag, the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include information related to the number of cross-component filters for the Cb color component,

wherein based on the information related to the number of cross-component filters for the Cb color component, the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include information on absolute values of the cross-component filter coefficients for the Cb color component and information on signs of the cross-component filter coefficients for the Cb color component, and

wherein the cross-component filter coefficients for the Cb color component are derived based on the information on the absolute values of the cross-component filter coefficients for the Cb color component and the information on the signs of the cross-component filter coefficients for the Cb color component.

9. The image encoding method of claim 8 , wherein the image information includes a sequence parameter set (SPS), and

wherein the SPS includes a CCALF enable flag related to whether the cross-component filtering is enabled.

10. The image encoding method of claim 8 , wherein the header further information includes a second flag related to whether the CCALF is enabled for a Cr color component of the filtered reconstructed chroma samples.

11. The image encoding method of claim 8 , wherein the information related to the number of cross-component filters for the Cb color component is zero-order exponential Golomb coded.

12. The image encoding method of claim 8 , wherein the image information includes information on a coding tree unit, and

the information on the coding tree unit includes:

information on whether the cross-component filter is applied to a current block of a Cb color component; and

information on whether the cross-component filter is applied to a current block of a Cr color component.

13. The image encoding method of claim 8 , wherein the image information includes information on a coding tree unit, and

the information on the coding tree unit includes:

information on a filter set index of the cross-component filter is applied to a current block of a Cb color component; and

information on the filter set index of the cross-component filter is applied to a current block of a Cr color component.

14. A non-transitory computer-readable storage medium storing a bitstream generated by an image encoding method, the method comprising:

generating residual samples for a current block;

deriving transform coefficients based on a transform process for the residual samples;

deriving quantized transform coefficients based on a quantization process for the transform coefficients;

generating residual information indicating the quantized transform coefficients;

generating reconstructed samples based on the residual information;

generating adaptive loop filter (ALF)-related information and cross-component ALF (CCALF)-related information for the reconstructed samples; and

encoding the image information to generate the bitstream, wherein the image information includes the residual information, the ALF-related information, and the CCALF-related information,

wherein the image information includes header information and an adaptation parameter set (APS) including ALF data,

wherein the header information includes a first flag related to whether the CCALF is enabled for a Cb color component of the filtered reconstructed chroma samples,

wherein the cross-component filter coefficients are represented based on the ALF data,

wherein based on the determination that a value of the first flag is 1, the header information includes information related to an identifier of the APS for deriving the cross-component filter coefficients for the Cb color component,

wherein the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include a Cb filter signal flag related to whether the cross-component filters for the Cb color component are signaled,

wherein based on the Cb filter signal flag, the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include information related to the number of cross-component filters for the Cb color component,

wherein based on the information related to the number of cross-component filters for the Cb color component, the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include information on absolute values of the cross-component filter coefficients for the Cb color component and information on signs of the cross-component filter coefficients for the Cb color component, and

wherein the cross-component filter coefficients for the Cb color component are derived based on the information on the absolute values of the cross-component filter coefficients for the Cb color component and the information on the signs of the cross-component filter coefficients for the Cb color component.

15. A transmission method of data for an image; the method comprising:

obtaining a bitstream for the image, wherein the bitstream is generated based on generating residual samples for a current block, deriving transform coefficients based on a transform process for the residual samples, deriving quantized transform coefficients based on a quantization process for the transform coefficients, generating residual information indicating the quantized transform coefficients, generating reconstructed samples based on the residual information, generating adaptive loop filter (ALF)-related information and cross-component ALF (CCALF)-related information for the reconstructed samples, and encoding the image information including the residual information, the ALF-related information, and the CCALF-related information; and

transmitting the data comprising the bitstream,

wherein the image information includes header information and an adaptation parameter set (APS) including ALF data,

wherein the header information includes a first flag related to whether the CCALF is enabled for a Cb color component of the filtered reconstructed chroma samples,

wherein the cross-component filter coefficients are represented based on the ALF data,

wherein based on the determination that a value of the first flag is 1, the header information includes information related to an identifier of the APS for deriving the cross-component filter coefficients for the Cb color component,

wherein the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include a Cb filter signal flag related to whether the cross-component filters for the Cb color component are signaled,

wherein based on the Cb filter signal flag, the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include information related to the number of cross-component filters for the Cb color component,

wherein based on the information related to the number of cross-component filters for the Cb color component, the ALF data included in the APS for deriving the cross-component filter coefficients for the Cb color component include information on absolute values of the cross-component filter coefficients for the Cb color component and information on signs of the cross-component filter coefficients for the Cb color component, and

wherein the cross-component filter coefficients for the Cb color component are derived based on the information on the absolute values of the cross-component filter coefficients for the Cb color component and the information on the signs of the cross-component filter coefficients for the Cb color component.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2022
From: NAM, JUNGHAK; CHOI, JANGWON
To: LG ELECTRONICS INC.
Reel/Frame 061251/0102 →
Continuity (3)
Continuation PCTKR2020011597 · Aug 31, 2020
Provisional Application 62893748 · Aug 29, 2019
Related Publication 20220182641A1 · Jun 9, 2022
Cited By (2)
US 12,445,637 US 12,501,064