IP Library › Granted Patent US 11,595,697

Granted Patent B2

US 11,595,697 · App. 17/682,723 · Granted Feb 28, 2023

Adaptive loop filtering-based image coding apparatus and method

Inventors: Junghak Nam (Seoul, KR); Jangwon Choi (Seoul, KR)

Assignee: LG Electronics Inc.

H04N19/82 H04N19/117 H04N19/18 H04N19/186 H04N19/70 H04N19/96 H04N19/139

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 11,595,697
App. No.: 17/682,723
Granted: Feb 28, 2023
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

According to one embodiment of the present document, filtering for chroma blocks can be performed on the basis of luma blocks. For example, a cross component adaptive loop filtering process can be performed. Therefore, the accuracy of in-loop filtering can be improved.

Claims (83)

1. An image decoding method performed by a decoding apparatus, comprising:

obtaining image information including prediction-related information and residual information through a bitstream;

deriving transform coefficients based on the residual information;

generating residual samples based on the transform coefficients;

generating prediction samples based on the prediction-related information;

generating reconstructed samples based on the prediction samples and the residual samples, the reconstructed samples including reconstructed luma samples and reconstructed chroma samples;

deriving adaptive loop filter (ALF) filter coefficients for an ALF process of the reconstructed chroma samples;

generating filtered reconstructed chroma samples based on the reconstructed chroma samples and the ALF filter coefficients;

deriving cross-component filter coefficients for cross-component filtering; and

generating modified filtered reconstructed chroma samples based on the reconstructed luma samples, the filtered reconstructed chroma samples, and the cross-component filter coefficients,

wherein the image information includes information on cross-component filtering,

wherein the information on the cross-component filtering includes information on a number of the cross-component filters for the cross-component filtering and information on the cross-component filter coefficients,

wherein the number of cross-component filters for the cross-component filtering is derived based on the information on the number of the cross-component filters for the cross-component filtering,

wherein the information on the cross-component filter coefficients is derived based on the number of cross-component filters for the cross-component filtering, and

wherein the cross-component filter coefficients for the cross-component filtering are derived based on the information on the cross-component filter coefficients.

2. The image decoding method of claim 1 , wherein the image information includes a sequence parameter set (SPS),

wherein the SPS includes a cross-component adaptive loop filter (CCALF) enable flag related to whether the cross-component filtering is enabled, and

wherein ID information of adaptation parameter sets (APSs) including ALF data used for deriving the cross-component filter coefficients is derived based on the CCALF enable flag.

3. The image decoding method of claim 1 , wherein the image information includes slice header information, and

wherein the slice header information includes a first flag related to whether the CCALF is enabled for a Cb color component of the filtered reconstructed chroma samples, and a second flag related to whether the CCALF is enabled for a Cr color component of the filtered reconstructed chroma samples.

4. The image decoding method of claim 3 , wherein the image information includes adaptation parameter sets (APSs),

wherein based on a determination that a value of the first flag is 1, the slice header information includes ID information of a first APS including first ALF data used for the derivation of the cross-component filter coefficients for the Cb color component, and

wherein based on a determination that a value of the second flag is 1, the slice header information includes ID information of a second APS including second ALF data used for the derivation of the cross-component filter coefficients for the Cr color component.

5. The image decoding method of claim 4 , wherein the first ALF data includes a Cb filter signal flag related to whether the cross-component filters for the Cb color component are signaled,

wherein based on the Cb filter signal flag, the first ALF data includes information related to the number of cross-component filters for the Cb color component,

wherein based on the information related to the number of cross-component filters for the Cb color component, the first ALF data includes information on absolute values of the cross-component filter coefficients for the Cb color component and information on signs of the cross-component filter coefficients for the Cb color component, and

wherein based on the information on the absolute values of the cross-component filter coefficients for the Cb color component and the information on the signs of the cross-component filter coefficients for the Cb color component, the cross-component filter coefficients for the Cb color component are derived.

6. The image decoding method of claim 4 , wherein the second ALF data includes a Cr filter signal flag related to whether the cross-component filters for the Cr color component are signaled,

wherein based on the Cr filter signal flag, the second ALF data includes information related to the number of cross-component filters for the Cr color component,

wherein based on the information related to the number of cross-component filters for the Cr color component, the second ALF data includes information on absolute values of the cross-component filter coefficients for the Cr color component and information on signs of the cross-component filter coefficients for the Cr color component, and

wherein based on the information on the absolute values of the cross-component filter coefficients for the Cr color component and the information on the signs of the cross-component filter coefficients for the Cr color component, the cross-component filter coefficients for the Cr color component are derived.

7. The image decoding method of claim 1 , wherein the image information includes information on a coding tree unit, and

wherein the information on the coding tree unit includes:

information on whether a cross-component filter is applied to a current block of a Cb color component; and

information on whether a cross-component filter is applied to a current block of a Cr color component.

8. The image decoding method of claim 1 , wherein the image information includes information on a coding tree unit, and

wherein the information on the coding tree unit includes:

information on a filter set index of a cross-component filter that is applied to a current block of a Cb color component; and

information on a filter set index of a cross-component filter that is applied to a current block of a Cr color component.

9. An image encoding method performed by an encoding apparatus, comprising:

generating prediction samples for a current block;

generating prediction-related information based on the prediction samples;

generating residual samples for the current block;

deriving transform coefficients based on a transform process for the residual samples;

generating residual information based on the transform coefficients;

generating reconstructed samples based on the residual samples and the prediction samples;

generating adaptive loop filter (ALF)-related information and information on cross-component filtering for the reconstructed samples; and

encoding image information including the residual information, the prediction-related information, the ALF-related information, and the information on the cross-component filtering,

wherein the information on the cross-component filtering includes information on a number of cross-component filters for the cross-component filtering and information on cross-component filter coefficients,

wherein the number of the cross-component filters for the cross-component filtering is represented based on the information on the number of cross-component filters for the cross-component filtering process,

wherein the cross-component filter coefficients are represented based on the information on the cross-component filter coefficients, and

wherein the information on the cross-component filter coefficients is included in the information on the cross-component filtering based on the number of cross-component filters.

10. The image encoding method of claim 9 , wherein the image information includes a sequence parameter set (SPS),

wherein the SPS includes a CCALF enable flag related to whether the CCALF is enabled, and

wherein ID information of adaptation parameter sets (APSs) including ALF data used for deriving the cross-component filter coefficients for the CCALF is derived based on the CCALF enable flag.

11. The image encoding method of claim 9 , wherein the image information includes slice header information, and

wherein the slice header information includes a first flag related to whether the CCALF is enabled for a Cb color component of filtered reconstructed chroma samples, and a second flag related to whether the CCALF is enabled for a Cr color component of the filtered reconstructed chroma samples.

12. The image encoding method of claim 11 , wherein the image information includes adaptation parameter sets (APSs),

13. The image encoding method of claim 12 , wherein the first ALF data includes a Cb filter signal flag related to whether the cross-component filters for the Cb color component are signaled,

wherein based on the Cb filter signal flag, the first ALF data includes information related to the number of cross-component filters for the Cb color component,

14. The image encoding method of claim 12 , wherein the second ALF data includes a Cr filter signal flag related to whether the cross-component filters for the Cr color component are signaled,

wherein based on the Cr filter signal flag, the second ALF data includes information related to the number of cross-component filters for the Cr color component,

15. The image encoding method of claim 9 , wherein the image information includes information on a coding tree unit, and

wherein the information on the coding tree unit includes:

information on whether a cross-component filter is applied to a current block of a Cb color component; and

information on whether a cross-component filter is applied to a current block of a Cr color component.

16. The image encoding method of claim 9 , wherein the image information includes information on a coding tree unit, and

wherein the information on the coding tree unit includes:

information on a filter set index of a cross-component filter that is applied to a current block of a Cb color component; and

information on a filter set index of a cross-component filter that is applied to a current block of a Cr color component.

17. A transmission method of data for an image, the method comprising:

obtaining a bitstream for the image, wherein the bitstream is generated based on generating prediction samples for a current block, generating prediction-related information based on the prediction samples, generating residual samples for the current block, deriving transform coefficients based on a transform process for the residual samples, generating residual information based on the transform coefficients, generating reconstructed samples based on the residual samples and the prediction samples, generating adaptive loop filter (ALF)-related information and information on cross-component filtering for the reconstructed samples, encoding image information including the residual information, the prediction-related information, the ALF-related information, and the information on the cross-component filtering; and

transmitting the data comprising the bitstream,

wherein the cross-component filter coefficients are represented based on the information on the cross-component filter coefficients, and

wherein the information on the cross-component filter coefficients is included in the information on the cross-component filtering based on the number of cross-component filters.

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2022

From: NAM, JUNGHAK; CHOI, JANGWON

To: LG ELECTRONICS INC.

Reel/Frame 060645/0363 →

Continuity (3)

Continuation PCTKR2020011599 · Aug 31, 2020

Provisional Application 62893755 · Aug 29, 2019

Related Publication 20220201338A1 · Jun 23, 2022