Joint component video frame filtering
A filter may be applied to a subset of components associated with a sample in a coding block. The output of the filter may be used to modify values for other component(s). For example, a filter may be applied to a selected (for example, dominant) component(s). The output of the filter may be used to modify a value for one of the other components (for example, non-dominant components). The output of the filter may be used, for example, after a weighting factor is applied to the filter output, to modify a value for another one of the other components. A joint refinement signal may be obtained, for example, as the filtered output signal minus the filter input signal of the selected component(s). A properly weighted version of the joint refinement signal may be applied to modify the other components.
1. An apparatus for video decoding, comprising one or more processors, wherein the one or more processors are configured to:
obtain a filter associated with a coding block comprising a first component, a second component and a third component, wherein the filter is associated with the second component and the third component;
apply the filter to a value of the first component associated with a sample in the coding block to obtain an output of the filter;
modify a value for the second component associated with the sample in the coding block using the output of the filter to obtain a modified value for the second component;
obtain a weighting factor associated with the third component;
apply the weighting factor to the output of the filter to generate a weighted filter output; and
modify a value for the third component associated with the sample in the coding block using the weighted filter output to obtain a modified-weighted value for the third component.
2. The video decoding apparatus of claim 1 , wherein the filter is derived based on the second component and the third component.
3. The video decoding apparatus of claim 1 , wherein the one or more processors are further configured to:
reconstruct the value for the first component, wherein the value for the first component is constructed before the filter is applied to the value of the first component to generate the output of the filter; and
obtain a refinement signal for the second component and for the third component based on a difference between the output of the filter and the value for the first component.
4. The video decoding apparatus of claim 1 , wherein the one or more processors are further configured to:
reconstruct the value for the first component, the value for the second component, and the value for the third component associated with the sample in the coding block, wherein the value for the first component is constructed before the filter is applied to the value of the first component to generate the output of the filter;
obtain a refinement signal for the second component and for the third component based on a difference between the output of the filter and the value for the first component;
obtain a first weighting factor associated with the second component;
determine a first weighted refinement signal based on the first weighting factor and the refinement signal for the second component and for the third component;
obtain a second weighting factor associated with the third component; and
determine a second weighted refinement signal based on the second weighting factor and the refinement signal for the second component and for the third component, wherein the value for the second component associated with the sample in the coding block is modified using the first weighted refinement signal, and the value for the third component associated with the sample in the coding block is modified using the second weighted refinement signal.
5. The video decoding apparatus of claim 1 , wherein the filter is a cross-component adaptive loop filter (CCALF), the first component is a luma component, the second component and the third component are chroma components, and the one or more processors are further configured to:
obtain a chroma adaptive loop filter (ALF) associated with the second component and the third component; and
apply the chroma ALF to the second component and the third component to generate the value for the second component and the value for the third component.
6. The video decoding apparatus of claim 1 , wherein the filter is a cross-component adaptive loop filter (CCALF), and the value for the second component and the value for the third component are not filtered by a chroma ALF.
7. The video decoding apparatus of claim 1 , wherein the value for the second component associated with the sample in the coding block is refined using the output of the filter, and the value for the third component associated with the sample in the coding block is refined using the output of the filter.
8. The video decoding apparatus of claim 1 , wherein the filter comprises a set of coefficients, wherein the set of coefficients are obtained based on the second component and the third component.
9. The video decoding apparatus of claim 1 , wherein the apparatus further comprises a memory.
10. A method for video decoding, comprising:
obtaining a filter associated with a coding block comprising a first component, a second component, and a third component, wherein the filter is associated with the second component and the third component;
applying the filter to a value of the first component associated with a sample in the coding block to obtain an output of the filter;
modifying a value for the second component associated with the sample in the coding block using the output of the filter to obtain a modified value for the second component;
obtaining a weighting factor associated with the third component;
applying the weighting factor to the output of the filter to generate a weighted filter output; and
modifying a value for the third component associated with the sample in the coding block using the weighted filter output to obtain a modified-weighted value for the third component.
11. The video decoding method of claim 10 , wherein the filter is derived based on the second component and the third component.
12. The video decoding method of claim 10 , further comprising:
reconstructing the value for the first component, wherein the value for the first component is constructed before the filter is applied to the first component to generate the output of the filter; and
obtaining a refinement signal for the second component and for the third component based on a difference between the output of the filter and the value for the first component.
13. The video decoding method of claim 10 , further comprising:
reconstructing the value for the first component, the value for the second component, and the value for the third component associated with the sample in the coding block, wherein the value for the first component is constructed before the filter is applied to the value of the first component to generate the output of the filter;
obtaining a refinement signal for the second component and for the third component based on a difference between the output of the filter and the value for the first component;
obtaining a first weighting factor associated with the second component;
determining a first weighted refinement signal based on the first weighting factor and the refinement signal for the second component and for the third component;
obtaining a second weighting factor associated with the third component; and
determining a second weighted refinement signal based on the second weighting factor and the refinement signal for the second component and for the third component, wherein the value for the second component associated with the sample in the coding block is modified using the first weighted refinement signal, and the value for the third component associated with the sample in the coding block is modified using the second weighted refinement signal.
14. The video decoding method of claim 10 , wherein the filter is a cross-component adaptive loop filter (CCALF), the first component is a luma component, the second component and the third component are chroma components, and the method further comprises:
obtaining a chroma adaptive loop filter (ALF) associated with the second component and the third component; and
applying the chroma ALF to the second component and the third component to generate the value for the second component and the value for the third component.
15. The video decoding method of claim 10 , wherein the filter is a cross-component adaptive loop filter (CCALF), and the value for the second component and the value for the third component are not filtered by a chroma ALF.
16. The video decoding method of claim 10 , wherein the value for the second component associated with the sample in the coding block is refined using the output of the filter, and the value for the third component associated with the sample in the coding block is refined using the output of the filter.
17. The video decoding method of claim 10 , wherein the filter comprises a set of coefficients, and wherein the set of coefficients are obtained based on the second component and the third component.
18. A non-transitory computer readable medium including instructions for causing one or more processors to:
obtain a filter associated with a coding block comprising a first component, a second component, and a third component, wherein the filter is associated with the second component and the third component;
apply the filter to a value of the first component associated with a sample in the coding block to obtain an output of the filter;
modify a value for the second component associated with the sample in the coding block using an output of the filter to obtain a modified value for the second component;
obtain a weighting factor associated with the third component;
apply the weighting factor to the output of the filter to generate a weighted filter output; and
modify a value for the third component associated with the sample in the coding block using the weighted filter output to obtain a modified-weighted value for the third component.