Granted Patent B2

US 12,206,859 · App. 18/453,041 · Granted Jan 21, 2025

Inventors: Li Zhang (San Diego, CA); Weijia Zhu (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN)

Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.

H04N19/132H04N9/77H04N19/117H04N19/136H04N19/17H04N19/186H04N19/70H04N19/80H04N19/82

Abstract

Claims (65)

1. A method of processing video data, comprising:

deriving, for a conversion between a video region of a video and a bitstream of the video, a first offset used in a cross-component filtering tool for a chroma sample of the video region based on luma samples of the video region;

deriving a second offset used in the filtering tool for the chroma sample based on the first offset; and

performing the conversion by applying the cross-component filtering tool to refine the chroma sample based on the second offset;

wherein an indication of usage of the cross-component filtering tool is conditionally included in the bitstream at a sequence parameter set (SPS) level based on whether an adaptive loop filter tool is enabled; and

wherein a first syntax element indicating an applicability of the cross-component filtering tool is included in the bitstream in a picture header or a slice header in case that the indication indicates that the cross-component filtering tool is enabled at the SPS level.

2. The method of claim 1 , wherein the second offset is derived using a clipping operation of the first offset.

3. The method of claim 1 , wherein the second offset is clipped to a given range.

4. The method of claim 1 , wherein the first offset is derived based on applying filtering coefficients on luma sample differences, and

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample.

5. The method of claim 4 , wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format, and wherein (x, y) indicates a coordinate of the chroma sample.

6. The method of claim 4 , wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample.

7. The method of claim 1 , wherein the indication of usage of the cross-component filtering tool is conditionally included in the bitstream further based on a chroma color format.

8. The method of claim 1 , wherein the indication is not explicitly included in case that the adaptive loop filter tool is disabled.

9. The method of claim 1 , wherein information related to the cross-component filtering tool is excluded from the bitstream in case that the adaptive loop filter tool is disabled.

10. The method of claim 9 , wherein the information related to the cross-component filtering tool includes at least one of a second syntax element which specifies that the cross-component filtering tool is enabled or not for a blue difference chroma (Cb) color component, or a third syntax element which specifies that the cross-component filtering tool is enabled or not for a red difference chroma (Cr) color component, and

wherein the information related to the cross-component filtering tool further includes a fourth syntax element, which specifies a first identifier of a first adaptive loop filter that a Cb color component of a current slice refers to, when the second syntax element indicates that the cross-component filtering tool is enabled for the Cb color component; and wherein the information related to the cross-component filtering tool further includes a fifth syntax element, which specifies a second identifier of a second adaptive loop filter that a Cr color component of the current slice refers to, when the third syntax element indicates that the cross-component filtering tool is enabled for the Cr color component.

11. The method of claim 1 , wherein a conformance bitstream satisfies that an identifier of an adaptive loop filter for the cross-component filtering tool included in the bitstream shall refer to one available adaptive loop filter.

12. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

13. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

14. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

derive, for a conversion between a video region of a video and a bitstream of the video, a first offset used in a cross-component filtering tool for a chroma sample of the video region based on luma samples of the video region;

derive a second offset used in the filtering tool for the chroma sample based on the first offset; and

perform the conversion by applying the cross-component filtering tool to refine the chroma sample based on the second offset;

wherein an indication of usage of the cross-component filtering tool is conditionally included in the bitstream at a sequence parameter set (SPS) level based on whether an adaptive loop filter tool is enabled; and

wherein a first syntax element indicating an applicability of the cross-component filtering tool is included in the bitstream in a picture header or a slice header in case that the indication indicates that the cross-component filtering tool is enabled at the SPS level.

15. The apparatus of claim 14 , wherein the second offset is derived using a clipping operation of the first offset,

wherein the second offset is clipped to a given range,

wherein the first offset is derived based on applying filtering coefficients on luma sample differences,

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample,

wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format,

wherein (x, y) indicates a coordinate of the chroma sample,

wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample,

wherein the indication of usage of the cross-component filtering tool is conditionally included in the bitstream further based on a chroma color format,

wherein the indication is not explicitly included in case that the adaptive loop filter tool is disabled,

wherein information related to the cross-component filtering tool is excluded from the bitstream in case that the adaptive loop filter tool is disabled,

wherein the information related to the cross-component filtering tool includes at least one of a second syntax element which specifies that the cross-component filtering tool is enabled or not for a blue difference chroma (Cb) color component, or a third syntax element which specifies that the cross-component filtering tool is enabled or not for a red difference chroma (Cr) color component,

wherein the information related to the cross-component filtering tool further includes a fourth syntax element, which specifies a first identifier of a first adaptive loop filter that a Cb color component of a current slice refers to, when the second syntax element indicates that the cross-component filtering tool is enabled for the Cb color component; and wherein the information related to the cross-component filtering tool further includes a fifth syntax element, which specifies a second identifier of a second adaptive loop filter that a Cr color component of the current slice refers to, when the third syntax element indicates that the cross-component filtering tool is enabled for the Cr color component, and

wherein a conformance bitstream satisfies that an identifier of an adaptive loop filter for the cross-component filtering tool included in the bitstream shall refer to one available adaptive loop filter.

16. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

derive, for a conversion between a video region of a video and a bitstream of the video, a first offset used in a cross-component filtering tool for a chroma sample of the video region based on luma samples of the video region;

derive a second offset used in the filtering tool for the chroma sample based on the first offset; and

perform the conversion by applying the cross-component filtering tool to refine the chroma sample based on the second offset;

wherein an indication of usage of the cross-component filtering tool is conditionally included in the bitstream at a sequence parameter set (SPS) level based on whether an adaptive loop filter tool is enabled; and

wherein a first syntax element indicating an applicability of the cross-component filtering tool is included in the bitstream in a picture header or a slice header in case that the indication indicates that the cross-component filtering tool is enabled at the SPS level.

17. A method for storing a bitstream of a video, comprising:

deriving, for a video region of a video, a first offset used in a cross-component filtering tool for a chroma sample of the video region based on luma samples of the video region;

deriving a second offset used in the filtering tool for the chroma sample based on the first offset;

generating the bitstream by applying the cross-component filtering tool to refine the chroma sample based on the second offset; and

storing the bitstream in a non-transitory computer-readable recording medium,

wherein an indication of usage of the cross-component filtering tool is conditionally included in the bitstream at a sequence parameter set (SPS) level based on whether an adaptive loop filter tool is enabled; and

wherein a first syntax element indicating an applicability of the cross-component filtering tool is included in the bitstream in a picture header or a slice header in case that the indication indicates that the cross-component filtering tool is enabled at the SPS level.

18. The method of claim 17 , wherein the second offset is derived using a clipping operation of the first offset,

wherein the second offset is clipped to a given range,

wherein the first offset is derived based on applying filtering coefficients on luma sample differences,

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample,

wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format,

wherein (x, y) indicates a coordinate of the chroma sample,

wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample,

wherein the indication of usage of the cross-component filtering tool is conditionally included in the bitstream further based on a chroma color format,

wherein the indication is not explicitly included in case that the adaptive loop filter tool is disabled,

wherein information related to the cross-component filtering tool is excluded from the bitstream in case that the adaptive loop filter tool is disabled,

wherein the information related to the cross-component filtering tool includes at least one of a second syntax element which specifies that the cross-component filtering tool is enabled or not for a blue difference chroma (Cb) color component, or a third syntax element which specifies that the cross-component filtering tool is enabled or not for a red difference chroma (Cr) color component,

wherein the information related to the cross-component filtering tool further includes a fourth syntax element, which specifies a first identifier of a first adaptive loop filter that a Cb color component of a current slice refers to, when the second syntax element indicates that the cross-component filtering tool is enabled for the Cb color component; and wherein the information related to the cross-component filtering tool further includes a fifth syntax element, which specifies a second identifier of a second adaptive loop filter that a Cr color component of the current slice refers to, when the third syntax element indicates that the cross-component filtering tool is enabled for the Cr color component, and

wherein a conformance bitstream satisfies that an identifier of an adaptive loop filter for the cross-component filtering tool included in the bitstream shall refer to one available adaptive loop filter.

Assignments (2)

Priority Claims (1)

Continuity (3)

References Cited (158)

Cited By (2)

US 12,513,291 US 12,621,450