IP Library › Granted Patent US 11,722,674
Granted Patent B2
US 11,722,674 · App. 17/732,743 · Granted Aug 8, 2023

Cross-component adaptive loop filter using luma differences

Inventors: Li Zhang (San Diego, CA); Weijia Zhu (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/132H04N9/77H04N19/117H04N19/136H04N19/17H04N19/186H04N19/70H04N19/80H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,722,674
App. No.
17/732,743
Granted
Aug 8, 2023
Kind
B2
Abstract

A method of video processing includes determining, for a conversion between a video region of a video and a bitstream representation of the video, to correct chroma samples of the video region using a cross-component adaptive loop filter (CC-ALF) process based on filtering of luma sample differences; and performing the conversion based on the determining.

Claims (35)

1. A method of processing video data, comprising:

determining, for a conversion between a video region of a video and a bitstream of the video, to apply a cross-component filter process on a chroma sample of the video region, wherein in the cross-component filter process, the chroma sample is refined based on applying filtering coefficients on luma sample differences; and

performing the conversion based on the determining,

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample, and wherein the filter support region used for the cross-component filter process is a diamond shaped luma region including the corresponding luma sample.

2. The method of claim 1 , wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format, and wherein (x, y) indicates a coordinate of the chroma sample.

3. The method of claim 1 , wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample.

4. The method of claim 1 , wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:2 format, and wherein (x, y) indicates a coordinate of the chroma sample.

5. The method of claim 1 , wherein an indication of usage of the cross-component filter process is conditionally included in the bitstream at a sequence parameter set (SPS) level based on whether an adaptive loop filter tool is enabled.

6. The method of claim 5 , wherein the indication is conditionally included in the bitstream further based on a chroma color format.

7. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

8. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

9. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a video region of a video and a bitstream of the video, to apply a cross-component filter process on a chroma sample of the video region, wherein in the cross-component filter process, the chroma sample is refined based on applying filtering coefficients on luma sample differences; and

perform the conversion based on the determination,

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample, and wherein the filter support region used for the cross-component filter process is a diamond shaped luma region including the corresponding luma sample.

10. The apparatus of claim 9 , wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format, and wherein (x, y) indicates a coordinate of the chroma sample; or

wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample.

11. The apparatus of claim 9 , wherein an indication of usage of the cross-component filter process is conditionally included in the bitstream at a sequence parameter set (SPS) level based on whether an adaptive loop filter tool is enabled.

12. The apparatus of claim 11 , wherein the indication is conditionally included in the bitstream further based on a chroma color format.

13. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a video region of a video and a bitstream of the video, to apply a cross-component filter process on a chroma sample of the video region, wherein in the cross-component filter process, the chroma sample is refined based on applying filtering coefficients on luma sample differences; and

perform the conversion based on the determination,

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample, and wherein the filter support region used for the cross-component filter process is a diamond shaped luma region including the corresponding luma sample.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format, and wherein (x, y) indicates a coordinate of the chroma sample; or

wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample.

15. The non-transitory computer-readable storage medium of claim 13 , wherein an indication of usage of the cross-component filter process is conditionally included in the bitstream at a sequence parameter set (SPS) level based on whether an adaptive loop filter tool is enabled.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the indication is conditionally included in the bitstream further based on a chroma color format.

17. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a video region of the video, to apply a cross-component filter process on a chroma sample of the video region, wherein in the cross-component filter process, the chroma sample is refined based on applying filtering coefficients on luma sample differences; and

generating the bitstream based on the determining,

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample, and wherein the filter support region used for the cross-component filter process is a diamond shaped luma region including the corresponding luma sample.

18. The non-transitory computer-readable recording medium of claim 17 , wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format, and wherein (x, y) indicates a coordinate of the chroma sample; or

wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample.

19. The non-transitory computer-readable recording medium of claim 17 , wherein an indication of usage of the cross-component filter process is conditionally included in the bitstream at a sequence parameter set (SPS) level based on whether an adaptive loop filter tool is enabled.

20. The non-transitory computer-readable recording medium of claim 19 , wherein the indication is conditionally included in the bitstream further based on a chroma color format.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: ZHANG, LI; ZHU, WEIJIA; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 059716/0568 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: LIU, HONGBIN
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059836/0402 →
Priority Claims (1)
WO PCT/CN2019/113955 · Oct 29, 2019 · international
Continuity (2)
Continuation PCTCN2020124701 · Oct 29, 2020
Related Publication 20220272348A1 · Aug 25, 2022
Cited By (2)
US 12,513,291 US 12,621,450