IP Library › Granted Patent US 11,736,697
Granted Patent B2
US 11,736,697 · App. 17/732,692 · Granted Aug 22, 2023

Cross-component adaptive loop filter

Inventors: Li Zhang (San Diego, CA); Weijia Zhu (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/132H04N9/77H04N19/117H04N19/136H04N19/17H04N19/186H04N19/70H04N19/80H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,736,697
App. No.
17/732,692
Granted
Aug 22, 2023
Kind
B2
Abstract

A method of video processing includes making a determination for a conversion between a video region of a video and a bitstream representation of the video to use a cross-component adaptive loop filtering (CC-ALF) tool for refining chroma samples values using luma sample values; and performing the conversion based on the determination, wherein the refining includes correcting the chroma sample values using a final refinement that is a further refinement of a first refinement value determined by selectively filtering the luma sample values.

Claims (34)

1. A method of processing video data, comprising:

deriving, for a conversion between a video region of a video and a bitstream of the video, a first offset used in a cross-component filtering tool for a chroma sample of the video region, wherein the first offset is derived based on values of luma samples in a filter support region and filter coefficients, wherein the filter support region used for the cross-component filtering tool is a diamond shaped luma region;

deriving a second offset used in the cross-component filtering tool for the chroma sample based on using a clipping operation to the first offset, wherein the second offset is clipped to a given range; and

performing the conversion by applying the cross-component filtering tool to refine the chroma sample by adding the second offset offset to a value of the chroma sample, wherein the value of the chroma sample is modified by a chroma adaptive loop filter process before a refinement by the cross-component filtering tool.

2. The method of claim 1 , wherein the first offset is derived based on applying filtering coefficients on luma sample differences, and

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample.

3. The method of claim 2 , wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format, and wherein (x, y) indicates a coordinate of the chroma sample.

4. The method of claim 2 , wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample.

5. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

6. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

7. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

derive, for a conversion between a video region of a video and a bitstream of the video, a first offset used in a cross-component filtering tool for a chroma sample of the video, wherein the first offset is derived based on values of luma samples in a filter support region and filter coefficients, wherein the filter support region used for the cross-component filtering tool is a diamond shaped luma region;

derive a second offset used in the cross-component filtering tool for the chroma sample based on using a clipping operation to the first offset, wherein the second offset is clipped to a given range; and

perform the conversion by applying the cross-component filtering tool to refine the chroma sample by adding the second offset offset to a value of the chroma sample, wherein the value of the chroma sample is modified by a chroma adaptive loop filter process before a refinement by the cross-component filtering tool.

8. The apparatus of claim 7 , wherein the first offset is derived based on applying filtering coefficients on luma sample differences, and

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample.

9. The apparatus of claim 8 , wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format, and wherein (x, y) indicates a coordinate of the chroma sample; or

wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample.

10. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

derive, for a conversion between a video region of a video and a bitstream of the video, a first offset used in a cross-component filtering tool for a chroma sample of the video, wherein the first offset is derived based on values of luma samples in a filter support region and filter coefficients, wherein the filter support region used for the cross-component filtering tool is a diamond shaped luma region;

derive a second offset used in the cross-component filtering tool for the chroma sample based on using a clipping operation to the first offset, wherein the second offset is clipped to a given range; and

perform the conversion by applying the cross-component filtering tool to refine the chroma sample by adding the second offset offset to a value of the chroma sample, wherein the value of the chroma sample is modified by a chroma adaptive loop filter process before a refinement by the cross-component filtering tool.

11. The non-transitory computer-readable storage medium of claim 10 , wherein the first offset is derived based on applying filtering coefficients on luma sample differences, and

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample.

12. The non-transitory computer-readable storage medium of claim 11 , wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format, and wherein (x, y) indicates a coordinate of the chroma sample; or

wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample.

13. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

deriving, for a video region of a video, a first offset used in a cross-component filtering tool for a chroma sample of the video region, wherein the first offset is derived based on values of luma samples in a filter support region and filter coefficients, wherein the filter support region used for the cross-component filtering tool is a diamond shaped luma region;

deriving a second offset used in the cross-component filtering tool for the chroma sample based on using a clipping operation to the first offset, wherein the second offset is clipped to a given range; and

generating the bitstream by applying the cross-component filtering tool to refine the chroma sample by adding the second offset offset to a value of the chroma sample, wherein the value of the chroma sample is modified by a chroma adaptive loop filter process before a refinement by the cross-component filtering tool.

14. The non-transitory computer-readable recording medium of claim 13 , wherein the first offset is derived based on applying filtering coefficients on luma sample differences, and

wherein each luma sample difference corresponds to a difference between a value of a luma sample in a filter support region and a value of a corresponding luma sample of the chroma sample.

15. The non-transitory computer-readable recording medium of claim 14 , wherein the corresponding luma sample is located at (x, y) for the video region that is in 4:4:4 format, and wherein (x, y) indicates a coordinate of the chroma sample; or

wherein the corresponding luma sample is located at (2x, 2y) for the video region that is in 4:2:0 format, and wherein (x, y) indicates a coordinate of the chroma sample.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: ZHANG, LI; ZHU, WEIJIA; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 059716/0289 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: LIU, HONGBIN
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059716/0400 →
Priority Claims (1)
WO PCT/CN2019/113955 · Oct 29, 2019 · international
Continuity (2)
Continuation PCTCN2020124700 · Oct 29, 2020
Related Publication 20220272389A1 · Aug 25, 2022