IP Library Granted Patent US 11,785,260
Granted Patent B2
US 11,785,260 · App. 17/716,447 · Granted Oct 10, 2023

Cross-component adaptive loop filtering in video coding

Inventors: Weijia Zhu (San Diego, CA); Li Zhang (San Diego, CA); Jizheng Xu (San Diego, CA); Kai Zhang (San Diego, CA)
Assignee: BYTEDANCE INC.
H04N19/82H04N19/117H04N19/186H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,785,260
App. No.
17/716,447
Granted
Oct 10, 2023
Kind
B2
Abstract

An example method of video processing includes making a determination, for a conversion between a current video block of a video and a bitstream representation of the video, whether a cross-component adaptive loop filtering tool is enabled for the current video block based on a color property of the video. The method also includes performing the conversion according to the determination.

Claims (46)

1. A method of processing video data, comprising:

performing a conversion between a current video unit of a video and a bitstream of the video according to a rule, wherein the rule specifies that a first filtering process being enabled for the current video unit is dependent on a color sampling format of the video being only one of 4:2:0, 4:2:2 or 4:4:4;

wherein the first filtering process is a cross-component adaptive loop filtering process which uses values of luma samples to refine each chroma component by applying a filtering operation to a luma component and then using an output of the filtering operation for chroma refinement in a loop filtering process,

wherein luma positions of the luma samples of the luma component used in the first filtering process are determined based on the color sampling format.

2. The method of claim 1 , wherein filter coefficients for the first filtering process are included in an adaptation parameter set, and the adaptation parameter set is allowed to be referenced in a slice header of a slice to which the current video unit belongs.

3. The method of claim 1 , wherein a first syntax element indicating usage of a coding tool for coding at least a first portion of multiple portions of the video is selectively included in a first video unit level of the bitstream based on a second syntax element included in a second video unit level of the bitstream.

4. The method of claim 3 , wherein the first portion of the multiple portions comprises a picture, and the first video unit level is a picture header.

5. The method of claim 3 , wherein the coding tool comprises a Bi-Direction Optical Flow coding tool.

6. The method of claim 3 , wherein the coding tool comprises a Decoder-side Motion Vector Refinement coding tool.

7. The method of claim 3 , wherein the second video unit level is a sequence parameter set.

8. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

9. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a current video unit of a video and a bitstream of the video according to a rule, wherein the rule specifies that a first filtering process being enabled for the current video unit is dependent on a color sampling format of the video being only one of 4:2:0, 4:2:2 or 4:4:4;

wherein the first filtering process is a cross-component adaptive loop filtering process which uses values of luma samples to refine each chroma component by applying a filtering operation to a luma component and then using an output of the filtering operation for chroma refinement in a loop filtering process,

wherein luma positions of the luma samples of the luma component used in the first filtering process are determined based on the color sampling format.

11. The apparatus of claim 10 , wherein filter coefficients for the first filtering process are included in an adaptation parameter set, and the adaptation parameter set is allowed to be referenced in a slice header of a slice to which the current video unit belongs.

12. The apparatus of claim 10 , wherein a first syntax element indicating usage of a coding tool for coding at least a first portion of multiple portions of the video is selectively included in a first video unit level of the bitstream based on a second syntax element included in a second video unit level of the bitstream;

wherein the first portion of the multiple portions comprises a picture, and the first video unit level is a picture header;

wherein the coding tool comprises a Bi-Direction Optical Flow coding tool;

wherein the coding tool comprises a Decoder-side Motion Vector Refinement coding tool; and

wherein the second video unit level is a sequence parameter set.

13. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a current video unit of a video and a bitstream of the video according to a rule, wherein the rule specifies that a first filtering process being enabled for the current video unit is dependent on a color sampling format of the video being only one of 4:2:0, 4:2:2 or 4:4:4;

perform the conversion according to the determination,

wherein the first filtering process is a cross-component adaptive loop filtering process which uses values of luma samples to refine each chroma component by applying a filtering operation to a luma component and then using an output of the filtering operation for chroma refinement in a loop filtering process,

wherein luma positions of the luma samples of the luma component used in the first filtering process are determined based on the color sampling format.

14. The non-transitory computer-readable storage medium of claim 13 ,

wherein filter coefficients for the first filtering process are included in an adaptation parameter set, and the adaptation parameter set is allowed to be referenced in a slice header of a slice to which the current video unit belongs.

15. The non-transitory computer-readable storage medium of claim 13 , wherein a first syntax element indicating usage of a coding tool for coding at least a first portion of multiple portions of the video is selectively included in a first video unit level of the bitstream based on a second syntax element included in a second video unit level of the bitstream;

wherein the first portion of the multiple portions comprises a picture, and the first video unit level is a picture header;

wherein the coding tool comprises a Bi-Direction Optical Flow coding tool;

wherein the coding tool comprises a Decoder-side Motion Vector Refinement coding tool; and

wherein the second video unit level is a sequence parameter set.

16. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

making a determination, for a current video unit of the video, that a first filtering process being enabled for the current video unit is dependent on a color sampling format of the video being only one of 4:2:0, 4:2:2 or 4:4:4; and

generating the bitstream according to the determination,

wherein the first filtering process is a cross-component adaptive loop filtering process which uses values of luma samples to refine each chroma component by applying a filtering operation to a luma component and then using an output of the filtering operation for chroma refinement in a loop filtering process,

wherein luma positions of the luma samples of the luma component used in the first filtering process are determined based on the color sampling format.

17. The non-transitory computer-readable recording medium of claim 16 ,

wherein filter coefficients for the first filtering process are included in an adaptation parameter set, and the adaptation parameter set is allowed to be referenced in a slice header of a slice to which the current video unit belongs.

18. The non-transitory computer-readable recording medium of claim 16 , wherein a first syntax element indicating usage of a coding tool for coding at least a first portion of multiple portions of the video is selectively included in a first video unit level of the bitstream based on a second syntax element included in a second video unit level of the bitstream;

wherein the first portion of the multiple portions comprises a picture, and the first video unit level is a picture header;

wherein the coding tool comprises a Bi-Direction Optical Flow coding tool;

wherein the coding tool comprises a Decoder-side Motion Vector Refinement coding tool; and

wherein the second video unit level is a sequence parameter set.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2022
From: ZHU, WEIJIA; ZHANG, LI; XU, JIZHENG; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 059559/0345 →
Priority Claims (1)
WO PCT/CN2019/110229 · Oct 9, 2019 · international
Continuity (2)
Continuation PCTUS2020054959 · Oct 9, 2020
Related Publication 20220248063A1 · Aug 4, 2022
Cited By (10)
US 12,244,819 US 12,284,347 US 12,284,371 US 12,356,020 US 12,382,060 US 12,418,647 US 12,425,586 US 12,477,130 US 12,581,090 US 12,666,024