IP Library › Granted Patent US 11,601,686
Granted Patent B2
US 11,601,686 · App. 17/696,583 · Granted Mar 7, 2023

Signaling usage of adaptive loop filter in video coding

Inventors: Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Kai Zhang (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/82H04N19/117H04N19/174H04N19/186H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,601,686
App. No.
17/696,583
Granted
Mar 7, 2023
Kind
B2
Abstract

Methods, systems and devices for signaling the usage of adaptive loop filtering in image and video coding are described. An example method of video processing includes determining, for a conversion between a current region of a video and a bitstream representation of the video, whether a luma adaptive loop filter is used during the conversion and whether luma adaptive loop filter coefficients are included in the bitstream representation, wherein a single syntax element in the bitstream representation is indicative of use of the luma adaptive loop filter and signaling of the luma adaptive loop filter coefficients, and performing, based on the determining, the conversion.

Claims (43)

1. A method of processing video data, comprising:

determining, for a conversion between a current region of a video and a bitstream of the video, whether a luma adaptive loop filter set is included in the bitstream or not based on a first syntax element;

determining, only based on that the first syntax element indicates that the luma adaptive loop filter set is included in the bitstream, for each adaptive loop filter class of the luma adaptive loop filter set, that luma adaptive loop filter coefficients are included in the bitstream; and

performing, based on the determining, the conversion,

wherein a second syntax element indicating whether the luma adaptive loop filter coefficients are included in the bitstream is omitted from the bitstream.

2. The method of claim 1 , wherein each adaptive loop filter class is assigned with a particular index denoted by sfldx, a range of a value of sfldx is from 0 to a number of adaptive loop filter classes in the luma adaptive loop filter set reduce 1.

3. The method of claim 2 , wherein the luma adaptive loop filter coefficients comprise at least one of an absolute value of a j-th coefficient of the adaptive loop filter class indicated by sfldx or a sign of the j-th coefficient of the adaptive loop filter class indicated by sfldx, where j is an integer variable.

4. The method of claim 1 , wherein when the adaptive loop filter class has all zero luma adaptive loop filter coefficients, the all zero luma adaptive loop filter coefficients are still included in the bitstream.

5. The method of claim 4 , wherein zero absolute value for each pair of positions that share a same luma adaptive loop filter coefficient is included in the bitstream.

6. The method of claim 5 , wherein the adaptive loop filter class is a 7×7 diamond adaptive loop filter, and 12 zero-absolute-valued coefficients are included in the bitstream.

7. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

8. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.

9. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current region of a video and a bitstream of the video, whether a luma adaptive loop filter set is included in the bitstream or not based on a first syntax element;

determine, only based on that the first syntax element indicates that the luma adaptive loop filter set is included in the bitstream, for each adaptive loop filter class of the luma adaptive loop filter set, that luma adaptive loop filter coefficients are included in the bitstream; and

perform, based on the determining, the conversion,

wherein a second syntax element indicating whether the luma adaptive loop filter coefficients are included in the bitstream is omitted from the bitstream.

10. The apparatus of claim 9 , wherein each adaptive loop filter class is assigned with a particular index denoted by sfldx, a range of a value of sfldx is from 0 to a number of adaptive loop filter classes in the luma adaptive loop filter set reduce 1; and

wherein the luma adaptive loop filter coefficients comprise at least one of an absolute value of a j-th coefficient of the adaptive loop filter class indicated by sfldx or a sign of the j-th coefficient of the adaptive loop filter class indicated by sfldx, where j is an integer variable.

11. The apparatus of claim 9 , wherein when the adaptive loop filter class has all zero luma adaptive loop filter coefficients, the all zero luma adaptive loop filter coefficients are still included in the bitstream;

wherein zero absolute value for each pair of positions that share a same luma adaptive loop filter coefficient is included in the bitstream; and

wherein the adaptive loop filter class is a 7×7 diamond adaptive loop filter, and 12 zero-absolute-valued coefficients are included in the bitstream.

12. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current region of a video and a bitstream of the video, whether a luma adaptive loop filter set is included in the bitstream or not based on a first syntax element;

determine, only based on that the first syntax element indicates that the luma adaptive loop filter set is included in the bitstream, for each adaptive loop filter class of the luma adaptive loop filter set, that luma adaptive loop filter coefficients are included in the bitstream; and

perform, based on the determining, the conversion,

wherein a second syntax element indicating whether the luma adaptive loop filter coefficients are included in the bitstream is omitted from the bitstream.

13. The non-transitory computer-readable storage medium of claim 12 , wherein each adaptive loop filter class is assigned with a particular index denoted by sfldx, a range of a value of sfldx is from 0 to a number of adaptive loop filter classes in the luma adaptive loop filter set reduce 1; and

wherein the luma adaptive loop filter coefficients comprise at least one of an absolute value of a j-th coefficient of the adaptive loop filter class indicated by sfldx or a sign of the j-th coefficient of the adaptive loop filter class indicated by sfldx, where j is an integer variable.

14. The non-transitory computer-readable storage medium of claim 12 , wherein when the adaptive loop filter class has all zero luma adaptive loop filter coefficients, the all zero luma adaptive loop filter coefficients are still included in the bitstream;

wherein zero absolute value for each pair of positions that share a same luma adaptive loop filter coefficient is included in the bitstream; and

wherein the adaptive loop filter class is a 7×7 diamond adaptive loop filter, and 12 zero-absolute-valued coefficients are included in the bitstream.

15. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a current region of a video, whether a luma adaptive loop filter set is included in the bitstream or not based on a first syntax element;

determining, only based on that the first syntax element indicates that the luma adaptive loop filter set is included in the bitstream, for each adaptive loop filter class of the luma adaptive loop filter set, that luma adaptive loop filter coefficients are included in the bitstream; and

generating the bitstream based on the determining,

wherein a second syntax element indicating whether the luma adaptive loop filter coefficients are included in the bitstream is omitted from the bitstream.

16. The non-transitory computer-readable recording medium of claim 15 ,

wherein each adaptive loop filter class is assigned with a particular index denoted by sfldx, a range of a value of sfldx is from 0 to a number of adaptive loop filter classes in the luma adaptive loop filter set reduce 1; and

wherein the luma adaptive loop filter coefficients comprises at least one of an absolute value of a j-th coefficient of the adaptive loop filter class indicated by sfldx or a sign of the j-th coefficient of the adaptive loop filter class indicated by sfldx, where j is an integer variable.

17. The non-transitory computer-readable recording medium of claim 15 , wherein when the adaptive loop filter class has all zero luma adaptive loop filter coefficients, the all zero luma adaptive loop filter coefficients are still included in the bitstream;

wherein zero absolute value for each pair of positions that share a same luma adaptive loop filter coefficient is included in the bitstream; and

wherein the adaptive loop filter class is a 7×7 diamond adaptive loop filter, and 12 zero-absolute-valued coefficients are included in the bitstream.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2022
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 059287/0778 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2022
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059287/0845 →
Priority Claims (1)
WO PCT/CN2019/106420 · Sep 18, 2019 · international
Continuity (2)
Continuation PCTCN2020116084 · Sep 18, 2020
Related Publication 20220210478A1 · Jun 30, 2022
Cited By (1)
US 12,739,400