IP Library Granted Patent US 11,233,995
Granted Patent B2
US 11,233,995 · App. 17/392,628 · Granted Jan 25, 2022

Temporal prediction of parameters in non-linear adaptive loop filter

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/117H04N19/119H04N19/132H04N19/174H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,233,995
App. No.
17/392,628
Granted
Jan 25, 2022
Kind
B2
Abstract

Devices, systems and methods for temporal prediction of parameters in non-linear adaptive loop filtering are described. In an exemplary aspect, a method for visual media processing includes configuring, for a current video block, one or more parameters of a clipping operation that is part of a non-linear filtering operation; and performing, based on the one or more parameters, a conversion between the current video block and a bitstream representation of the current video block, wherein the one or more parameters is coded in accordance with a rule.

Claims (48)

1. A method of processing video data, comprising:

determining, that a non-linear filtering operation is applied for a current video region of a video;

generating at least one first filtering index for the current video region;

deriving a first filtering coefficient set based on the at least one first filtering index and at least one coefficient parameter syntax element;

deriving a first clipping parameter set based on the at least one first filtering index and at least one filtering clipping syntax element;

performing the non-linear filtering operation based on the first filtering coefficient set and the first clipping parameter set; and

performing a conversion between the current video region and a bitstream of the video;

wherein the coefficient parameter syntax element is present in the bitstream independently from values of the first filtering coefficient set.

2. The method of claim 1 , wherein the at least one filtering clipping syntax element is present in the bitstream in case that at least one value of the first filtering coefficient set is zero.

3. The method of claim 1 , wherein the at least one filtering clipping syntax element is present in the bitstream regardless of the values of the first filtering coefficient set.

4. The method of claim 1 , wherein the at least one filtering clipping syntax element and the at least one coefficient parameter syntax element are present in a same adaptive parameter set.

5. The method of claim 4 , wherein the at least one filtering clipping syntax element includes a clipping index.

6. The method of claim 4 , wherein the at least one coefficient parameter syntax element includes a coefficient absolute value.

7. The method of claim 4 , wherein the at least one filtering clipping syntax element is coded with a fixed length of 2 bits and the at least one coefficient parameter syntax element is coded using Exponential-Golomb model with fixed order.

8. The method of claim 1 , wherein the current video region includes a coding tree block or a slice.

9. The method of claim 1 , wherein the at least one first filtering index is derived based on multiple sample differences in different directions.

10. The method of claim 9 , wherein the current video region is split into multiple M*M video sub-region, and the multiple sample differences in different directions are derived for every M*M video sub-region, and wherein M is equal to 2 or 4.

11. The method of claim 10 , wherein the multiple sample differences in different directions are derived based on 1:N subsampling rate, wherein N is great than 1.

12. The method of claim 1 , wherein the conversion includes encoding the current video region into the bitstream.

13. The method of claim 1 , wherein the conversion includes decoding the current video region from the bitstream.

14. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, that a non-linear filtering operation is applied for a current video region of a video;

generate at least one first filtering index for the current video region;

derive a first filtering coefficient set based on the at least one first filtering index and at least one coefficient parameter syntax element;

derive a first clipping parameter set based on the at least one first filtering index and at least one filtering clipping syntax element;

perform the non-linear filtering operation based on the first filtering coefficient set and the first clipping parameter set; and

perform a conversion between the current video region and a bitstream of the video;

wherein the coefficient parameter syntax element is present in the bitstream independently from values of the first filtering coefficient set.

15. The apparatus of claim 14 , wherein the at least one filtering clipping syntax element is present in the bitstream in case that at least one value of the first filtering coefficient set is zero.

16. The apparatus of claim 14 , wherein the at least one filtering clipping syntax element is present in the bitstream regardless of the values of the first filtering coefficient set.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, that a non-linear filtering operation is applied for a current video region of a video;

generate at least one first filtering index for the current video region;

derive a first filtering coefficient set based on the at least one first filtering index and at least one coefficient parameter syntax element;

derive a first clipping parameter set based on the at least one first filtering index and at least one filtering clipping syntax element;

perform the non-linear filtering operation based on the first filtering coefficient set and the first clipping parameter set; and

perform a conversion between the current video region and a bitstream of the video;

wherein the coefficient parameter syntax element is present in the bitstream independently from values of the first filtering coefficient set.

18. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, that a non-linear filtering operation is applied for a current video region of a video;

generating at least one first filtering index for the current video region;

deriving a first filtering coefficient set based on the at least one first filtering index and at least one coefficient parameter syntax element;

deriving a first clipping parameter set based on the at least one first filtering index and at least one filtering clipping syntax element;

performing the non-linear filtering operation based on the first filtering coefficient set and the first clipping parameter set; and

generating a bitstream of the video based on the non-linear filtering operation;

wherein the coefficient parameter syntax element is present in the bitstream independently from values of the first filtering coefficient set.

19. The non-transitory computer-readable recording medium of claim 18 , wherein the at least one filtering clipping syntax element is present in the bitstream in case that at least one value of the first filtering coefficient set is zero.

20. The non-transitory computer-readable recording medium of claim 18 , wherein the at least one filtering clipping syntax element is present in the bitstream regardless of the values of the first filtering coefficient set.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2021
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 057071/0792 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 057071/0808 →
Priority Claims (1)
WO PCT/CN2019/082626 · Apr 15, 2019 · international
Continuity (2)
Continuation PCTCN2020084876 · Apr 15, 2020
Related Publication 20210368171A1 · Nov 25, 2021
Cited By (2)
US 12,593,038 US 12,666,018