IP Library › Granted Patent US 11,729,382
Granted Patent B2
US 11,729,382 · App. 17/646,048 · Granted Aug 15, 2023

Temporal prediction of parameters in non-linear adaptive loop filter

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/117H04N19/119H04N19/132H04N19/174H04N19/176H04N19/184H04N19/70H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,729,382
App. No.
17/646,048
Granted
Aug 15, 2023
Kind
B2
Abstract

Devices, systems and methods for temporal prediction of parameters in non-linear adaptive loop filtering are described. In an exemplary aspect, a method for visual media processing includes configuring, for a current video block, one or more parameters of a clipping operation that is part of a non-linear filtering operation; and performing, based on the one or more parameters, a conversion between the current video block and a bitstream representation of the current video block, wherein the one or more parameters is coded in accordance with a rule.

Claims (54)

1. A method of processing video data, comprising:

determining, that a non-linear filtering operation is applied for a current video region of a video;

generating at least one first filtering index for the current video region;

deriving a first filtering coefficient set based on the at least one first filtering index and at least one coefficient parameter syntax element;

deriving a first clipping parameter set based on the at least one first filtering index and at least one filtering clipping syntax element;

performing the non-linear filtering operation based on the first filtering coefficient set and the first clipping parameter set; and

performing a conversion between the current video region and a bitstream of the video;

wherein the at least one filtering clipping syntax element is present in the bitstream independently from values of the first filtering coefficient set,

wherein the at least one filtering clipping syntax element and the at least one coefficient parameter syntax element are present in a same adaptive parameter set, and

wherein the current video region includes a coding tree block or a slice.

2. The method of claim 1 , wherein the at least one filtering clipping syntax element is present in the bitstream in case that at least one value of the first filtering coefficient set is zero.

3. The method of claim 1 , wherein the at least one filtering clipping syntax element includes a clipping index.

4. The method of claim 1 , wherein the at least one coefficient parameter syntax element includes a coefficient absolute value.

5. The method of claim 1 , wherein the at least one filtering clipping syntax element is coded with a fixed length of 2 bits and the at least one coefficient parameter syntax element is coded using Exponential-Golomb model with fixed order.

6. The method of claim 1 , wherein the at least one first filtering index is derived based on multiple sample differences in different directions.

7. The method of claim 6 , wherein the current video region is split into multiple M*M video sub-region, and the multiple sample differences in the different directions are derived for every M*M video sub-region, and wherein M is equal to 2 or 4.

8. The method of claim 7 , wherein the multiple sample differences in the different directions are derived based on 1:N subsampling rate, and wherein N is greater than 1.

9. The method of claim 1 , wherein the conversion includes encoding the current video region into the bitstream.

10. The method of claim 1 , wherein the conversion includes decoding the current video region from the bitstream.

11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, that a non-linear filtering operation is applied for a current video region of a video;

generate at least one first filtering index for the current video region;

derive a first filtering coefficient set based on the at least one first filtering index and at least one coefficient parameter syntax element;

derive a first clipping parameter set based on the at least one first filtering index and at least one filtering clipping syntax element;

perform the non-linear filtering operation based on the first filtering coefficient set and the first clipping parameter set; and

perform a conversion between the current video region and a bitstream of the video;

wherein the at least one filtering clipping syntax element is present in the bitstream independently from values of the first filtering coefficient set,

wherein the at least one filtering clipping syntax element and the at least one coefficient parameter syntax element are present in a same adaptive parameter set, and

wherein the current video region includes a coding tree block or a slice.

12. The apparatus of claim 11 , wherein the at least one filtering clipping syntax element is present in the bitstream in case that at least one value of the first filtering coefficient set is zero.

13. The apparatus of claim 11 , wherein the at least one filtering clipping syntax element includes a clipping index.

14. The apparatus of claim 11 , wherein the at least one first filtering index is derived based on multiple sample differences in different directions.

15. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, that a non-linear filtering operation is applied for a current video region of a video;

generate at least one first filtering index for the current video region;

derive a first filtering coefficient set based on the at least one first filtering index and at least one coefficient parameter syntax element;

derive a first clipping parameter set based on the at least one first filtering index and at least one filtering clipping syntax element;

perform the non-linear filtering operation based on the first filtering coefficient set and the first clipping parameter set; and

perform a conversion between the current video region and a bitstream of the video;

wherein the at least one filtering clipping syntax element is present in the bitstream independently from values of the first filtering coefficient set,

wherein the at least one filtering clipping syntax element and the at least one coefficient parameter syntax element are present in a same adaptive parameter set, and

wherein the current video region includes a coding tree block or a slice.

16. A method for storing a bitstream of a video, comprising:

determining, that a non-linear filtering operation is applied for a current video region of the video;

generating at least one first filtering index for the current video region;

deriving a first filtering coefficient set based on the at least one first filtering index and at least one coefficient parameter syntax element;

deriving a first clipping parameter set based on the at least one first filtering index and at least one filtering clipping syntax element;

performing the non-linear filtering operation based on the first filtering coefficient set and the first clipping parameter set; and

generating the bitstream of the video based on the non-linear filtering operation; and

storing the bitstream in a non-transitory computer-readable recording medium,

wherein the at least one filtering clipping syntax element is present in the bitstream independently from values of the first filtering coefficient set,

wherein the at least one filtering clipping syntax element and the at least one coefficient parameter syntax element are present in a same adaptive parameter set, and

wherein the current video region includes a coding tree block or a slice.

17. The method of claim 16 , wherein the at least one filtering clipping syntax element is present in the bitstream in case that at least one value of the first filtering coefficient set is zero.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2021
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 058481/0430 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 058481/0480 →
Priority Claims (1)
WO PCT/CN2019/082626 · Apr 15, 2019 · international
Continuity (3)
Continuation 17392628 · Aug 3, 2021
Continuation PCTCN2020084876 · Apr 15, 2020
Related Publication 20220124327A1 · Apr 21, 2022