IP Library Granted Patent US 10,778,974
Granted Patent B2
US 10,778,974 · App. 16/025,772 · Granted Sep 15, 2020

Adaptive loop filter with enhanced classification methods

Inventors: Marta Karczewicz (San Diego, CA); Li Zhang (San Diego, CA); Wei-Jung Chien (San Diego, CA)
Assignee: Qualcomm Incorporated
H04N19/117H04N19/124H04N19/14H04N19/159H04N19/176H04N19/463H04N19/82H04N19/86
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,778,974
App. No.
16/025,772
Filed
Jul 2, 2018
Granted
Sep 15, 2020
Kind
B2
Art Unit
2421
USPC
375/240.03
Abstract

An apparatus configured to decode video data, including a memory configured to store a block of a current picture of the video data, and one or more processors in communication with the memory. The one or more processors may be configured to reconstruct the block of the current picture of the video data, determine a classification, from among a plurality of classifications, of the block according to a rule, wherein the rule is adaptively determined based on characteristics of coded sequences of the video data, and apply an adaptive loop filter (ALF) to the block based on the classification of the block.

Claims (67)

1. An apparatus configured to decode video data, the apparatus comprising:

a memory configured to store a block of a current picture of the video data; and

one or more processors in communication with the memory, the one or more processors configured to:

reconstruct the block of the current picture of the video data;

determine a classification, from among a plurality of classifications, of the block according to a rule, wherein the rule is adaptively determined based on characteristics of coded sequences of the video data, and wherein the rule is based on a bit-depth of a pixel in the block; and

apply an adaptive loop filter (ALF) to the block based on the classification of the block.

2. The apparatus of claim 1 , wherein, to determine the classification, the one or more processors may be further configured to:

adjust a quantization process for determining an activity value of the block of the current picture based on the rule.

3. The apparatus of claim 2 , wherein, to adjust the quantization process, the one or more processors may be configured to:

determine a function of mapping the activity value of the block of the current picture to an activity index based on the rule; and

determine the classification based on the activity index.

4. The apparatus of claim 1 , wherein, to determine the classification, the one or more processors may be further configured to:

determine one or more thresholds for determining a direction value of the block of the current picture based on the rule;

determine the direction value of the block of the current picture based on the one or more thresholds; and

determine the classification based on the direction value.

5. The apparatus of claim 1 , wherein the ALF is a geometric transformation-based ALF (GALF).

6. The apparatus of claim 1 , wherein the one or more processors are further configured to:

obtain, from a bitstream that comprises an encoded representation of the current picture, an indication of the rule.

7. The apparatus of claim 1 , wherein the one or more processors are further configured to:

derive the rule based on characteristics of coded sequences of the video data.

8. The apparatus of claim 1 , wherein the rule indicates how to merge blocks with different activity values into one class.

9. The apparatus of claim 8 , wherein the one or more processors are further configured to obtain, from a bitstream that comprises an encoded representation of the current picture, an indication of the rule that indicates how to merge blocks with different activity values into one class.

10. The apparatus of claim 1 , wherein the rule indicates how to merge blocks with different direction values into one class.

11. The apparatus of claim 10 , wherein the one or more processors are further configured to obtain, from a bitstream that comprises an encoded representation of the current picture, an indication of the rule that indicates how to merge blocks with different direction values into one class.

12. The apparatus of claim 1 , wherein to determine the classification, the one or more processors are further configured to:

determine the classification, from among the plurality of classifications, of the block according to the rule, wherein the rule indicates how to merge blocks with different activity values and direction values into one class.

13. The apparatus of claim 1 , wherein the one or more processors are further configured to adaptively change a total number of allowed classifications of the plurality of classifications, per unit, wherein the unit is one of a tile, slice, picture, sequence, or largest coding unit (LCU).

14. The apparatus of claim 1 , wherein the one or more processors are further configured to:

output the block after applying the ALF.

15. A method for decoding video data, the method comprising:

reconstructing a block of a current picture of the video data;

determining a classification, from among a plurality of classifications, of the block according to a rule, wherein the rule is adaptively determined based on characteristics of coded sequences of the video data, and wherein the rule is based on a bit-depth of a pixel in the block; and

applying an adaptive loop filter (ALF) to the block based on the classification of the block.

16. The method of claim 15 , wherein determining the classification comprises:

adjusting a quantization process for determining an activity value of the block of the current picture based on the rule.

17. The method of claim 16 , wherein adjusting the quantization process comprises:

determining a function of mapping the activity value of the block of the current picture to an activity index based on the rule; and

determining the classification based on the activity index.

18. The method of claim 15 , wherein determining the classification comprises:

determining one or more thresholds for determining a direction value of the block of the current picture based on the rule;

determining the direction value of the block of the current picture based on the one or more thresholds; and

determining the classification based on the direction value.

19. The method of claim 15 , wherein the ALF is a geometric transformation-based ALF (GALF).

20. The method of claim 15 , further comprising:

obtaining, from a bitstream that comprises an encoded representation of the current picture, an indication of the rule.

21. The method of claim 15 , further comprising:

deriving the rule based on characteristics of coded sequences of the video data.

22. The method of claim 15 , wherein the rule indicates how to merge blocks with different activity values into one class.

23. The method of claim 22 , further comprising:

obtaining, from a bitstream that comprises an encoded representation of the current picture, an indication of the rule that indicates how to merge blocks with different activity values into one class.

24. The method of claim 15 , wherein the rule indicates how to merge blocks with different direction values into one class.

25. The method of claim 24 , further comprising:

obtaining, from a bitstream that comprises an encoded representation of the current picture, an indication of the rule that indicates how to merge blocks with different direction values into one class.

26. The method of claim 15 , further comprising:

determining the classification, from among the plurality of classifications, of the block according to the rule, wherein the rule indicates how to merge blocks with different activity values and direction values into one class.

27. The method of claim 15 , further comprising:

adaptively changing a total number of allowed classifications of the plurality of classifications, per unit, wherein the unit is one of a tile, slice, picture, sequence, or largest coding unit (LCU).

28. The method of claim 15 , further comprising:

outputting the block after applying the ALF.

29. A non-transitory computer-readable storage medium storing instructions that, when executed, causes one or more processors of a device configured to decode video data to:

reconstruct the block of the current picture of the video data;

determine a classification, from among a plurality of classifications, of the block according to a rule, wherein the rule is adaptively determined based on characteristics of coded sequences of the video data, and wherein the rule is based on a bit-depth of a pixel in the block; and

apply an adaptive loop filter (ALF) to the block based on the classification of the block.

30. An apparatus configured to decode video data, the apparatus comprising:

means for reconstructing a block of a current picture of the video data;

means for determining a classification, from among a plurality of classifications, of the block according to a rule, wherein the rule is adaptively determined based on characteristics of coded sequences of the video data, and wherein the rule is based on a bit-depth of a pixel in the block; and

means for applying an adaptive loop filter (ALF) to the block based on the classification of the block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2018
From: KARCZEWICZ, MARTA; ZHANG, LI; CHIEN, WEI-JUNG
To: QUALCOMM INCORPORATED
Reel/Frame 047466/0520 →
Continuity (2)
Provisional Application 62528915 · Jul 5, 2017
Related Publication 20190014315A1 · Jan 10, 2019
Cited By (29)
US 12,206,846 US 12,206,859 US 12,244,794 US 12,244,819 US 12,262,006 US 12,273,527 US 12,284,347 US 12,284,371 US 12,328,432 US 12,341,980 US 12,356,020 US 12,382,060 US 12,382,105 US 12,395,650 US 12,418,647 US 12,425,585 US 12,425,586 US 12,477,108 US 12,477,130 US 12,495,141 US 12,526,407 US 12,556,699 US 12,581,090 US 12,587,648 US 12,593,038 US 12,598,300 US 12,621,445 US 12,666,024 US 12,684,174