IP Library Granted Patent US 9,787,989
Granted Patent B2
US 9,787,989 · App. 13/914,670 · Granted Oct 10, 2017

Intra-coding mode-dependent quantization tuning

Inventors: Nguyen Nguyen (Waterloo, CA); Dake He (Waterloo, CA)
Assignee: BlackBerry Limited
H04N19/126H04N19/14H04N19/157H04N19/18H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,787,989
App. No.
13/914,670
Granted
Oct 10, 2017
Kind
B2
Abstract

Methods of encoding and decoding video are described. The methods for encoding and decoding a picture partitioned into blocks include determining an activity rank for a block, based on a block size of the block and an intra-coding mode for the block; calculating a normalization value based on the activity rank divided by an average activity rank determined over a plurality of previously-encoded/decoded blocks; and quantizing/dequantizing a set of transform domain coefficients for the block using a quantization step size adjusted by the normalization value.

Claims (43)

1. A method of decoding video from a bitstream of encoded video using a video decoder, the video including a picture partitioned into blocks, the method comprising:

storing a look-up table of predetermined activity ranks each associated with a respective combination of a block size and intra-coding mode;

selecting, from the look-up table of predetermined activity ranks, an activity rank for a block that was encoded using a selected one of a plurality of intra-coding modes, based on a block size of the block and the intra-coding mode that was used in encoding the block, wherein selecting includes indexing the look-up table using the block size and the intra-coding mode to read the associated activity rank;

calculating a normalization value based on the activity rank divided by an average activity rank determined over a plurality of previously-decoded blocks; and

dequantizing a set of decoded quantized coefficients for the block using a quantization step size adjusted by the normalization value.

2. The method claimed in claim 1 , wherein the intra-coding modes are grouped into subsets and wherein each subset has an associated activity rank.

3. The method claimed in claim 1 , wherein the average activity rank is an average activity rank calculated based on activity ranks for blocks of a previous picture.

4. The method claimed in claim 1 , wherein the average activity rank is an average over a set of N blocks decoded immediately before the block.

5. The method claimed in claim 4 , wherein N is the number of blocks in one of a picture and a slice.

6. The method claimed in claim 1 , wherein dequantizing a set of decoded quantized coefficients for the block comprises dequantizing using the quantization step size scaled by the normalization value.

7. The method claimed in claim 1 , wherein the normalization value comprises an AC normalization value and wherein dequantizing includes dequantizing AC quantized transform domain coefficients using the quantization step size adjusted by the AC normalization value.

8. The method claimed in claim 7 , further including dequantizing a DC quantized transform domain coefficient using the quantization step size adjusted by a DC normalization value, and wherein the DC normalization value is calculated using a structural similarity measurement including DC coefficients of a plurality of blocks.

9. The method claimed in claim 1 , wherein the block is partitioned into a plurality of regions, and wherein calculating a normalization value includes calculating an AC normalization value for use in at least one of the regions and calculating at least two regional normalization value for use in respective other regions.

10. The method claimed in claim 9 , wherein calculating at least two regional normalization values comprises jointly solving a first equation relating the at least two regional normalization values to the AC normalization value and a second equation relating the at least two regional normalization values to each other.

11. A method of encoding video using a video encoder to produce a bitstream of encoded video, the video including a picture partitioned into blocks, the method comprising:

storing a look-up table of predetermined activity ranks each associated with a respective combination of a block size and intra-coding mode;

determining that a block is to be encoded using a selected one of a plurality of intra-coding modes;

selecting, from the look-up table of predetermined activity ranks, an activity rank for the block, based on a block size of the block and the selected intra-coding mode for the block, wherein selecting includes indexing the look-up table using the block size and the intra-coding mode to read the associated activity rank;

calculating a normalization value based on the activity rank divided by an average activity rank determined over a plurality of previously-encoded blocks; and

quantizing a set of transform domain coefficients for the block using a quantization step size adjusted by the normalization value.

12. The method claimed in claim 11 , wherein the normalization value comprises an AC normalization value and wherein quantizing includes quantizing AC transform domain coefficients using the quantization step size adjusted by the AC normalization value.

13. The method claimed in claim 12 , further including quantizing a DC transform domain coefficient using the quantization step size adjusted by a DC normalization value, and wherein the DC normalization value is calculated using a structural similarity measurement including DC coefficients of a plurality of blocks.

14. The method claimed in claim 11 , wherein the block is partitioned into a plurality of regions, and wherein calculating a normalization value includes calculating an AC normalization value for use in at least one of the regions and calculating at least two regional normalization value for use in respective other regions.

15. The method claimed in claim 14 , wherein calculating at least two regional normalization values comprises jointly solving a first equation relating the at least two regional normalization values to the AC normalization value and a second equation relating the at least two regional normalization values to each other.

16. A decoder for decoding a bitstream of encoded video, the decoder comprising:

a processor;

a memory storing a look-up table of predetermined activity ranks each associated with a respective combination of a block size and intra-coding mode; and

a decoding application stored in memory and containing instructions for causing the processor to

select, from the look-up table of predetermined activity ranks, an activity rank for a block that was encoded using a selected one of a plurality of intra-coding modes, based on a block size of the block and the intra-coding mode that was used in encoding the block, wherein selecting includes indexing the look-up table using the block size and the intra-coding mode to read the associated activity rank,

calculate a normalization value based on the activity rank divided by an average activity rank determined over a plurality of previously-decoded blocks, and

dequantize a set of decoded quantized coefficients for the block using a quantization step size adjusted by the normalization value.

17. An encoder for encoding video, the video including a picture partitioned into blocks, the encoder comprising:

a processor;

a memory storing a look-up table of predetermined activity ranks each associated with a respective combination of a block size and intra-coding mode; and

an encoding application stored in memory and containing instructions for causing the processor to

determine that a block is to be encoded using a selected one of a plurality of intra-coding modes,

select, from the look-up table of predetermined activity ranks, an activity rank for the block, based on a block size of the block and the selected intra-coding mode for the block, wherein selecting includes indexing the look-up table using the block size and the intra-coding mode to read the associated activity rank,

calculate a normalization value based on the activity rank divided by an average activity rank determined over a plurality of previously-encoded blocks, and

quantize a set of transform domain coefficients for the block using a quantization step size adjusted by the normalization value.

18. A non-transitory processor-readable medium storing a look-up table of predetermined activity ranks each associated with a respective combination of a block size and intra-coding mode, and storing processor-executable instructions which, when executed, cause one or more processors to perform the method of:

select, from the look-up table of predetermined activity ranks, an activity rank for a block that was encoded using a selected one of a plurality of intra-coding modes, based on a block size of the block and the intra-coding mode that was used in encoding the block, wherein selecting includes indexing the look-up table using the block size and the intra-coding mode to read the associated activity rank;

calculating a normalization value based on the activity rank divided by an average activity rank determined over a plurality of previously-decoded blocks; and

dequantizing a set of decoded quantized coefficients for the block using a quantization step size adjusted by the normalization value.

Assignments (8)
CORRECTIVE ASSIGNMENT TO CORRECT THE ADDED PATENT NUMBER TO REMOVE PATENT NO. 8,873,407 AT PREVIOUSLY RECORDED ON REEL 64066 FRAME 1. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE DATE MARCH 20, 2023. Recorded Feb 2, 2026
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 074921/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE COVER SHEET AT PAGE 50 TO REMOVE 12817157 PREVIOUSLY RECORDED ON REEL 063471 FRAME 0474. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 5, 2023
From: BLACKBERRY LIMITED
To: OT PATENT ESCROW, LLC
Reel/Frame 064806/0669 →
CORRECTIVE ASSIGNMENT TO CORRECT 12817157 APPLICATION NUMBER PREVIOUSLY RECORDED AT REEL: 064015 FRAME: 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 5, 2023
From: OT PATENT ESCROW, LLC
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064807/0001 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 19, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064066/0001 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 16, 2023
From: OT PATENT ESCROW, LLC
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064015/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2023
From: BLACKBERRY LIMITED
To: OT PATENT ESCROW, LLC
Reel/Frame 063471/0474 →
CHANGE OF NAME Recorded Mar 15, 2016
From: RESEARCH IN MOTION LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 038087/0963 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2013
From: NGUYEN, NGUYEN; HE, DAKE
To: RESEARCH IN MOTION LIMITED
Reel/Frame 030585/0655 →
Continuity (1)
Related Publication 20140362905A1 · Dec 11, 2014