IP Library Granted Patent US 11,706,413
Granted Patent B2
US 11,706,413 · App. 17/362,869 · Granted Jul 18, 2023

Unified transform type signaling and transform type dependent transform coefficient level coding

Inventors: Benjamin Bross (Berlin, DE); Phan Hoang Tung Nguyen (Berlin, DE); Paul Keydel (Berlin, DE); Heiko Schwarz (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE); Christian Helmrich (Berlin, DE)
Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
H04N19/12H04N19/129H04N19/132H04N19/176H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,706,413
App. No.
17/362,869
Granted
Jul 18, 2023
Kind
B2
Abstract

A picture in a data stream is subdivided into different size transform blocks. For a transform block, a transformation is selected by checking whether the block's size exceeds a threshold. If it does, a default technique is used to select the transformation. If it does not, a transformation is used from a list of transformations as identified by an index, the list including an identity transformation and non-identity transformations. A coefficients block in the data stream is decoded, and if the selected transformation is the identity transformation, then the coefficients block is used as a residual sample array, and if the selected transformation is not the identity transformation, the coefficients block is subjected to an inverse transformation corresponding to the selected transformation to obtain a residual sample array used to correct a prediction for the transform block.

Claims (88)

1. An apparatus for decoding a picture using predictive coding and block-based transform residual coding, comprising:

a processor; and

a memory having instructions which, when executed by the processor, cause the apparatus to:

select, for a predetermined transform block, a transformation out of a predetermined list of transformations, the selected transformation comprising an identity transformation and at least one non-identity transformation,

decode, for the predetermined transform block, a block of coefficients from a data stream by decoding for a current coefficient a significance flag indicative of whether the current coefficient is zero or not using a context, wherein:

when the selected transformation is the identity transformation, the context depends on a number of coefficients being non-zero among a first set of coefficients immediately neighboring the current coefficient, and

when the selected transformation is one of the at least one non-identity transformation, the context depends on values of a second set of coefficients and a position of the current coefficient, the second set of coefficients including at least one coefficient immediately neighboring the current coefficient and at least one coefficient positioned farther away from the current coefficient than any of the coefficients immediately neighboring the current coefficient,

derive from the block of coefficients a residual sample array for the predetermined transform block so that the block of coefficients is related to the residual sample array according to the selected transformation, and

correct a prediction for the predetermined transform block using the residual sample array to reconstruct the predetermined transform block.

2. The apparatus of claim 1 , wherein the instructions, when executed by the processor, further causes the apparatus to:

decode a predetermined coefficient by:

context adaptively entropy decoding N greater-than-X flags indicative of whether an absolute of the predetermined coefficient is greater than X or not,

decoding, using a variable length code, a remainder indicative of an amount at which the absolute of the predetermined coefficient exceeds an absolute threshold which depends on N, N being larger if the selected transformation is the identity transformation than compared to if the selected transformation is one of the at least one non-identity transformation.

3. The apparatus of claim 1 , wherein when the selected transformation is the non-identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a downward direction,

a second coefficient that immediately neighbors the current coefficient in a rightward direction,

a third coefficient that immediately neighbors the first coefficient in a rightward direction and the second coefficient in a downward direction,

a fourth coefficient that immediately neighbors the first coefficient in a downward direction, and

a fifth coefficient that immediately neighbors the second coefficient in a rightward direction.

4. The apparatus of claim 1 , wherein when the selected transformation is the identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a first direction, and

a second coefficient that immediately neighbors the current coefficient in a second direction that is different than the first direction.

5. An apparatus for encoding a picture using predictive coding and block-based transform residual coding, comprising:

a processor; and

a memory having instructions which, when executed by the processor, cause the apparatus to:

select, for a predetermined transform block, a transformation out of a predetermined list of transformations, the selected transformation comprising an identity transformation and at least one non-identity transformation,

derive a prediction for the predetermined transform block,

encode, for the predetermined transform block, a block of coefficients into a data stream by encoding for a current coefficient a significance flag indicative of whether the current coefficient is zero or not using a context, wherein:

when the selected transformation is the identity transformation, the context depends on a number of coefficients being non-zero among a first set of coefficients immediately neighboring the current coefficient, and

when the selected transformation is one of the at least one non-identity transformation, the context depends on values of a second set of coefficients and a position of the current coefficient, the second set of coefficients including at least one coefficient immediately neighboring the current coefficient and at least one coefficient positioned further away from the current coefficient than any of the coefficients immediately neighboring the current coefficient,

the block of coefficients is related to a residual sample array according to the selected transformation, and the predetermined transform block is reconstructible by correcting the prediction for the predetermined transform block using the residual sample array.

6. The apparatus of claim 5 , wherein when the selected transformation is the non-identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a downward direction,

a second coefficient that immediately neighbors the current coefficient in a rightward direction,

a third coefficient that immediately neighbors the first coefficient in a rightward direction and the second coefficient in a downward direction,

a fourth coefficient that immediately neighbors the first coefficient in a downward direction, and

a fifth coefficient that immediately neighbors the second coefficient in a rightward direction.

7. The apparatus of claim 5 , wherein when the selected transformation is the identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a first direction, and

a second coefficient that immediately neighbors the current coefficient in a second direction that is different than the first direction.

8. A method for decoding a picture using predictive coding and block-based transform residual coding, comprising

selecting, for a predetermined transform block, a transformation out of a predetermined list of transformations, the selected transformation comprising an identity transformation and at least one non-identity transformation,

decoding, for the predetermined transform block, a block of coefficients from a data stream by decoding for a current coefficient a significance flag indicative of whether the current coefficient is zero or not using a context, wherein:

when the selected transformation is the identity transformation, the context depends on a number of coefficients being non-zero among a first set of coefficients immediately neighboring the current coefficient, and

when the selected transformation is one of the at least one non-identity transformation, the context depends on values of a second set of coefficients and a position of the current coefficient, the second set of coefficients including at least one coefficient immediately neighboring the current coefficient and at least one coefficient positioned further away from the current coefficient than any of the coefficients immediately neighboring the current coefficient

deriving from the block of coefficients a residual sample array for the predetermined transform block so that the block of coefficients is related to the residual sample array according to the selected transformation, and

correcting a prediction for the predetermined transform block using the residual sample array to reconstruct the predetermined transform block.

9. The method of claim 8 , wherein when the selected transformation is the non-identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a downward direction,

a second coefficient that immediately neighbors the current coefficient in a rightward direction,

a third coefficient that immediately neighbors the first coefficient in a rightward direction and the second coefficient in a downward direction,

a fourth coefficient that immediately neighbors the first coefficient in a downward direction, and

a fifth coefficient that immediately neighbors the second coefficient in a rightward direction.

10. The method of claim 8 , wherein when the selected transformation is the identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a first direction, and

a second coefficient that immediately neighbors the current coefficient in a second direction that is different than the first direction.

11. A method for encoding a picture using predictive coding and block-based transform residual coding, comprising

selecting, for a predetermined transform block, a transformation out of a predetermined list of transformations, the selected transformation comprising an identity transformation and at least one non-identity transformation,

deriving a prediction for the predetermined transform block,

encoding, for the predetermined transform block, a block of coefficients into a data stream by encoding for a current coefficient a significance flag indicative of whether the current coefficient is zero or not using a context, wherein:

when the selected transformation is the identity transformation, the context depends on a number of coefficients being non-zero among a first set of coefficients immediately neighboring the current coefficient, and

when the selected transformation is one of the at least one non-identity transformation, the context depends on values of a second set of coefficients and a position of the current coefficient, wherein the second set of coefficients include at least one coefficient immediately neighboring the current coefficient and at least one coefficient positioned further away from the current coefficient than any of the coefficients immediately neighboring the current coefficient,

wherein the block of coefficients is related to a residual sample array according to the selected transformation, and the predetermined transform block is reconstructible by correcting the prediction for the predetermined transform block using the residual sample array.

12. The method of claim 11 , wherein when the selected transformation is the non-identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a downward direction,

a second coefficient that immediately neighbors the current coefficient in a rightward direction,

a third coefficient that immediately neighbors the first coefficient in a rightward direction and the second coefficient in a downward direction,

a fourth coefficient that immediately neighbors the first coefficient in a downward direction, and

a fifth coefficient that immediately neighbors the second coefficient in a rightward direction.

13. The method of claim 11 , wherein when the selected transformation is the identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a first direction, and

a second coefficient that immediately neighbors the current coefficient in a second direction that is different than the first direction.

14. A data stream encoded by a method for encoding a picture using predictive coding and block-based transform residual coding, comprising

selecting, for a predetermined transform block, a transformation out of a predetermined list of transformations, the selected transformation comprising an identity transformation and at least one non-identity transformation,

deriving a prediction for the predetermined transform block,

encoding, for the predetermined transform block, a block of coefficients into the data stream by encoding for a current coefficient a significance flag indicative of whether the current coefficient is zero or not using a context, wherein:

when the selected transformation is the identity transformation, the context depends on a number of coefficients being non-zero among a first set of coefficients immediately neighboring the current coefficient, and

when the selected transformation is one of the at least one non-identity transformation, the context depends on values of a second set of coefficients and a position of the current coefficient, wherein the second set of coefficients include at least one coefficient immediately neighboring the current coefficient and at least one coefficient positioned further away from the current coefficient than any of the coefficients immediately neighboring the current coefficient,

wherein the block of coefficients is related to a residual sample array according to the selected transformation, and the predetermined transform block is reconstructible by correcting the prediction for the predetermined transform block using the residual sample array.

15. The data stream of claim 14 , wherein when the selected transformation is the non-identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a downward direction,

a second coefficient that immediately neighbors the current coefficient in a rightward direction,

a third coefficient that immediately neighbors the first coefficient in a rightward direction and the second coefficient in a downward direction,

a fourth coefficient that immediately neighbors the first coefficient in a downward direction, and

a fifth coefficient that immediately neighbors the second coefficient in a rightward direction.

16. The data stream of claim 14 , wherein when the selected transformation is the identity transformation the context depends on:

a first coefficient that immediately neighbors the current coefficient in a first direction, and

a second coefficient that immediately neighbors the current coefficient in a second direction that is different than the first direction.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: BROSS, BENJAMIN; NGUYEN, PHAN HOANG TUNG; KEYDEL, PAUL; SCHWARZ, HEIKO; MARPE, DETLEV; WIEGAND, THOMAS; HELMRICH, CHRISTIAN
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 058156/0734 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2021
From: BROSS, BENJAMIN; NGUYEN, PHAN HOANG TUNG; KEYDEL, PAUL; SCHWARZ, HEIKO; MARPE, DETLEV; WIEGAND, THOMAS; HELMRICH, CHRISTIAN
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 057904/0491 →
Priority Claims (2)
EP 19150112 · Jan 2, 2019 · regional
EP 19162406 · Mar 12, 2019 · regional
Continuity (2)
Continuation PCTEP2019087162 · Dec 30, 2019
Related Publication 20210368176A1 · Nov 25, 2021