IP Library › Granted Patent US 12,108,084
Granted Patent B2
US 12,108,084 · App. 17/554,429 · Granted Oct 1, 2024

Decoder, encoder and methods comprising a coding for intra subpartitions

Inventors: Santiago De Luxán Hernández (Berlin, DE); Valeri George (Berlin, DE); Gayathri Venugopal (Berlin, DE); Jens Brandenburg (Berlin, DE); Benjamin Bross (Berlin, DE); Heiko Schwarz (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
H04N19/61H04N19/159H04N19/176H04N19/46H04N19/625H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,108,084
App. No.
17/554,429
Granted
Oct 1, 2024
Kind
B2
Abstract

Decoder for decoding a picture, wherein blocks into which the picture is subdivided are assigned to a set of prediction types, which include intra prediction and inter prediction. For each of predetermined intra-predicted blocks, the decoder is configured to derive, from the data stream, an information on a partitioning of the respective predetermined intra-predicted block into partitions. The decoder is configured to derive, from the data stream, for each partition of the respective predetermined intra-predicted block, a partition-specific prediction residual signal related to a spatial domain prediction residual signal of the respective partition of the respective predetermined intra-predicted block via a predetermined transform. The predetermined transform can be identified out of a set of transforms including a first transform and a second transform, which equals a concatenation of a primary transform and a secondary transform applied onto a subset of coefficients of the primary transform.

Claims (64)

1. A decoder for decoding a picture, the decoder configured to:

derive, from a data stream, into which the picture is coded, an assignment of a picture, at a granularity of blocks into which the picture is subdivided, to a set of prediction types which comprise intra prediction and inter prediction, so that each block is assigned to an associated prediction type out of the set of prediction types,

derive, from the data stream, for each of intra-predicted blocks to which the intra-prediction is assigned, an associated intra-prediction mode out of a set of intra-prediction modes;

for each of the intra-predicted blocks the associated intra-prediction mode of which is comprised within a predetermined subset of the set of intra-prediction modes:

derive, from the data stream, an information on a partitioning of the respective intra-predicted block into partitions;

determine a partition-specific intra-prediction for each partition of the respective intra-predicted block using the associated intra-prediction mode assigned to the respective intra-predicted block;

derive from the data stream, for each partition of the respective intra-predicted block, a partition-specific prediction residual signal;

determine whether, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside a respective predetermined area;

responsive to a determination that, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside the respective predetermined area, decode a secondary transform index for the respective intra-predicted block, wherein the secondary transform index indicates to not use any inverse secondary transform, or use a first inverse secondary transform, or use a second inverse secondary transform, for generating a partition-specific spatial domain residual for each partition of the respective intra-predicted block; and

reconstruct each partition of the respective intra-predicted block using the partition-specific spatial domain residual and the partition-specific intra-prediction.

2. The decoder of claim 1 , configured to:

responsive to a determination that for at least one partition of the respective intra-predicted block there is a non-zero transform coefficient outside the respective predetermined area, not decode the secondary transform index and infer that no secondary transform is used for the respective intra-predicted block.

3. The decoder of claim 1 , wherein:

the first inverse secondary transform or the second inverse secondary transform is further indicated by the associated intra-prediction mode assigned to the respective intra-predicted block.

4. An encoder for encoding a picture, the encoder configured to:

encode, into a data stream, into which the picture is coded, an assignment of a picture, at a granularity of blocks into which the picture is subdivided, to a set of prediction types which comprise intra prediction and inter prediction, so that each block is assigned to an associated prediction type out of the set of prediction types;

encode, into the data stream, for each of intra-predicted blocks to which the intra-prediction is assigned, an associated intra-prediction mode out of a set of intra-prediction modes;

for each of the intra-predicted blocks the associated intra-prediction mode of which is comprised within a predetermined subset of the set of intra-prediction modes:

encode, into the data stream, an information on a partitioning of the respective predetermined intra-predicted block into partitions;

determine a partition-specific intra-prediction for each partition of the respective intra-predicted block using the associated intra-prediction mode assigned to the respective intra-predicted block;

encode into the data stream, for each partition of the respective intra-predicted block, a partition-specific residual signal;

determine whether, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside a respective predetermined area;

responsive to a determination that, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside the respective predetermined area, encode a secondary transform index for the respective intra-predicted block, wherein the secondary transform index indicates to not use any inverse secondary transform, or use a first inverse secondary transform, or use a second inverse secondary transform, for generating a partition-specific spatial domain residual for each partition of the respective intra-predicted block; and

wherein each partition of the respective intra-predicted block is reconstructable using the partition-specific spatial domain residual and the partition-specific intra-prediction.

5. A method for decoding a picture, the method comprising:

deriving, from a data stream, into which the picture is coded, an assignment of a picture, at a granularity of blocks into which the picture is subdivided, to a set of prediction types which comprise intra prediction and inter prediction, so that each block is assigned to an associated prediction type out of the set of prediction types;

deriving, from the data stream, for each of intra-predicted blocks to which the intra-prediction is assigned, an associated intra-prediction mode out of a set of intra-prediction modes;

for each of the intra-predicted blocks the associated intra-prediction mode of which is comprised within a predetermined subset of the set of intra-prediction modes:

deriving, from the data stream, an information on a partitioning of the respective intra-predicted block into partitions;

determining a partition-specific intra-prediction for each partition of the respective intra-predicted block using the associated intra-prediction mode assigned to the respective intra-predicted block;

deriving from the data stream, for each partition of the respective intra-predicted block, a partition-specific prediction residual signal;

determining whether, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside a respective predetermined area;

responsive to a determination that, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside the respective predetermined area, decoding a secondary transform index for the respective intra-predicted block, wherein the secondary transform index indicates to not use any inverse secondary transform, or use a first inverse secondary transform, or use a second inverse secondary transform, for generating a partition-specific spatial domain residual for each partition of the respective intra-predicted block; and

reconstructing each partition of the respective intra-predicted block using the partition-specific spatial domain residual and the partition-specific intra-prediction.

6. A method for decoding a picture, the method comprising:

encoding, into a data stream, into which the picture is coded, an assignment of a picture, at a granularity of blocks into which the picture is subdivided, to a set of prediction types which comprise intra prediction and inter prediction, so that each block is assigned to an associated prediction type out of the set of prediction types;

encoding, into the data stream, for each of intra-predicted blocks to which the intra-prediction is assigned, an associated intra-prediction mode out of a set of intra-prediction modes;

for each the of intra-predicted blocks the associated intra-prediction mode of which is comprised within a predetermined subset of the set of intra-prediction modes:

encoding, into the data stream, an information on a partitioning of the respective intra-predicted block into partitions;

determining a partition-specific intra-prediction for each partition of the respective intra-predicted block using the associated intra-prediction mode assigned to the respective intra-predicted block,

encoding into the data stream, for each partition of the respective intra-predicted block, a partition-specific residual signal;

determining whether, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside a respective predetermined area;

responsive to a determination that, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside the respective predetermined area, encoding a secondary transform index for the respective intra-predicted block, wherein the secondary transform index indicates to not use any inverse secondary transform, or use a first inverse secondary transform, or use a second inverse secondary transform, for generating a partition-specific spatial domain residual for each partition of the respective intra-predicted block; and

wherein for each block partition of the respective intra-predicted block is reconstructable using the partition-specific spatial domain residual and the partition-specific intra-prediction.

7. A non-transitory digital storage medium having a computer program stored thereon to perform a method for decoding a picture, the method comprising:

deriving, from a data stream, into which the picture is coded, an assignment of a picture, at a granularity of blocks into which the picture is subdivided, to a set of prediction types which comprise intra prediction and inter prediction, so that each block is assigned to an associated prediction type out of the set of prediction types;

deriving, from the data stream, for each of intra-predicted blocks to which the intra-prediction is assigned, an associated intra-prediction mode out of a set of intra-prediction modes;

for each of the intra-predicted blocks the associated intra-prediction mode of which is comprised within a predetermined subset of the set of intra-prediction modes:

deriving, from the data stream, an information on a partitioning of the respective intra-predicted block into partitions;

determining a partition-specific intra-prediction for each partition of the respective intra-predicted block using the associated intra-prediction mode assigned to the respective intra-predicted block;

deriving from the data stream, for each partition of the respective intra-predicted block, a partition-specific prediction residual signal;

determining whether, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside a respective predetermined area;

responsive to a determination that, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside the respective predetermined area, decoding a secondary transform index for the respective intra-predicted block, wherein the secondary transform index indicates to not use any inverse secondary transform, or use a first inverse secondary transform, or use a second inverse secondary transform, for generating a partition-specific spatial domain residual for each partition of the respective intra-predicted block; and

reconstructing each partition of the respective intra-predicted block using the partition-specific spatial domain residual and the partition-specific intra-prediction.

8. A non-transitory digital storage medium having a computer program stored thereon to perform a method for encoding a picture, the method comprising:

encoding, into a data stream, into which the picture is coded, an assignment of a picture, at a granularity of blocks into which the picture is subdivided, to a set of prediction types which comprise intra prediction and inter prediction, so that each block is assigned to an associated prediction type out of the set of prediction types;

encoding, into the data stream, for each of intra-predicted blocks to which the intra-prediction is assigned, an associated intra-prediction mode out of a set of intra-prediction modes;

for each of the intra-predicted blocks the associated intra-prediction mode of which is comprised within a predetermined subset of the set of intra-prediction modes:

encoding, into the data stream, an information on a partitioning of the respective intra-predicted block into partitions;

determine a partition-specific intra-prediction for each partition of the respective predetermined intra-predicted block using the associated intra-prediction mode assigned to the respective predetermined intra-predicted block;

encoding into the data stream, for each partition of the respective intra-predicted block, a partition-specific residual signal;

determining whether, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside a respective predetermined area;

responsive to a determination that, for each of the partitions of the respective intra-predicted block, no non-zero transform coefficient lies outside the respective predetermined area, encoding a secondary transform index for the respective intra-predicted block, wherein the secondary transform index indicates to not use any inverse secondary transform, or use a first inverse secondary transform, or use a second inverse secondary transform, for generating a partition-specific spatial domain residual for each partition of the respective intra-predicted block; and

wherein each partition of the respective intra-predicted block is reconstructable using the partition-specific spatial domain residual and the partition-specific intra-prediction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2022
From: HERNANDEZ, SANTIAGO DE LUXAN; GEORGE, VALERI; VENUGOPAL, GAYATHRI; BRANDENBURG, JENS; BROSS, BENJAMIN; SCHWARZ, HEIKO; MARPE, DETLEV; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 059866/0135 →
Priority Claims (3)
EP 19182425 · Jun 25, 2019 · regional
EP 19191601 · Aug 13, 2019 · regional
EP 19199382 · Sep 24, 2019 · regional
Continuity (2)
Continuation PCTEP2020067549 · Jun 23, 2020
Related Publication 20220124372A1 · Apr 21, 2022