Granted Patent B2

US 12,192,492 · App. 17/689,622 · Granted Jan 7, 2025

Inventors: Thomas Schierl (Berlin, DE); Valeri George (Berlin, DE); Anastasia Henkel (Berlin, DE); Detlev Marpe (Berlin, DE); Karsten Grüneberg (Berlin, DE); Robert Skupin (Berlin, DE)

Assignee: GE Video Compression, LLC

H04N19/188H04N19/13H04N19/174H04N19/436H04N19/46H04N19/463H04N19/70H04N19/91H04N19/593

Abstract

Claims (45)

1. A decoder for decoding information from a datastream to reconstruct a picture, which is partitioned into portions, the decoder comprising:

a processor;

an entropy decoder configured to entropy decode, using the processor, the portions based on wavefront parallel processing (WPP), wherein the portions are grouped in one or more WPP substreams, and for each of the one or more WPP substreams, a first portion according to a slice order in a respective WPP substream starts at a left edge of the picture, and wherein the entropy decoder is configured to entropy decode a current portion of the portions according to one of at least two modes including:

in accordance with a first mode of the at least two modes, decode data related to the current portion using context adaptive entropy decoding to obtain a residual signal, wherein the context adaptive entropy decoding includes deriving contexts across portion boundaries and initializing a symbol probability associated with the current portion depending on a saved state of the symbol probability of a previously decoded portion, wherein, in initializing the symbol probability associated with the current portion in accordance with the first mode, the entropy decoder is configured to:

for a current coding block that is the first coding block from a left end of a current row of the picture in accordance with a raster scan order, initialize the symbol probability associated with the current portion based on a saved symbol probability as acquired in context adaptive entropy decoding the previously decoded portion up to a second coding block of a preceding row of the picture, wherein the second coding block of the preceding row of the picture includes a part of the picture, wherein the preceding row is associated with the previously decoded portion and neighbors the current row, and

otherwise, initialize the symbol probability associated with the current portion based on a symbol probability as acquired at an end of context adaptive entropy decoding the previously decoded portion, and

in accordance with a second mode of the at least two modes, decode data related to the current portion using context adaptive entropy decoding to obtain a residual signal, wherein the context adaptive entropy decoding includes restricting the derivation of the contexts so as to not cross the portion boundaries and an initialization of the symbol probabilities independent of a previously decoded portion, and save the symbol probability as acquired in context adaptive entropy decoding the previously decoded portion up to the second coding block in the preceding row associated with the previously decoded portion in accordance with the raster scan order,

wherein the picture is partitioned into the portions, the portions are slices or slice segments, and the current portion includes information indicating a position within the picture at which entropy decoding of the current portion begins;

a predictor configured to generate, using the processor, a prediction signal based on prediction parameters related to the current portion from the datastream; and

a reconstruction module configured to reconstruct, using the processor, a portion of the picture related to the current portion based on the residual signal and the prediction signal.

2. The decoder according to claim 1 , where the picture is partitioned in coding blocks arranged in rows and columns and having the raster scan order defined among each other and each portion of the portions is a slice, and the decoder is configured to associate each slice with a continuous subset of the coding blocks in the raster scan order so that the subsets follow each other along the raster scan order in accordance with a slice order.

3. The decoder according to claim 1 , wherein, in initializing the symbol probability associated with the current portion in accordance with the first mode, the entropy decoder is configured to: responsive to a determination that the first coding block associated with the current portion is not the first coding block in the current row, initialize the symbol probability associated with the current portion based on a symbol probability as acquired at the end of context adaptive entropy decoding the previously decoded portion.

4. The decoder according to claim 1 , wherein the entropy decoder is configured to be responsive to a syntax element portion within the current portion, the syntax element portion indicating which of the first and second modes to use for decoding.

5. The decoder according to claim 4 , wherein the entropy decoder is configured to be responsive to a generic syntax element in the datastream so as to operate in one of at least two generic operating modes, with, according to a first generic operating mode, performing responsive to the syntax element portion for each portion, and, according to a second generic operating mode, using a different one of the at least two modes other than the first mode.

6. The decoder according to claim 1 , wherein the entropy decoder is configured to according to the first and second modes, continue continuously updating the symbol probabilities from a beginning to an end of the current portion.

7. The decoder according to claim 1 , wherein the entropy decoder is configured to save symbol probabilities as acquired in context adaptive entropy decoding the previously decoded portion up to an end of the previously decoded portion.

8. The decoder according to claim 1 , wherein the entropy decoder is configured to, in the first and second modes, restrict the predictive decoding within tiles into which the picture is sub-divided.

9. The decoder according to claim 1 , wherein the entropy decoder is configured to, in accordance with the first of the at least two modes, copy for the current portion, a portion of a slice header syntax from a preceding portion decoded in the second mode.

10. An encoder for encoding a picture into a datastream, wherein the picture is partitioned into portions, the encoder comprising:

a processor;

a residual module configured to generate, using the processor, a residual signal related to a current portion of the portions of the picture;

a predictor configured to generate, using the processor, prediction parameters based on a prediction signal, wherein the prediction parameters are encoded into the datastream; and

an entropy encoder configured to entropy encode, using the processor into the datastream, the portions based on wavefront parallel processing (WPP), wherein the portions are grouped in one or more WPP substreams, and for each of the one or more WPP substreams, a first portion according to a slice order in a respective WPP substream starts at a left edge of the picture, and the residual signal related to the current portion is to be entropy encoded according to one of at least two modes, wherein the entropy encoder is configured to:

if the current portion is to be coded in accordance with a first mode of the at least two modes, encode the residual signal using context adaptive entropy encoding including deriving contexts across portion boundaries and initializing a symbol probability associated with the current portion depending on a saved state of the symbol probability of a previously encoded portion, wherein, in initializing the symbol probability associated with the current portion in accordance with the first mode, the entropy encoder is configured to:

for a current coding block that is the first coding block from a left end of a current row of the picture in accordance with a raster scan order, initialize the symbol probability associated with the current portion based on the saved symbol probability as acquired in context adaptive entropy encoding the previously encoded portion up to a second coding block of a preceding row of the picture, wherein the second coding block of the preceding row of the picture includes a part of the picture, wherein the preceding row is associated with the previously encoded portion and neighbors the current row, and

otherwise, initialize the symbol probability associated with the current portion based on a symbol probability as acquired at an end of context adaptive entropy encoding the previously encoded portion, and

if the current portion is to be coded in accordance with a second mode of the at least two modes, encode the residual signal using context adaptive entropy encoding with restricting the derivation of the contexts so as to not cross the portion boundaries and initializing the symbol probabilities independent of any previously encoded portion, and save the symbol probability as acquired in context adaptive entropy encoding the previously encoded portion up to the second coding block in the preceding row associated with the previously encoded portion in accordance with the raster scan order, wherein the picture is partitioned into the portions, the portions are slices or slice segments, and the current portion includes information indicating a position within the picture at which entropy encoding of the current portion begins.

11. The encoder according to claim 10 , where the picture is partitioned in coding blocks arranged in rows and columns and having the raster scan order defined among each other and each portion of the portions is a slice, and the encoder is configured to associate each slice with a continuous subset of the coding blocks in the raster scan order so that the subsets follow each other along the raster scan order in accordance with a slice order.

12. The encoder according to claim 10 , wherein, in initializing the symbol probability associated with the current portion in accordance with the first mode, the entropy encoder is configured to: responsive to a determination that the first coding block associated with the current portion is not the first coding block in the current row, initialize the symbol probability associated with the current portion based on a symbol probability as acquired at the end of context adaptive entropy encoding the previously encoded portion.

13. The encoder according to claim 10 , wherein the entropy encoder is configured code a syntax element portion within the current portion of the portions, the syntax element portion indicating which of the first and second modes to use for encoding.

14. The encoder according to claim 13 , wherein the entropy encoder is configured to determine a generic syntax element and write the generic syntax element into the datastream with operating in one of at least two generic operating modes depending on the generic syntax element, namely, with, according to a first generic operating mode, performing coding the syntax element portion for each portion, and, according to a second generic operating mode, inevitably using a different one of the at least two modes other than the first mode.

15. The encoder according to claim 10 , wherein the entropy encoder is configured to according to the first and second modes, continue continuously updating the symbol probabilities from a beginning to an end of the current portion.

16. The encoder according to claim 10 , where the entropy encoder is configured to save symbol probabilities as acquired in context adaptive entropy encoding the previously encoded portion up to an end of the previously encoded portion.

17. The encoder according to claim 10 , where the entropy encoder is configured to, in the first and second modes, restrict the predictive encoding within tiles into which the picture is sub-divided.

18. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information related to a picture of a video, wherein the picture is partitioned in units of portions, wherein a processor is configured to code the encoded information into the data stream for storing in the non-transitory computer-readable medium using operations including:

generating a residual signal related to a current portion of the portions of the picture;

generating prediction parameters based on a prediction signal, wherein the prediction parameters are encoded into the datastream;

entropy encoding the portions based on wavefront parallel processing (WPP), wherein the portions are grouped in one or more WPP substreams, and for each of the one or more WPP substreams, a first portion according to a slice order in a respective WPP substream starts at a left edge of the picture, and the residual signal related to the current portion is to be entropy encoded according to one of at least two modes, wherein the entropy encoding includes:

if the current portion is to be coded in accordance with a first mode of the at least two modes, encoding the residual signal using context adaptive entropy encoding including deriving contexts across portion boundaries and initializing a symbol probability associated with the current portion depending on a saved state of the symbol probability of a previously encode portion, wherein, in initializing the symbol probability associated with the current portion in accordance with the first mode, the entropy encoding includes:

for a current coding block that is the first coding block from a left end of a current row of the picture in accordance with a raster scan order, initializing the symbol probability associated with the current portion based on the saved symbol probability as acquired in context adaptive entropy encoding the previously encoded portion up to a second coding block of a preceding row of the picture, wherein the second coding block of the preceding row of the picture includes a part of the picture, wherein the preceding row is associated with the previously encoded portion and neighbors the current row, and

otherwise, initializing the symbol probability associated with the current portion based on a symbol probability as acquired at an end of context adaptive entropy encoding the previously encoded portion, and

if the current portion is to be coded in accordance with a second mode of the at least two modes, encoding the residual signal using context adaptive entropy encoding with restricting the derivation of the contexts so as to not cross the portion boundaries and initializing the symbol probabilities independent of any previously encoded portion, and saving the symbol probability as acquired in context adaptive entropy encoding the previously encoded portion up to the second coding block in the preceding row associated with the previously encoded portion in accordance with the raster scan order,

wherein the picture is partitioned into the portions, the portions are slices or slice segments, and the current portion includes information indicating a position within the picture at which entropy encoding of the current portion begins.

19. The non-transitory computer-readable medium according to claim 18 , wherein the operations include, in initializing the symbol probability associated with the current portion in accordance with the first mode, the entropy encoding includes: responsive to a determination that the first coding block associated with the current portion is not the first coding block in the current row, initializing the symbol probability associated with the current portion based on a symbol probability as acquired at the end of context adaptive entropy encoding the previously encoded portion.

Assignments (2)

Continuity (7)

References Cited (400)