IP Library Granted Patent US 10,771,800
Granted Patent B2
US 10,771,800 · App. 16/840,043 · Granted Sep 8, 2020

Sample array coding for low-delay

Inventors: Valeri George (Berlin, DE); Anastasia Henkel (Berlin, DE); Heiner Kirchhoffer (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Schierl (Berlin, DE)
Assignee: GE VIDEO COMPRESSION, LLC
H04N19/44H03M7/3071H04N19/13H04N19/167H04N19/174H04N19/436H04N19/503H04N19/51H04N19/91H03M7/4037
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,771,800
App. No.
16/840,043
Granted
Sep 8, 2020
Kind
B2
Abstract

The entropy coding of a current part of a predetermined entropy slice is based on, not only, the respective probability estimations of the predetermined entropy slice as adapted using the previously coded part of the predetermined entropy slice, but also probability estimations as used in the entropy coding of a spatially neighboring, in entropy slice order preceding entropy slice at a neighboring part thereof. Thereby, the probability estimations used in entropy coding are adapted to the actual symbol statistics more closely, thereby lowering the coding efficiency decrease normally caused by lower-delay concepts. Temporal interrelationships are exploited additionally or alternatively.

Claims (48)

1. A decoder for reconstructing a sample array of a video from an entropy-encoded data stream, the decoder comprising:

an entropy decoder configured to entropy decode a plurality of entropy slices in the entropy-encoded data stream to reconstruct the sample array, each of the plurality of entropy slices corresponding to one row of a plurality of rows of the sample array and each of the plurality of rows having a same number of blocks therein,

wherein, for a current entropy slice of the plurality of entropy slices, the entropy decoder is configured to:

initialize, during a starting phase of entropy decoding, a first probability estimate for the current entropy slice before decoding a first block of a current row corresponding to the current entropy slice based on a second probability estimate obtained after completing entropy decoding of a second block of a previous row corresponding to a previous entropy slice of the plurality of entropy slices,

wherein the first block is the left-most block of the current row and the second block is spatially adjoining and to the right of the left-most block of the previous row, and the current and previous rows are consecutive rows of the sample array, and

perform, during a continuation phase of the entropy decoding, entropy decoding using the first probability estimate along an entropy coding path leading from left to right across the current row, the entropy decoding is performed by adapting the first probability estimate along the entropy coding path using only a previously-decoded part of the current entropy slice.

2. The decoder according to claim 1 , wherein the entropy decoder is configured to entropy-decode the plurality of entropy slices in an order, the order is chosen such that, along the order, the plurality of rows follow each other in a direction angled relative to the entropy coding paths of the entropy slices.

3. The decoder according to claim 1 , wherein the entropy decoder is configured to store the second probability estimate after the second block is entropy-decoded, and use the stored second probability estimate for initializing the first probability estimate.

4. The decoder according to claim 1 , wherein the entropy decoder is configured to, in entropy decoding a current part of the current entropy slice, adapt, during the continuation phase of the entropy decoding, the first probability estimate based on a third probability estimate obtained after decoding a portion of the previous entropy slice.

5. The decoder according to claim 4 , wherein the entropy decoder is configured to adapt, during a continuation phase of the entropy decoding, the first probability estimate based on an average of the first probability estimate adapted using the previously-decoded part of the current entropy slice and the third probability estimate.

6. The decoder according to claim 4 , wherein the portion of the previous entropy slice corresponds to a portion of the previous row spatially-neighboring a portion of the current row corresponding to the current part of the current entropy slice.

7. The decoder according to claim 2 , wherein the entropy decoder is configured to steer the entropy decoding of immediately consecutive entropy slices in the order so that a distance of currently decoded blocks of rows corresponding to the immediately consecutive entropy slices measured in blocks along the entropy coding paths remains two blocks.

8. The decoder according to claim 1 , wherein the previous row is spatially above the current row, and the entropy decoding of the previous entropy slice begins before the entropy decoding of the current entropy slice.

9. The decoder according to claim 1 , wherein the sample array is a current sample array of a sequence of sample arrays and the entropy decoder is configured to entropy-decode a current entropy slice based on the first probability estimate as adapted using the second probability estimate, the previously-decoded part of the current entropy slice, and a fourth probability estimate used in entropy decoding a previously decoded frame corresponding to one of the sample arrays other than the current sample array.

10. The decoder according to claim 1 , wherein the decoder is at least a portion of a programmable logic device, programmable gate array, microprocessor, computer or hardware apparatus.

11. A method for reconstructing a sample array from an entropy-encoded data stream coded with the video, the method comprising:

entropy decoding a plurality of entropy slices in the entropy-encoded data stream to reconstruct the sample array, each of the plurality of entropy slices corresponding to one row of a plurality of rows of the sample array and each of the plurality of rows having a same number of blocks therein;

for a current entropy slice of the plurality of entropy slices, initializing, during a starting phase of the entropy decoding, a first probability estimate for the current entropy slice before decoding a first block of a current row corresponding to the current entropy slice based on a second probability estimate obtained after completing entropy decoding of a second block of a previous row corresponding to a previous entropy slice of the plurality of entropy slices,

wherein the first block is the left-most block of the current row and the second block is spatially adjoining and to the right of the left-most block of the previous row, and the current and previous rows are consecutive rows of the sample array; and

the entropy decoding is performed, during a continuation phase of the entropy decoding, using the first probability estimate along an entropy coding path leading from left to right across the current row, the entropy decoding including: adapting the first probability estimate along the entropy coding path using only a previously-decoded part of the current entropy slice.

12. The method according to claim 11 , wherein the entropy decoding of the plurality of entropy slices is performed in an order, wherein the order is chosen such that, along the order, the plurality of rows follow each other in a direction angled relative to the entropy coding paths of the entropy slices.

13. The method according to claim 11 , further comprising storing the second probability estimate after the second block is entropy-decoded; and using the stored second probability estimate for initializing the first probability estimate.

14. The method according to claim 11 , further comprising, in entropy decoding a current part of the current entropy slice, adapting the first probability estimate based on a third probability estimate obtained after decoding a portion of the previous entropy slice.

15. The method according to claim 14 , wherein the adapting the first probability estimate is based on an average of the first probability estimate adapted using the previously-decoded part of the current entropy slice and the third probability estimate.

16. The method according to claim 14 , wherein the portion of the previous entropy slice corresponds to a portion of the previous row spatially-neighboring a portion of the current row corresponding to the current part of the current entropy slice.

17. The method according to claim 12 , further comprising steering the entropy decoding of immediately consecutive entropy slices in the order so that a distance of currently decoded blocks of rows corresponding to the immediately consecutive entropy slices measured in blocks along the entropy coding paths remains two blocks.

18. The method according to claim 11 , wherein the previous row is spatially above the current row, and the entropy decoding of the previous entropy slice begins before the entropy decoding of the current entropy slice.

19. The method according to claim 11 , wherein the sample array is a current sample array of a sequence of sample arrays and the method comprises entropy decoding a current entropy slice based on the first probability estimate as adapted using the second probability estimate, the previously-decoded part of the current entropy slice, and a fourth probability estimate used in entropy decoding a previously decoded frame corresponding to one of the sample arrays other than the current sample array.

20. A method for encoding a sample array into an entropy-encoded data stream coded with a video, the method comprising:

entropy encoding a plurality of entropy slices into the entropy-encoded data stream, each of the plurality of entropy slices corresponding to one row of a plurality of rows of the sample array and each of the plurality of rows having a same number of blocks therein;

for a current entropy slice of the plurality of entropy slices, initializing, during a starting phase of the entropy encoding, a first probability estimate for the current entropy slice before decoding a first block of a current row corresponding to the current entropy slice based on a second probability estimate obtained after completing entropy encoding of a second block of a previous row corresponding to a previous entropy slice of the plurality of entropy slices,

wherein the first block is the left-most block of the current row and the second block is spatially adjoining and to the right of the left-most block of the previous row, and the current and previous rows are consecutive rows of the sample array; and

the entropy encoding is performed, during a continuation phase of the entropy encoding, using the first probability estimate along an entropy coding path leading from left to right across the current row, the entropy encoding including adapting the first probability estimate along the entropy coding path using only a previously-encoded part of the current entropy slice.

21. The method according to claim 20 , wherein the entropy encoding of the plurality of entropy slices is performed in an order, the entropy slice order is chosen such that, along the entropy slice order, the different portions follow each other in a direction angled relative to the entropy coding paths of the entropy slices.

22. The method according to claim 20 , further comprising storing the second probability estimate after the second block is entropy-encoded, wherein the stored second probability estimate is used for initializing the first probability estimate.

23. The method according to claim 20 , further comprising, in entropy encoding a current part of the current entropy slice, adapting the first probability estimate based on a third probability estimate obtained after encoding a portion of the previous entropy slice.

24. The method according to claim 23 , wherein the adapting the first probability estimate is based on an average of the first probability estimate adapted using the previously-encoded part of the current entropy slice and the third probability estimate.

25. The method according to claim 23 , wherein the portion of the previous entropy slice corresponds to a portion of the previous row spatially-neighboring a portion of the current row corresponding to the current part of the current entropy slice.

26. The method according to claim 21 , further comprising steering the entropy encoding of immediately consecutive entropy slices in the order so that a distance of currently encoded blocks of rows corresponding to the immediately consecutive entropy slices measured in blocks along the entropy coding paths remains two blocks.

27. The method according to claim 20 , wherein the previous row is spatially above the current row, and the entropy encoding of the previous entropy slice begins before the entropy encoding of the current entropy slice.

28. The method according to claim 20 , wherein the sample array is a current sample array of a sequence of sample arrays and the method comprises entropy encoding a current entropy slice based on the first probability estimate as adapted using the second probability estimate, the previously-encoded part of the current entropy slice, and a fourth probability estimate used in entropy encoding a previously encoded frame corresponding to one of the sample arrays other than the current sample array.

29. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising entropy-encoded information associated with a sample array of a video, the entropy-encoded information including a plurality of entropy slices, each of the plurality of entropy slices corresponding to one row of a plurality of rows of the sample array and each of the plurality of rows having a same number of blocks therein,

wherein the sample array is encoded by operations including:

for a current entropy slice of the plurality of entropy slices, initializing, during a starting phase of the entropy encoding, a first probability estimate for the current entropy slice before decoding a first block of a current row corresponding to the current entropy slice based on a second probability estimate obtained after completing entropy encoding of a second block of a previous row corresponding to a previous entropy slice of the plurality of entropy slices,

wherein the first block is the left-most block of the current row and the second block is spatially adjoining and to the right of the left-most block of the previous row, and the current and previous rows are consecutive rows of the sample array; and

entropy encoding, during a continuation phase of the entropy encoding, using the first probability estimate along an entropy coding path leading from left to right across the current row, the entropy encoding including adapting the first probability estimate along the entropy coding path using only a previously-encoded part of the current entropy slice.

30. The non-transitory computer-readable medium 29 , wherein the previous row is spatially above the current row, and the entropy encoding of the previous entropy slice begins before the entropy encoding of the current entropy slice.

Assignments (3)
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2020
From: GEORGE, VALERI; HENKEL, ANASTASIA; KIRCHHOFFER, HEINER; MARPE, DETLEV; SCHIERL, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V
Reel/Frame 052309/0719 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2020
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 052314/0523 →
Continuity (9)
Continuation 16578716 · Sep 23, 2019
Continuation 16109874 · Aug 23, 2018
Continuation 15824196 · Nov 28, 2017
Continuation 15639312 · Jun 30, 2017
Continuation 15414356 · Jan 24, 2017
Continuation 14141374 · Dec 26, 2013
Continuation PCTEP2012063929 · Jul 16, 2012
Provisional Application 61508477 · Jul 15, 2011
Related Publication 20200236378A1 · Jul 23, 2020
Cited By (1)
US 12,284,359