IP Library Granted Patent US 11,949,897
Granted Patent B2
US 11,949,897 · App. 18/160,689 · Granted Apr 2, 2024

Sample array coding for low-delay

Inventors: Valeri George (Berlin, DE); Anastasia Henkel (Berlin, DE); Heiner Kirchhoffer (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Schierl (Berlin, DE)
Assignee: GE Video Compression, LLC
H04N19/44H03M7/3071H04N19/13H04N19/167H04N19/174H04N19/436H04N19/503H04N19/51H04N19/91H03M7/4037
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,949,897
App. No.
18/160,689
Granted
Apr 2, 2024
Kind
B2
Abstract

The entropy coding of a current part of a predetermined entropy slice is based on, not only, the respective probability estimations of the predetermined entropy slice as adapted using the previously coded part of the predetermined entropy slice, but also probability estimations as used in the entropy coding of a spatially neighboring, in entropy slice order preceding entropy slice at a neighboring part thereof. Thereby, the probability estimations used in entropy coding are adapted to the actual symbol statistics more closely, thereby lowering the coding efficiency decrease normally caused by lower-delay concepts. Temporal interrelationships are exploited additionally or alternatively.

Claims (38)

1. A decoder for reconstructing a sample array of a video from an entropy-encoded data stream, the decoder comprising:

an entropy decoder configured to entropy decode a plurality of entropy slices in the entropy-encoded data stream to reconstruct the sample array, each of the plurality of entropy slices corresponding to one row of a plurality of rows of the sample array and each of the plurality of rows having a same number of blocks therein,

wherein, for a current entropy slice of the plurality of entropy slices, the entropy decoder is configured to:

initialize, during a starting phase of entropy decoding, a first probability estimate for the current entropy slice before decoding a first block of a current row corresponding to the current entropy slice based on a second probability estimate obtained after completing entropy decoding of a previously-decoded block of a previous row corresponding to a previous entropy slice of the plurality of entropy slices,

wherein the first block is the left-most block of the current row and the previously-decoded block is neighboring the first block, and the current and previous rows are consecutive rows of the sample array, and

perform, during a continuation phase of the entropy decoding, entropy decoding using the first probability estimate along an entropy coding path leading from left to right across the current row, the entropy decoding is performed by adapting the first probability estimate along the entropy coding path using only a previously-decoded part of the current entropy slice.

2. The decoder according to claim 1 , wherein the entropy decoder is configured to entropy-decode the plurality of entropy slices in an order, the order is chosen such that, along the order, the plurality of rows follow each other in a direction angled relative to the entropy coding paths of the entropy slices.

3. The decoder according to claim 1 , wherein the entropy decoder is configured to store the second probability estimate after the previously-decoded block is entropy-decoded, and use the stored second probability estimate for initializing the first probability estimate.

4. The decoder according to claim 1 , wherein the entropy decoder is configured to, in entropy decoding a current part of the current entropy slice, adapt, during the continuation phase of the entropy decoding, the first probability estimate based on a third probability estimate obtained after decoding a portion of the previous entropy slice.

5. The decoder according to claim 1 , wherein the previous row is spatially above the current row, and the entropy decoding of the previous entropy slice begins before the entropy decoding of the current entropy slice.

6. The decoder according to claim 1 , wherein the sample array is a current sample array of a sequence of sample arrays and the entropy decoder is configured to entropy-decode a current entropy slice based on the first probability estimate as adapted using the second probability estimate, the previously-decoded part of the current entropy slice, and a fourth probability estimate used in entropy decoding a previously-decoded frame corresponding to one of the sample arrays other than the current sample array.

7. The decoder according to claim 1 , wherein the decoder is at least a portion of a programmable logic device, programmable gate array, microprocessor, computer or hardware apparatus.

8. A method for reconstructing a sample array from an entropy-encoded data stream coded with the video, the method comprising:

entropy decoding a plurality of entropy slices in the entropy-encoded data stream to reconstruct the sample array, each of the plurality of entropy slices corresponding to one row of a plurality of rows of the sample array and each of the plurality of rows having a same number of blocks therein;

for a current entropy slice of the plurality of entropy slices, initializing, during a starting phase of the entropy decoding, a first probability estimate for the current entropy slice before decoding a first block of a current row corresponding to the current entropy slice based on a second probability estimate obtained after completing entropy decoding of a previously-decoded block of a previous row corresponding to a previous entropy slice of the plurality of entropy slices,

wherein the first block is the left-most block of the current row and the previously-decoded block is neighboring the first block, and the current and previous rows are consecutive rows of the sample array; and

the entropy decoding is performed, during a continuation phase of the entropy decoding, using the first probability estimate along an entropy coding path leading from left to right across the current row, the entropy decoding including: adapting the first probability estimate along the entropy coding path using only a previously-decoded part of the current entropy slice.

9. The method according to claim 8 , wherein the entropy decoding of the plurality of entropy slices is performed in an order, wherein the order is chosen such that, along the order, the plurality of rows follow each other in a direction angled relative to the entropy coding paths of the entropy slices.

10. The method according to claim 8 , further comprising storing the second probability estimate after the previously-decoded block is entropy-decoded; and using the stored second probability estimate for initializing the first probability estimate.

11. The method according to claim 8 , further comprising, in entropy decoding a current part of the current entropy slice, adapting the first probability estimate based on a third probability estimate obtained after decoding a portion of the previous entropy slice.

12. The method according to claim 8 , wherein the previous row is spatially above the current row, and the entropy decoding of the previous entropy slice begins before the entropy decoding of the current entropy slice.

13. The method according to claim 8 , wherein the sample array is a current sample array of a sequence of sample arrays and the method comprises entropy decoding a current entropy slice based on the first probability estimate as adapted using the second probability estimate, the previously-decoded part of the current entropy slice, and a fourth probability estimate used in entropy decoding a previously-decoded frame corresponding to one of the sample arrays other than the current sample array.

14. A method for encoding a sample array into an entropy-encoded data stream coded with a video, the method comprising:

entropy encoding a plurality of entropy slices into the entropy-encoded data stream, each of the plurality of entropy slices corresponding to one row of a plurality of rows of the sample array and each of the plurality of rows having a same number of blocks therein;

for a current entropy slice of the plurality of entropy slices, initializing, during a starting phase of the entropy encoding, a first probability estimate for the current entropy slice before decoding a first block of a current row corresponding to the current entropy slice based on a second probability estimate obtained after completing entropy encoding of a previously-encoded block of a previous row corresponding to a previous entropy slice of the plurality of entropy slices,

wherein the first block is the left-most block of the current row and the previously-encoded block is neighboring the first block, and the current and previous rows are consecutive rows of the sample array; and

the entropy encoding is performed, during a continuation phase of the entropy encoding, using the first probability estimate along an entropy coding path leading from left to right across the current row, the entropy encoding including adapting the first probability estimate along the entropy coding path using only a previously-encoded part of the current entropy slice.

15. The method according to claim 14 , wherein the entropy encoding of the plurality of entropy slices is performed in an order, the entropy slice order is chosen such that, along the entropy slice order, the different portions follow each other in a direction angled relative to the entropy coding paths of the entropy slices.

16. The method according to claim 14 , further comprising storing the second probability estimate after the previously-encoded block is entropy-encoded, wherein the stored second probability estimate is used for initializing the first probability estimate.

17. The method according to claim 14 , further comprising, in entropy encoding a current part of the current entropy slice, adapting the first probability estimate based on a third probability estimate obtained after encoding a portion of the previous entropy slice.

18. The method according to claim 14 , wherein the previous row is spatially above the current row, and the entropy encoding of the previous entropy slice begins before the entropy encoding of the current entropy slice.

19. The method according to claim 14 , wherein the sample array is a current sample array of a sequence of sample arrays and the method comprises entropy encoding a current entropy slice based on the first probability estimate as adapted using the second probability estimate, the previously-encoded part of the current entropy slice, and a fourth probability estimate used in entropy encoding a previously-encoded frame corresponding to one of the sample arrays other than the current sample array.

20. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising entropy-encoded information associated with a sample array of a video, the entropy-encoded information including a plurality of entropy slices, each of the plurality of entropy slices corresponding to one row of a plurality of rows of the sample array and each of the plurality of rows having a same number of blocks therein,

wherein the sample array is encoded by operations including:

for a current entropy slice of the plurality of entropy slices, initializing, during a starting phase of the entropy encoding, a first probability estimate for the current entropy slice before decoding a first block of a current row corresponding to the current entropy slice based on a second probability estimate obtained after completing entropy encoding of a previously-encoded block of a previous row corresponding to a previous entropy slice of the plurality of entropy slices,

wherein the first block is the left-most block of the current row and the previously-encoded block is neighboring the first block, and the current and previous rows are consecutive rows of the sample array; and

entropy encoding, during a continuation phase of the entropy encoding, using the first probability estimate along an entropy coding path leading from left to right across the current row, the entropy encoding including adapting the first probability estimate along the entropy coding path using only a previously-encoded part of the current entropy slice.

Assignments (4)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0781 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2023
From: GEORGE, VALERI; HENKEL, ANASTASIA; KIRCHHOFFER, HEINER; MARPE, DETLEV; SCHIERL, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 062591/0451 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2023
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 062591/0563 →
Continuity (12)
Division 17210026 · Mar 23, 2021
Continuation 16987955 · Aug 7, 2020
Continuation 16840043 · Apr 3, 2020
Continuation 16578716 · Sep 23, 2019
Continuation 16109874 · Aug 23, 2018
Continuation 15824196 · Nov 28, 2017
Continuation 15639312 · Jun 30, 2017
Continuation 15414356 · Jan 24, 2017
Continuation 14141374 · Dec 26, 2013
Continuation PCTEP2012063929 · Jul 16, 2012
Provisional Application 61508477 · Jul 15, 2011
Related Publication 20230179786A1 · Jun 8, 2023