IP Library Granted Patent US 11,178,411
Granted Patent B2
US 11,178,411 · App. 17/029,130 · Granted Nov 16, 2021

Coding of significance maps and transform coefficient blocks

Inventors: Heiner Kirchhoffer (Berlin, DE); Heiko Schwarz (Panketel, DE); Tung Nguyen (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: GE Video Compression, LLC
H04N19/18H04N19/124H04N19/129H04N19/13H04N19/136H04N19/139H04N19/176H04N19/46H04N19/50H04N19/51H04N19/59H04N19/61H04N19/70H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,178,411
App. No.
17/029,130
Granted
Nov 16, 2021
Kind
B2
Abstract

A higher coding efficiency for coding a significance map indicating positions of significant transform coefficients within a transform coefficient block is achieved by the scan order by which the sequentially extracted syntax elements indicating, for associated positions within the transform coefficient block, as to whether at the respective position a significant or insignificant transform coefficient is situated, are sequentially associated to the positions of the transform coefficient block, among the positions of the transform coefficient block depends on the positions of the significant transform coefficients indicated by previously associated syntax elements. Alternatively, the first-type elements may be context-adaptively entropy decoded using contexts which are individually selected for each of the syntax elements dependent on a number of significant transform coefficients in a neighborhood of the respective syntax element, indicated as being significant by any of the preceding syntax elements.

Claims (47)

1. An apparatus for decoding a transform coefficient block, the apparatus comprising:

a decoder configured for extracting, from a data stream, a significance map that indicates positions of significant transform coefficients within the transform coefficient block, and values of the significant transform coefficients within the transform coefficient block, and dividing the transform coefficient block into a plurality of sub-blocks; and

an associator configured for associating the significant transform coefficients with their respective positions in the transform coefficient block, wherein transform coefficients within each of the plurality of sub-blocks of the transform coefficient block are scanned in a position sub-scan order and the plurality of sub-blocks of the transform coefficient block are scanned in a sub-block scan order, wherein the position sub-scan order is selected from a plurality of scan orders including a diagonal scan order,

wherein the decoder is configured for using context-adaptive entropy decoding to extract the values of the significant transform coefficients of a current sub-block of the plurality of sub-blocks, the context-adaptive entropy decoding including:

determining an index value from among a plurality of indices, wherein the index value corresponds to a current context set selected for the current sub-block from a pre-defined plurality of context sets and the index value is determined based on a specific value related to a previously traversed sub-block of the plurality of sub-blocks of the transform coefficient block, and

selecting a current context from a plurality of contexts based on the index value and information about already-coded one or more of the significant transform coefficients in the current sub-block.

2. The apparatus according to claim 1 , wherein the decoder is configured for, in context-adapted entropy decoding the significant transform coefficients within one of the plurality of sub-blocks using the selected context, assigning the selected context to a position within the respective sub-block.

3. The apparatus according to claim 1 , wherein the apparatus is at least a portion of a programmable logic device, programmable gate array, microprocessor, computer or hardware apparatus.

4. The apparatus according to claim 1 , wherein the data stream comprises at least a portion associated with color samples.

5. The apparatus according to claim 1 , wherein the data stream comprises at least a portion associated with depth values related to a depth map.

6. The apparatus according to claim 1 , wherein the position sub-scan order is adaptively selected from a plurality of scan orders including a zig-zag scan order.

7. An apparatus for encoding a transform coefficient block, the apparatus comprising:

an encoder configured for encoding, into a data stream, a significance map that indicates positions of significant transform coefficients within the transform coefficient block, and encoding values of the significant transform coefficients within the transform coefficient block, wherein the transform coefficient block is divided into a plurality of sub-blocks and transform coefficients within each of the plurality of sub-blocks of the transform coefficient block are scanned in a position sub-scan order and the plurality of sub-blocks of the transform coefficient block are scanned in a sub-block scan order, wherein the position sub-scan order is selected from a plurality of scan orders including a diagonal scan order,

wherein the encoder is further configured for using context-adaptive entropy encoding to encode the values of the significant transform coefficients of a current sub-block of the plurality of sub-blocks, the context-adaptive entropy encoding including:

determining an index value from among a plurality of indices, wherein the index value corresponds to a current context set selected for the current sub-block from a pre-defined plurality of context sets and the index value is determined based on a specific value related to a previously traversed sub-block of the plurality of sub-blocks of the transform coefficient block, and

selecting a current context from a plurality of contexts based on the index value and information about already-coded one or more of the significant transform coefficients in the current sub-block.

8. The apparatus according to claim 7 , wherein the encoder is configured for, in context-adapted entropy encoding the significant transform coefficients within one of the plurality of sub-blocks using the selected context, assigning the selected context to the a position within the respective sub-block.

9. The apparatus according to claim 7 , wherein the apparatus is at least a portion of a programmable logic device, programmable gate array, microprocessor, computer or hardware apparatus.

10. The apparatus according to claim 7 , wherein the data stream comprises at least a portion associated with color samples.

11. The apparatus according to claim 7 , wherein the data stream comprises at least a portion associated with depth values related to a depth map.

12. The apparatus according to claim 7 , wherein the position sub-scan order is adaptively selected from a plurality of scan orders including a zig-zag scan order.

13. The apparatus according to claim 7 , wherein the sub-block scan order leads zigzag-wise from a sub-block including a position of a lowest frequency in a vertical direction and in a horizontal direction to a sub-block including a position of a highest frequency in both the vertical and horizontal directions.

14. A non-transitory computer-readable medium for storing data associated with a transform coefficient block, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising an encoded significance map indicating positions of significant transform coefficients within a transform coefficient block, and values of the significant transform coefficients within the transform coefficient block,

wherein the transform coefficient block is divided into a plurality of sub-blocks and the values of the significant transform coefficients are encoded into the data stream by context-adaptive entropy encoding, and transform coefficients within each of the plurality of sub-blocks of the transform coefficient block are scanned in a position sub-scan order and the plurality of sub-blocks of the transform coefficient block are scanned in a sub-block scan order, wherein the position sub-scan order is selected from a plurality of scan orders including a diagonal scan order,

wherein the values of the significant transform coefficients of a current sub-block of the plurality of sub-blocks are context-adapted entropy encoded by:

determining an index value from among a plurality of indices, wherein the index value corresponds to a current context set selected for the current sub-block from a pre-defined plurality of context sets and the index value is determined based on a specific value related to a previously traversed sub-block of the plurality of sub-blocks of the transform coefficient block, and

selecting a current context from a plurality of contexts based on the index value and information about already-coded one or more of the significant transform coefficients in the current sub-block.

15. The non-transitory computer-readable medium according to claim 14 , wherein, in context-adapted entropy encoding the significant transform coefficients within one of the plurality of sub-blocks using the selected context for the respective sub-block, the selected context is assigned to a position within the respective sub-block.

16. The non-transitory computer-readable medium according to claim 14 , wherein the sub-block scan order leads zigzag-wise from a sub-block including a position of a lowest frequency in a vertical direction and in a horizontal direction to a sub-block including a position of a highest frequency in both the vertical and horizontal directions.

17. The non-transitory computer-readable medium according to claim 14 , wherein the data stream comprises at least a portion associated with color samples.

18. The non-transitory computer-readable medium according to claim 14 , wherein the data stream comprises at least a portion associated with depth values related to a depth map.

19. The non-transitory computer-readable medium according to claim 14 , wherein in accordance with the position sub-scan order, each of the plurality of sub-blocks is scanned from a position within the respective sub-block corresponding to a highest frequency in both vertical and horizontal directions to a position of the respective sub-block corresponding to a lowest frequency in both the vertical and horizontal directions.

20. The non-transitory computer-readable medium according to claim 14 , wherein the data stream is processed by an apparatus, which is at least a portion of a programmable logic device, programmable gate array, microprocessor, computer or hardware apparatus.

21. The non-transitory computer-readable medium according to claim 14 , wherein the position sub-scan order is adaptively selected from a plurality of scan orders including a diagonal scan order.

22. The non-transitory computer readable digital storage medium according to claim 14 , wherein the medium is a DVD, Blue-Ray, CD, ROM, PROM, EPROM, EEPROM or FLASH memory.

23. A method for decoding a transform coefficient block, the method comprising:

extracting, from a data stream, a significance map that indicates positions of significant transform coefficients within the transform coefficient block, and values of the significant transform coefficients within the transform coefficient block;

dividing the transform coefficient block into a plurality of sub-blocks;

associating the significant transform coefficients with their respective positions in the transform coefficient block, wherein transform coefficients within each of the plurality of sub-blocks of the transform coefficient block are scanned in a position sub-scan order and the plurality of sub-blocks of the transform coefficient block are scanned in a sub-block scan order, wherein the position sub-scan order is selected from a plurality of scan orders including a diagonal scan order; and

using context-adaptive entropy decoding to extract the values of the significant transform coefficients of a current sub-block of the plurality of sub-blocks including:

determining an index value from among a plurality of indices, wherein the index value corresponds to a current context set selected for the current sub-block from a pre-defined plurality of context sets and the index value is determined based on a specific value related to a previously traversed sub-block of the plurality of sub-blocks of the transform coefficient block, and

selecting a current context from a plurality of contexts based on the index value and information about already-coded one or more of the significant transform coefficients in the current sub-block.

24. The method according to claim 23 , wherein the context-adapted entropy decoding the significant transform coefficients within one of the plurality of sub-blocks using the selected context includes assigning the selected context to a position within the respective sub-block.

25. The method according to claim 23 , wherein the data stream comprises at least a portion associated with color samples.

26. The method according to claim 23 , wherein the data stream comprises at least a portion associated with depth values related to a depth map.

27. The method according to claim 23 , wherein the position sub-scan order is adaptively selected from a plurality of scan orders including a zig-zag scan order.

Assignments (4)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0748 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0446 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2020
From: KIRCHHOFFER, HEINER; SCHWARZ, HEIKO; NGUYEN, TUNG; MARPE, DETLEV; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 053854/0268 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2020
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 053854/0334 →
Priority Claims (2)
EP 10159766 · Apr 13, 2010 · regional
WO PCT/EP2010/054822 · Apr 13, 2010 · international
Continuity (8)
Continuation 16983356 · Aug 3, 2020
Continuation 16572669 · Sep 17, 2019
Continuation 16385391 · Apr 16, 2019
Continuation 16003183 · Jun 8, 2018
Continuation 15828756 · Dec 1, 2017
Continuation 13648538 · Oct 10, 2012
Continuation PCTEP2011055644 · Apr 11, 2011
Related Publication 20210006804A1 · Jan 7, 2021