IP Library Granted Patent US 10,448,060
Granted Patent B2
US 10,448,060 · App. 16/017,453 · Granted Oct 15, 2019

Multitree subdivision and inheritance of coding parameters in a coding block

Inventors: Philipp Helle (Berlin, DE); Detlev Marpe (Berlin, DE); Simon Oudin (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: GE VIDEO COMPRESSION, LLC
H04N19/96H04N19/124H04N19/129H04N19/13H04N19/159H04N19/176H04N19/30H04N19/439H04N19/44H04N19/463H04N19/513H04N19/52H04N19/53H04N19/593H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,448,060
App. No.
16/017,453
Granted
Oct 15, 2019
Kind
B2
Abstract

A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.

Claims (53)

1. A decoder, comprising:

an extractor configured to extract, from a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a portion of a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree subdivision of the coding block,

the first information including inheritance information with respect to the plurality of non-overlapping coding sub-blocks, wherein the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an inter coding process; and

a reconstruction mechanism including a processor configured to:

obtain an inheritance syntax element representing the one or more coding parameters associated with the coding block, if the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on the one or more coding parameters associated with the coding block,

copy the inheritance syntax element into a set of syntax elements representing coding parameters used in the inter coding process corresponding to each of the plurality of non-overlapping coding sub-blocks,

determine at least one coding parameter to use in the inter coding process for at least one of the plurality of non-overlapping coding sub-blocks based on the copied inheritance syntax element representing the one or more coding parameters associated with the coding block, wherein a value of the at least one coding parameter is the same as or differs from that of the one or more coding parameters associated with the coding block, and

reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on the value of the at least one coding parameter.

2. The decoder of claim 1 , wherein the reconstruction mechanism comprises a residual reconstructor configured to generate residual of the at least one of the plurality of non-overlapping coding sub-blocks based on the at least one coding parameter.

3. The decoder of claim 1 , wherein the extractor is configured to extract information based on a depth-first traversal order.

4. The decoder of claim 1 , wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters associated with the coding block, the reconstruction mechanism is further configured to:

obtain, from the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks; and

reconstruct the one of the plurality of non-overlapping coding sub-blocks based on the at least one parameter.

5. The decoder of claim 1 , wherein the data stream comprises at least a portion associated with color samples.

6. The decoder of claim 1 , wherein the data stream comprises at least a portion associated with depth values related to a depth map.

7. The decoder of claim 1 , wherein the first information includes subdivision information associated with the array of information samples, the subdivision information indicating a primary sub-division associated with prediction coding and a sub-ordinate sub-division associated with transform coding, such that a tree-root block of the primary sub-division is sub-divided into leaf blocks of the primary sub-division which, in turn, form the tree-root blocks of the sub-ordinate sub-division, further sub-divided into leaf regions of the sub-ordinate sub-division.

8. The decoder of claim 1 , wherein the one or more coding parameters of the coding block are one or more motion parameters.

9. A method for decoding a coding block, the method comprising:

extracting, from a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a portion of a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree subdivision of the coding block,

the first information including inheritance information with respect to the plurality of non-overlapping coding sub-blocks, wherein the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an inter coding process;

obtaining an inheritance syntax element representing the one or more coding parameters associated with the coding block, if the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on the one or more coding parameters associated with the coding block;

copying the inheritance syntax element into a set of syntax elements representing coding parameters used in the inter coding process corresponding to each of the plurality of non-overlapping coding sub-blocks;

determining at least one coding parameter to use in the inter coding process for at least one of the plurality of non-overlapping coding sub-blocks based on the copied inheritance syntax element representing the one or more coding parameters associated with the coding block, wherein a value of the at least one coding parameter is the same as or differs from that of the one or more coding parameters associated with the coding block; and

reconstructing the at least one of the plurality of non-overlapping coding sub-blocks based on the value of the at least one coding parameter.

10. The method of claim 9 , further comprising generating residual of the at least one of the plurality of non-overlapping coding sub-blocks based on the at least one coding parameter.

11. The method of claim 9 , wherein extracting the information is based on a depth-first traversal order.

12. The method of claim 9 , wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters associated with the coding block, the method further comprises:

obtaining, from the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks; and

reconstructing the one of the plurality of non-overlapping coding sub-blocks based on the at least one parameter.

13. The method of claim 9 , wherein the data stream comprises at least a portion associated with color samples.

14. The method of claim 9 , wherein the data stream comprises at least a portion associated with depth values related to a depth map.

15. The method of claim 9 , wherein the first information includes subdivision information associated with the array of information samples, the subdivision information indicating a primary sub-division associated with prediction coding and a sub-ordinate sub-division associated with transform coding, such that a tree-root block of the primary sub-division is sub-divided into leaf blocks of the primary sub-division which, in turn, form the tree-root blocks of the sub-ordinate sub-division, further sub-divided into leaf regions of the sub-ordinate sub-division.

16. The method of claim 9 , wherein the one or more coding parameters of the coding block are one or more motion parameters.

17. An encoder configured to code, into a data stream, first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a portion of a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree subdivision of the coding block,

the first information including inheritance information with respect to the plurality of non-overlapping coding sub-blocks, wherein the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an inter coding process,

wherein the encoder is further configured to code an inheritance syntax element representing the one or more coding parameters associated with the coding block into the data stream and when the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on the one or more coding parameters associated with the coding block, the inheritance syntax element is to be copied into a set of syntax elements representing coding parameters used in the inter coding process corresponding to each of the plurality of non-overlapping coding sub-blocks, and used to determine at least one coding parameter to use in the inter coding process for at least one of the plurality of non-overlapping coding sub-blocks, wherein a value of the at least one coding parameter is same as or differs from that of the one or more coding parameters associated with the coding block, and reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on the value of the at least one coding parameter.

18. The encoder of claim 17 , wherein the encoder is configured to code information based on a depth-first traversal order.

19. The encoder of claim 17 , wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters associated with the coding block, the encoder is further configured to code, into the data stream, at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks, wherein the at least one parameter is to be used to reconstruct the one of the plurality of non-overlapping coding sub-blocks.

20. The encoder of claim 17 , wherein the data stream comprises at least a portion associated with color samples.

21. The encoder of claim 17 , wherein the data stream comprises at least portion associated with depth values related to a depth map.

22. The encoder of claim 17 , wherein the first information includes subdivision information associated with the array of information samples, the subdivision information indicating a primary sub-division associated with prediction coding and a sub-ordinate sub-division associated with transform coding, such that a tree-root block of the primary sub-division is sub-divided into leaf blocks of the primary sub-division which, in turn, form the tree-root blocks of the sub-ordinate sub-division, further sub-divided into leaf regions of the sub-ordinate sub-division.

23. The encoder of claim 17 , wherein the one or more coding parameters of the coding block are one or more motion parameters.

24. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising first information related to a plurality of non-overlapping coding sub-blocks within a coding block of an array of information samples representing a portion of a video, wherein the plurality of non-overlapping coding sub-blocks are obtained by applying multi-tree subdivision of the coding block,

the first information including inheritance information with respect to the plurality of non-overlapping coding sub-blocks, wherein the inheritance information is indicative of whether one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on one or more coding parameters associated with the coding block, wherein the one or more coding parameters of the plurality of non-overlapping coding sub-blocks and the one or more coding parameters of the coding block are coding parameters used in an inter coding process,

wherein the data stream further comprises an inheritance syntax element representing the one or more coding parameters associated with the coding block, and

when the inheritance information indicates that the one or more coding parameters of the plurality of non-overlapping coding sub-blocks are to be determined based on the one or more coding parameters associated with the coding block, the inheritance syntax element is to be copied into a set of syntax elements representing coding parameters used in the inter coding process corresponding to each of the plurality of non-overlapping coding sub-blocks, and used to determine at least one coding parameter to use in the inter coding process for at least one of the plurality of non-overlapping coding sub-blocks, wherein a value of the at least one coding parameter is same as or differs from that of the one or more coding parameters associated with the coding block, and reconstruct the at least one of the plurality of non-overlapping coding sub-blocks based on the value of the at least one coding parameter.

25. The non-transitory computer-readable medium of claim 24 , wherein information in the data stream is coded based on a depth-first traversal order.

26. The non-transitory computer-readable medium of claim 24 , wherein if the inheritance information indicates that the plurality of non-overlapping coding sub-blocks are not to inherit the one or more coding parameters associated with the coding block, the data stream comprises at least one parameter associated with one of the plurality of non-overlapping coding sub-blocks, wherein the at least one parameter is to be used to reconstruct the one of the plurality of non-overlapping coding sub-blocks.

27. The non-transitory computer-readable medium of claim 24 , wherein the data stream comprises at least a portion associated with color samples.

28. The non-transitory computer-readable medium of claim 24 , wherein the data stream comprises at least portion associated with depth values related to a depth map.

29. The non-transitory computer-readable medium of claim 24 , wherein the first information includes subdivision information associated with the array of information samples, the subdivision information indicating a primary sub-division associated with prediction coding and a sub-ordinate sub-division associated with transform coding, such that a tree-root block of the primary sub-division is sub-divided into leaf blocks of the primary sub-division which, in turn, form the tree-root blocks of the sub-ordinate sub-division, further sub-divided into leaf regions of the sub-ordinate sub-division.

30. The non-transitory computer-readable medium of claim 24 , wherein the one or more coding parameters of the coding block are one or more motion parameters.

Assignments (4)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0717 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2018
From: HELLE, PHILIPP; MARPE, DETLEV; OUDIN, SIMON; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 046194/0114 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2018
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 046194/0172 →
Priority Claims (1)
EP 10159782 · Apr 13, 2010 · regional
Continuity (3)
Continuation 13649233 · Oct 11, 2012
Continuation PCTEP2011055794 · Apr 13, 2011
Related Publication 20180310030A1 · Oct 25, 2018