IP Library Granted Patent US 11,051,047
Granted Patent B2
US 11,051,047 · App. 17/066,709 · Granted Jun 29, 2021

Inheritance in sample array multitree subdivision

Inventors: Philipp Helle (Berlin, DE); Detlev Marpe (Berlin, DE); Simon Oudin (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: GE Video Compression, LLC
H04N19/96H04N19/124H04N19/129H04N19/13H04N19/159H04N19/176H04N19/30H04N19/439H04N19/44H04N19/463H04N19/513H04N19/52H04N19/53H04N19/593H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,051,047
App. No.
17/066,709
Granted
Jun 29, 2021
Kind
B2
Abstract

A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.

Claims (74)

1. A decoder for reconstructing an array of information samples based on a data stream, the array of information samples representing a spatially sampled information signal, the decoder comprising:

a divider configured for:

subdividing the array of information samples into prediction blocks associated with prediction coding according to first subdivision information,

subdividing at least one of the prediction blocks that is greater than a maximum size into root blocks of the maximum size, wherein the root blocks are associated with transform coding, and

with respect to a current root block of the root blocks,

determining whether the current root block is to be subdivided based on second subdivision information, and

responsive to a determination that the current root block is to be subdivided, subdividing the current root block into residual blocks associated with transform coding;

an extractor configured for:

with respect to each of the at least one of the prediction blocks,

extracting, from the data stream, inheritance information indicating whether inheritance is to be applied in relation to residual blocks associated with the prediction block, and

if inheritance is to be applied, sharing a coding parameter among the residual blocks associated with the prediction block; and

a reconstructor configured for:

determining a residual signal for each of the residual blocks based on the coding parameter in transform coding; and

reconstructing the array of information samples based on the residual signals.

2. The decoder according to claim 1 , wherein the spatially sampled information signal is a video accompanied with depth information.

3. The decoder according to claim 1 , wherein the spatially sampled information signal is a sequence of pictures with each picture comprising an array of luma samples along with two arrays of chroma samples per frame, wherein a scaling factor for a spatial resolution of the arrays of chroma samples relative to the array of luma samples in the horizontal direction differs from a scaling factor for a spatial resolution vertical direction.

4. The decoder according to claim 1 , wherein the array of information samples is one of samples arrays related to different color components and forming color planes of a picture, and the decoder is configured to decode the different color planes of the picture independently.

5. The decoder according to claim 1 , wherein the extractor is configured to, if inheritance is indicated not to be used, extract the coding parameter from the data stream for each of the residual blocks corresponding to the respective prediction block.

6. The decoder according to claim 1 , wherein the decoder is configured to reconstruct the array information samples by prediction using a prediction mode which is extracted and decoded from the data stream.

7. The decoder according to claim 1 , wherein subdivision into the prediction blocks, subdivision into the residual blocks, or both is based on a quadtree partitioning technique.

8. A method for reconstructing an array of information samples based on a data stream, the array of information samples representing a spatially sampled information signal, the method comprising:

subdividing the array of information samples into prediction blocks associated with prediction coding according to first subdivision information;

subdividing at least one of the prediction blocks that is greater than a maximum size into root blocks of the maximum size, wherein the root blocks are associated with transform coding;

with respect to a current root block of the root blocks,

determining whether the current root block is to be subdivided based on second subdivision information, and

responsive to a determination that the current root block is to be subdivided, subdividing the current root block into residual blocks associated with transform coding;

with respect to each of the at least one of the prediction blocks,

extracting, from the data stream, inheritance information indicating whether inheritance is to be applied in relation to residual blocks associated with the prediction block, and

if inheritance is to be applied, sharing a coding parameter among the residual blocks associated with the prediction block;

determining a residual signal for each of the residual blocks based on the coding parameter in transform coding; and

reconstructing the array of information samples based on the residual signals.

9. The method according to claim 8 , wherein the spatially sampled information signal is a video accompanied with depth information.

10. The method according to claim 8 , wherein the spatially sampled information signal is a sequence of pictures with each picture comprising an array of luma samples along with two arrays of chroma samples per frame, wherein a scaling factor for a spatial resolution of the arrays of chroma samples relative to the array of luma samples in the horizontal direction differs from a scaling factor for a spatial resolution vertical direction.

11. The method according to claim 8 , wherein the array of information samples is one of samples arrays related to different color components and forming color planes of a picture, and the decoder is configured to decode the different color planes of the picture independently.

12. The method according to claim 8 , further comprising: if inheritance is indicated not to be used, extracting the coding parameter from the data stream for each of the residual blocks corresponding to the respective prediction block.

13. The method according to claim 8 , wherein the array information samples is reconstructed by prediction using a prediction mode which is extracted and decoded from the data stream.

14. The method according to claim 8 , wherein subdivision into the prediction blocks, subdivision into the residual blocks, or both is based on a quadtree partitioning technique.

15. An encoder for encoding an array of information samples into a data stream, the array of information samples representing a spatially sampled information signal, the encoder comprising:

a divider configured to:

subdivide the array of information samples into prediction blocks associated with prediction coding according to first subdivision information,

subdivide at least one of the prediction blocks that is greater than a maximum size into root blocks of the maximum size, wherein the root blocks are associated with transform coding, and

with respect to a current root block of the root blocks,

determine whether the current root block is to be subdivided based on second subdivision information, and

responsive to a determination that the current root block is to be subdivided, subdivide the current root block into residual blocks associated with transform coding; and

an inserter configured to:

with respect to each of the at least one of the prediction blocks,

insert inheritance information into the data stream, the inheritance information indicating whether inheritance is to be applied in relation to residual blocks associated with the prediction block, and

if inheritance is to be applied, share a coding parameter among the residual blocks associated with the prediction block.

16. The encoder according to claim 15 , wherein the spatially sampled information signal is a video accompanied with depth information.

17. The encoder according to claim 15 , wherein the spatially sampled information signal is a sequence of pictures with each picture comprising an array of luma samples along with two arrays of chroma samples per frame, wherein a scaling factor for a spatial resolution of the arrays of chroma samples relative to the array of luma samples in the horizontal direction differs from a scaling factor for a spatial resolution vertical direction.

18. The encoder according to claim 15 , wherein the array of information samples is one of samples arrays related to different color components and forming color planes of a picture, and the decoder is configured to decode the different color planes of the picture independently.

19. The encoder according to claim 15 , wherein the inserter is configured to, if inheritance is indicated not to be used, insert the coding parameter into the data stream for each of the residual blocks corresponding to the respective prediction block.

20. The encoder according to claim 15 , wherein the encoder is configured to encode the array information samples by prediction using a prediction mode which is inserted into the data stream.

21. The encoder according to claim 15 , wherein subdivision into the prediction blocks, subdivision into the residual blocks, or both is based on a quadtree partitioning technique.

22. The encoder according to claim 21 , wherein, according to the quadtree partitioning technique, the array of information samples is subdivided into prediction blocks such that a plurality of hierarchical levels are created, wherein each of the prediction blocks is associated with one of the plurality of hierarchical levels.

23. A non-transitory computer-readable medium for storing data, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information associated with an array of information samples representing a spatially sampled information signal, the encoded information including inheritance information, wherein the array of information samples is reconstructed based on a plurality of instructions including:

subdividing the array of information samples into prediction blocks associated with prediction coding according to first subdivision information;

subdividing at least one of the prediction blocks that is greater than a maximum size into root blocks of the maximum size, wherein the root blocks are associated with transform coding;

with respect to a current root block of the root blocks,

determining whether the current root block is to be subdivided based on second subdivision information, and

responsive to a determination that the current root block is to be subdivided, subdividing the current root block into residual blocks associated with transform coding;

with respect to each of the at least one of the prediction blocks,

extracting, from the data stream, inheritance information indicating whether inheritance is to be applied in relation to residual blocks associated with the prediction block, and

if inheritance is to be applied, sharing a coding parameter among the residual blocks associated with the prediction block; and

determining a residual signal for each of the residual blocks based on the coding parameter in transform coding; and

reconstructing the array of information samples based on the residual signals.

24. The computer-readable medium of claim 23 , wherein the spatially sampled information signal is a video accompanied with depth information.

25. The computer-readable medium of claim 23 , wherein the spatially sampled information signal is a sequence of pictures with each picture comprising an array of luma samples along with two arrays of chroma samples per frame, wherein a scaling factor for a spatial resolution of the arrays of chroma samples relative to the array of luma samples in the horizontal direction differs from a scaling factor for a spatial resolution vertical direction.

26. The computer-readable medium of claim 23 , wherein the array of information samples is one of samples arrays related to different color components and forming color planes of a picture, and the decoder is configured to decode the different color planes of the picture independently.

27. The computer-readable medium of claim 23 , the plurality of instructions including further including: if inheritance is indicated not to be used, extracting the coding parameter from the data stream for each of the residual blocks corresponding to the respective prediction block.

28. The computer-readable medium of claim 23 , wherein the array information samples is reconstructed by prediction using a prediction mode which is extracted and decoded from the data stream.

29. The computer-readable medium of claim 23 , wherein subdivision into the prediction blocks, subdivision into the residual blocks, or both is based on a quadtree partitioning technique.

30. The computer-readable medium of claim 29 , wherein, according to the quadtree partitioning technique, the array of information samples is subdivided into prediction blocks such that a plurality of hierarchical levels are created, wherein each of the prediction blocks is associated with one of the plurality of hierarchical levels.

Assignments (4)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0748 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0615 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2020
From: HELLE, PHILIPP; MARPE, DETLEV; OUDIN, SIMON; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 054016/0544 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2020
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 054356/0893 →
Priority Claims (2)
EP 10159782 · Apr 13, 2010 · regional
WO PCT/EP2010/054827 · Apr 13, 2010 · international
Continuity (7)
Continuation 16803167 · Feb 27, 2020
Continuation 16664031 · Oct 25, 2019
Continuation 16578620 · Sep 23, 2019
Continuation 15197406 · Jun 29, 2016
Continuation 13649233 · Oct 11, 2012
Continuation PCTEP2011055794 · Apr 13, 2011
Related Publication 20210037265A1 · Feb 4, 2021