IP Library Granted Patent US 11,611,761
Granted Patent B2
US 11,611,761 · App. 16/987,854 · Granted Mar 21, 2023

Inter-plane reuse of coding parameters

Inventors: Martin Winken (Berlin, DE); Heiner Kirchhoffer (Berlin, DE); Heiko Schwarz (Panketal, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: GE Video Compression, LLC
H04N19/159H04N19/103H04N19/119H04N19/147H04N19/176H04N19/186H04N19/196H04N19/46H04N19/463H04N19/597H04N19/61H04N19/70H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,611,761
App. No.
16/987,854
Granted
Mar 21, 2023
Kind
B2
Abstract

A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.

Claims (38)

1. A decoder for decoding a data stream encoded with a video represented by multiple arrays of information samples, comprising:

an extractor configured for:

extracting, from the data stream, a first set of coding parameters associated with a first coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first coding block,

extracting, from the data stream, inter-plane interchange information associated with a second coding block in a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether a second set of coding parameters used for reconstructing the second coding block is to be derived based on the first set of coding parameters, and

responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is not to be derived based on the first set of coding parameters, obtaining the second set of coding parameters from the data stream;

a predictor configured for:

copying, responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is to be derived based on the first set of coding parameters, at least one of the first set of coding parameters associated with the first coding block as equal to at least one of the second set of coding parameters associated with the second coding block, which is spatially corresponding to the first coding block such that the first and second coding blocks correspond to a same spatial area within the first and second arrays, respectively, wherein a spatial resolution of the first array is greater than a spatial resolution of the second array, and

predicting the second coding block based on the second set of coding parameters to generate a predicted second coding block; and

a reconstructor configured for reconstructing the second coding block based on the predicted second coding block.

2. The decoder of claim 1 , wherein the extractor is further configured for extracting, from the data stream in accordance with the second set of coding parameters,

residual information associated with the second coding block.

3. The decoder of claim 2 , wherein the reconstructor is configured for reconstructing the second coding block based on the predicted second coding block and the residual information associated with the second coding block.

4. The decoder of claim 1 , wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

5. The decoder of claim 1 , wherein coding parameters in the first and second set of coding parameters include at least one of motion parameters for inter-prediction, an intra coding parameter, and subdivision information that specifies how a coding block is to be sub-divided.

6. The decoder of claim 1 , wherein the inter-plane interchange information signals whether a second intra coding parameter of the second set of coding parameters is to be derived based on a first intra coding parameter of the first set of coding parameters.

7. An encoder for encoding, into a data stream, a video represented by multiple arrays of information samples, comprising:

a data stream inserter configured for

inserting, into the data stream, a first set of coding parameters associated with a first coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first coding block,

inserting, into the data stream, inter-plane interchange information associated with a second coding block in a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether a second set of coding parameters used for reconstructing the second coding block is to be derived based on the first set of coding parameters, and

responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is not to be derived based on the first set of coding parameters, inserting, into the data stream, the second set of coding parameters; and

a predictor configured for

copying, responsive to a determination based on the inter-plane interchange information that the second set of coding parameters is to be derived based on the first set of coding parameters, at least one of the first set of coding parameters associated with the first coding block as equal to at least one of the second set of coding parameters associated with the second coding block, which is spatially corresponding to the first coding block such that the first and second coding blocks correspond to a same spatial area within the first and second arrays, respectively, wherein a spatial resolution of the first array is greater than a spatial resolution of the second array, and

predicting the second coding block based on the second set of coding parameters to generate a predicted second coding block.

8. The encoder of claim 7 , the data stream inserter is further configured for inserting, into the data stream in accordance with the second set of coding parameters, residual information associated with the second coding block.

9. The encoder of claim 8 , further comprising a reconstructor configured for reconstructing the second coding block based on the predicted second coding block and the residual information associated with the second coding block.

10. The encoder of claim 7 , wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

11. The encoder of claim 7 , wherein coding parameters in the first and second set of coding parameters include at least one of motion parameters for inter-prediction, an intra coding parameter, and subdivision information that specifies how a coding block is to be sub-divided.

12. The encoder of claim 7 , wherein the inter-plane interchange information signals whether a second intra coding parameter of the second set of coding parameters is to be derived based on a first intra coding parameter of the first set of coding parameters.

13. A data stream stored in a non-transitory storage medium, the data stream related to a video represented by multiple arrays of information samples, the data stream comprising:

a first set of coding parameters associated with a first coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first coding block,

inter-plane interchange information associated with a second coding block in a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether a second set of coding parameters used for reconstructing the second coding block is to be derived based on the first set of coding parameters, and

the second set of coding parameters associated with the second coding block when the inter-plane interchanging information signals that the second set of coding parameters is not to be derived based on the first set of coding parameters,

wherein if the inter-plane interchange information signals that the second set of coding parameters is to be derived based on the first set of coding parameters, at least one of the first set of coding parameters associated with the first coding block is copied equal to at least one of the second set of coding parameters associated with the second coding block, which is spatially corresponding to the first coding block such that the first and second coding blocks correspond to a same spatial area within the first and second arrays, respectively, wherein a spatial resolution of the first array is greater than a spatial resolution of the second array,

wherein the second coding block is predicted based on the second set of coding parameters to generate a predicted second coding block based on which residual information associated with the second coding block is to be derived.

14. The data stream of claim 13 , further comprising the residual information associated with the second coding block inserted in accordance with the second set of coding parameters.

15. The data stream of claim 13 , wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

16. The data stream of claim 13 , wherein coding parameters in the first and second set of coding parameters include at least one of motion parameters for inter-prediction, an intra coding parameter, and subdivision information that specifies how a coding block is to be sub-divided.

17. The data stream of claim 13 , wherein the inter-plane interchange information signals whether a second intra coding parameter of the second set of coding parameters is to be derived based on a first intra coding parameter of the first set of coding parameters.

Assignments (4)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0748 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0446 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2020
From: WINKEN, MARTIN; KIRCHHOFFER, HEINER; SCHWARZ, HEIKO; MARPE, DETLEV; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 053433/0112 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2020
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 054150/0287 →
Continuity (3)
Continuation 13649291 · Oct 11, 2012
Continuation PCTEP2010054840 · Apr 13, 2010
Related Publication 20200366906A1 · Nov 19, 2020