IP Library Granted Patent US 10,574,998
Granted Patent B2
US 10,574,998 · App. 16/197,154 · Granted Feb 25, 2020

Inter-plane prediction

Inventors: Martin Winken (Berlin, DE); Heiner Kirchhoffer (Berlin, DE); Heiko Schwarz (Panketal, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: GE VIDEO COMPRESSION, LLC
H04N19/159H04N19/103H04N19/119H04N19/147H04N19/176H04N19/186H04N19/196H04N19/46H04N19/463H04N19/597H04N19/61H04N19/70H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,574,998
App. No.
16/197,154
Granted
Feb 25, 2020
Kind
B2
Abstract

A better rate distortion ratio is achieved by making interrelationships between coding parameters of different planes available for exploitation for the aim of redundancy reduction despite the additional overhead resulting from the need to signal the inter-plane prediction information to the decoder. In particular, the decision to use inter plane prediction or not may be performed for a plurality of planes individually. Additionally or alternatively, the decision may be done on a block basis considering one secondary plane.

Claims (55)

1. A decoder for decoding a data stream encoded with a video including pictures of a scene represented by multiple arrays of information samples, comprising: an extractor configured for:

extracting, from the data stream, a first set of coding parameters including a first intra coding parameter associated with a first intra coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first intra coding block in an intra coding mode and the first intra coding parameter indicates an angle of direction of intra prediction within the first array,

extracting, from the data stream, inter-plane interchange information associated with a second intra coding block in a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether intra coding information of the second intra coding block in the intra coding mode is to be derived based on a combination of the reconstructed first intra coding block and one or more of a second set of coding parameters, and

responsive to the inter-plane interchange information indicating no derivation of the intra coding information of the second intra coding block based on the combination, extracting, from the data stream, the second set of coding parameters including a second intra coding parameter which indicates an angle of direction of intra prediction within the second array; and

a predictor configured for:

responsive to the inter-plane interchange information indicating derivation of the intra coding information of the second intra coding block based on the combination, deriving the intra coding information for the second intra coding block based on the combination of the reconstructed first intra coding block and the one or more of the second set of coding parameters, and

predicting the second intra coding block based on the second set of coding parameters including the second intra coding parameter to generate a predicted second intra coding block based on the intra coding mode, wherein the first and second arrays of information samples represent different types of spatially sampled information of the scene.

2. The decoder of claim 1 , wherein the extractor is further configured for extracting, from the data stream in accordance with the second set of coding parameters, residual information associated with the second coding block.

3. The decoder of claim 2 , further comprising a reconstructor configured for reconstructing the second coding block based on the predicted second coding block and the residual information associated with the second coding block.

4. The decoder of claim 1 , wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

5. The decoder of claim 1 , wherein coding parameters in the first and second set of coding parameters include motion parameters for inter-prediction.

6. The decoder of claim 1 , wherein coding parameters in the first and second set of coding parameters include subdivision information that specifies how a coding block is to be sub-divided.

7. The decoder of claim 6 , wherein first subdivision of the first array of information samples differs from second subdivision of the second array of information samples.

8. The decoder of claim 1 , wherein a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a first direction differs from a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a second direction.

9. A method for decoding a data stream encoded with a video including pictures of a scene represented by multiple arrays of information samples, comprising:

extracting, from the data stream, a first set of coding parameters including a first intra coding parameter associated with a first intra coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first intra coding block in an intra coding mode and the first intra coding parameter indicates an angle of direction of intra prediction within the first array;

extracting, from the data stream, inter-plane interchange information associated with a second intra coding block in a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether intra coding information of the second intra coding block in the intra coding mode is to be derived based on a combination of the reconstructed first intra coding block and one or more of a second set of coding parameters;

responsive to the inter-plane interchange information indicating no derivation of the intra coding information of the second intra coding block based on the combination, extracting, from the data stream, the second set of coding parameters including a second intra coding parameter which indicates an angle of direction of intra prediction within the second array;

responsive to the inter-plane interchange information indicating derivation of the intra coding information of the second intra coding block based on the combination, deriving the intra coding information for the second intra coding block based on the combination of the reconstructed first intra coding block and the one or more of the second set of coding parameters; and

predicting the second intra coding block based on the second set of coding parameters including the second intra coding parameter to generate a predicted second intra coding block based on the intra coding mode,

wherein the first and second arrays of information samples represent different types of spatially sampled information of the scene.

10. The method of claim 9 , further comprising extracting, from the data stream in accordance with the second set of coding parameters, residual information associated with the second coding block.

11. The method of claim 10 , further comprising reconstructing the second coding block based on the predicted second coding block and the residual information associated with the second coding block.

12. The method of claim 9 , wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

13. The method of claim 9 , wherein coding parameters in the first and second set of coding parameters include motion parameters for inter-prediction.

14. The method of claim 9 , wherein coding parameters in the first and second set of coding parameters include subdivision information that specifies how a coding block is to be sub-divided.

15. The method of claim 14 , wherein first subdivision of the first array of information samples differs from second subdivision of the second array of information samples.

16. The method of claim 9 , wherein a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a first direction differs from a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a second direction.

17. An encoder for encoding, into a data stream, a video including pictures of a scene represented by multiple arrays of information samples, comprising:

a data stream inserter configured for:

inserting, into the data stream, a first set of coding parameters including a first intra coding parameter associated with a first intra coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first intra coding block in an intra coding mode and the first intra coding parameter indicates an angle of direction of intra prediction within the first array,

inserting, into the data stream, inter-plane interchange information associated with a second intra coding block in a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether intra coding information of the second intra coding block in the intra coding mode is to be derived based on a combination of the reconstructed first intra coding block and one or more of a second set of coding parameters, and

responsive to the inter-plane interchange information indicating no derivation of the intra coding information of the second intra coding block based on the combination, inserting, into the data stream, the second set of coding parameters including a second intra coding parameter which indicates an angle of direction of intra prediction within the second array; and

a predictor configured for responsive to the inter-plane interchange information indicating derivation of the intra coding information of the second intra coding block based on the combination, deriving the intra coding information for the second intra coding block based on the combination of the reconstructed first intra coding block and the one or more of the second set of coding parameters, and

predicting the second intra coding block based on the second set of coding parameters including the second intra coding parameter to generate a predicted second intra coding block based on the intra coding mode,

wherein the first and second arrays of information samples represent different types of spatially sampled information of the scene.

18. The encoder of claim 17 , the data stream inserter is further configured for inserting, into the data stream in accordance with the second set of coding parameters, residual information associated with the second coding block.

19. The encoder of claim 18 , further comprising a reconstructor configured for reconstructing the second coding block based on the predicted second coding block and the residual information associated with the second coding block.

20. The encoder of claim 17 , wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

21. The encoder of claim 17 , wherein coding parameters in the first and second set of coding parameters include motion parameters for inter-prediction.

22. The encoder of claim 17 , wherein coding parameters in the first and second set of coding parameters include subdivision information that specifies how a coding block is to be sub-divided.

23. The encoder of claim 22 , wherein first subdivision of the first array of information samples differs from second subdivision of the second array of information samples.

24. The encoder of claim 17 , wherein a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a first direction differs from a scaling factor for a spatial resolution of the first array of information samples relative to the second array of information samples in a second direction.

25. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream related to a video including pictures of a scene represented by multiple arrays of information samples, and comprising:

a first set of coding parameters including a first intra coding parameter associated with a first intra coding block in a first array of information samples that represents a first color component of the video, wherein the first set of coding parameters is to be used for reconstructing the first intra coding block in an intra coding mode and the first intra coding parameter indicates an angle of direction of intra prediction within the first array,

inter-plane interchange information associated with a second intra coding block in a second array of information samples that represents a second color component of the video, wherein the inter-plane interchange information signals whether intra coding information of the second intra coding block in the intra coding mode is to be derived based a combination of on the reconstructed first intra coding block and one or more of a second set of coding parameters, and

the second set of coding parameters including a second intra coding parameter which indicates an angle of direction of intra prediction within the second array,

wherein responsive to the inter-plane interchange information indicating derivation of the intra coding information of the second intra coding block based on the combination, the intra coding information for the second intra coding block is derived based on the combination of the reconstructed first intra coding block and the one or more of the second set of coding parameters, and the second intra coding block is predicted based on the second set of coding parameters including the second intra coding parameter to generate a predicted second intra coding block,

wherein, based on the predicted second block, residual information associated with the second intra coding block is to be derived, and the first and second arrays of information samples representing different types of spatially sampled information of the scene.

26. The computer-readable medium of claim 25 , wherein the data stream further comprises the residual information associated with the second coding block.

27. The computer-readable medium of claim 26 , wherein the second coding block is reconstructed based on the predicted second coding block and the residual information associated with the second coding block.

28. The computer-readable medium of claim 25 , wherein the different types of spatially sampled information include brightness, color, depth, or transparency information of the scene.

29. The computer-readable medium of claim 25 , wherein coding parameters in the first and second set of coding parameters include motion parameters for inter-prediction.

30. The computer-readable medium of claim 25 , wherein coding parameters in the first and second set of coding parameters include subdivision information that specifies how a coding block is to be sub-divided.

Assignments (3)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0717 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2018
From: WINKEN, MARTIN; KIRCHHOFFER, HEINER; SCHWARZ, HEIKO; MARPE, DETLEV; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 047558/0249 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2018
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 047558/0289 →
Continuity (4)
Continuation 15195266 · Jun 28, 2016
Continuation 13649291 · Oct 11, 2012
Continuation PCTEP2010054840 · Apr 13, 2010
Related Publication 20190089962A1 · Mar 21, 2019