IP Library Granted Patent US 10,212,420
Granted Patent B2
US 10,212,420 · App. 14/666,658 · Granted Feb 19, 2019

Scalable video coding using inter-layer prediction of spatial intra prediction parameters

Inventors: Tobias Hinz (Schorfheide, DE); Haricharan Lakshman (Berlin, DE); Jan Stegemann (Berlin, DE); Philipp Helle (Berlin, DE); Mischa Siekmann (Berlin, DE); Karsten Suehring (Berlin, DE); Detlev Marpe (Berlin, DE); Heiko Schwarz (Panketal, DE); Christian Bartnik (Berlin, DE); Ali Atef Ibrahim Khairat Abdelhamid (Berlin, DE); Heiner Kirchhoffer (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: GE Video Compression, LLC
H04N19/119H04N19/105H04N19/107H04N19/117H04N19/137H04N19/157H04N19/176H04N19/18H04N19/187H04N19/198H04N19/33H04N19/48H04N19/503H04N19/587H04N19/59H04N19/593H04N19/61H04N19/615H04N19/70H04N19/82H04N19/865H04N19/11H04N19/463
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,212,420
App. No.
14/666,658
Granted
Feb 19, 2019
Kind
B2
Abstract

The coding efficiency of scalable video coding is increased by substituting missing spatial intra prediction parameter candidates in a spatial neighborhood of a current block of the enhancement layer by use of intra prediction parameters of a co-located block of the base layer signal. By this measure, the coding efficiency for coding the spatial intra prediction parameters is increased due to the improved prediction quality of the set of intra prediction parameters of the enhancement layer, or, more precisely stated, the increased likelihood, that appropriate predictors for the intra prediction parameters for an intra predicted block of the enhancement layer are available thereby increasing the likelihood that the signaling of the intra prediction parameter of the respective enhancement layer block may be performed, on average, with less bits.

Claims (56)

1. A scalable video decoder comprising:

a block-based decoding unit configured to:

reconstruct, using a processor, a base layer signal from a coded data stream by a block-wise prediction based on a selection between a spatial intra prediction and a temporal inter-prediction mode; and

reconstruct, using a processor, an enhancement layer signal of a video from the coded data stream by the block-wise prediction that includes using a current intra prediction parameter to decode a current block of the enhancement layer signal according to a spatial intra prediction mode, comprising:

check whether a neighboring block of the enhancement layer signal is decoded according to the spatial intra prediction mode, wherein the neighboring block neighbors the current block of the enhancement layer signal;

responsive to checking the neighboring block, insert a neighboring intra prediction parameter that includes an angular intra prediction parameter of the neighboring block-into a set of intra prediction parameters for the current block;

check whether a co-located block of the base layer signal is decoded according to the spatial intra prediction mode, wherein the co-located block is co-located in the base layer signal relative to the current block of the enhancement layer signal;

responsive to checking the co-located block, insert a base-layer intra prediction parameter of the co-located block of the base layer signal into the set of intra prediction parameters for the current block;

determine the current intra prediction parameter for the current block based on a syntax element present in the coded data stream specific to the current block, wherein the syntax element indicates at least one of the set of intra prediction parameters; and

form a weighted average of an inter-layer prediction of the current block acquired from the reconstructed base layer signal, and an enhancement layer internal prediction of the current block as reconstructed using the current intra prediction parameter to acquire an enhancement layer prediction of the current block.

2. The scalable video decoder according to claim 1 , wherein the block-based decoding unit is configured to perform the checking the neighboring block and responsive to checking the neighboring block, including in the set with respect to a set of neighboring blocks of the enhancement layer signal, neighboring the current block of the enhancement layer signal.

3. The scalable video decoder according to claim 1 , wherein the set of intra prediction parameters for the current block includes a default intra prediction parameter.

4. The scalable video decoder according to claim 1 , wherein the base-layer intra prediction parameter is included in the set of intra prediction parameters for the current block if the neighboring block of the enhancement layer signal has not been predicted using the spatial intra prediction mode.

5. The scalable video decoder according to claim 1 , wherein the block-based decoding unit is configured to further check whether the neighboring intra prediction parameter of the neighboring block fulfills a particular criterion, and include the neighboring intra prediction parameter in the set of intra prediction parameters for the current block dependent on the further check.

6. The scalable video decoder according to claim 5 , wherein:

the neighboring intra prediction parameter is included in the set of intra prediction parameters for the current block if the neighboring block of the enhancement layer signal has been predicted using the spatial intra prediction mode and the neighboring intra prediction parameter of the neighboring block is an angular intra prediction parameter, and

the base-layer intra prediction parameter is included in the set of intra prediction parameters if the neighboring block of the enhancement layer signal has not been predicted using the spatial intra prediction mode or the neighboring intra prediction parameter of the neighboring block is not the angular intra prediction parameter.

7. The scalable video decoder according to claim 1 , wherein the block-based decoding unit is configured to check whether the base-layer intra prediction parameter is an angular intra prediction parameter.

8. The scalable video decoder according to claim 7 , wherein:

the neighboring intra prediction parameter is included in the set of intra prediction parameters for the current block if the neighboring block of the enhancement layer signal has been predicted using the spatial intra prediction mode and the intra prediction parameter of the neighboring block is an angular intra prediction direction,

the base-layer intra prediction parameter included in the set of intra prediction parameters if the neighboring block of the enhancement layer signal has not been predicted using the spatial intra prediction mode or the neighboring intra prediction parameter of the neighboring block is not the angular intra prediction direction, but for the co-located block of the base layer signal, the spatial intra prediction mode has been selected and the base-layer intra prediction parameter is the angular intra prediction parameter, and

neither the neighboring intra prediction parameter nor the base-layer intra prediction parameter is included in the set of intra prediction parameters for the current block if the neighboring block of the enhancement layer signal has not been predicted using the spatial intra prediction mode or the neighboring intra prediction parameter is not the angular intra prediction direction, and for the co-located block of the base layer signal, the spatial intra prediction mode has not been selected or the base-layer intra prediction parameter is not the angular intra prediction parameter.

9. The scalable video decoder according to claim 1 , wherein a default intra prediction parameter is included in the set of intra prediction parameters for the current block if neither the neighboring intra prediction parameter nor the base-layer intra prediction parameter has been selected.

10. The scalable video decoder according to claim 1 , wherein the current intra prediction parameter is determined based on the syntax element present by checking, based on the syntax element, as to whether the current intra prediction parameter is a member of the set of intra prediction parameters, and if so, then indexing one of the set of intra prediction parameters using the syntax element, and if not, then deriving another one of a set of possible intra prediction modes, not member of the set of intra prediction parameters, using the syntax element.

11. The scalable video decoder according to claim 1 ,

wherein a weighting between the inter-layer prediction of the current block and the enhancement layer internal prediction of the current block varies over different spatial frequency components.

12. A scalable video decoding method comprising:

reconstructing a base layer signal from a coded data stream by a block-wise prediction based on a selection between a spatial intra prediction and a temporal inter-prediction mode; and

reconstructing an enhancement layer signal of a video from the coded data stream by the block-wise prediction that includes using a current intra prediction parameter to decode a current block of the enhancement layer signal according to a spatial intra prediction mode, comprising

checking whether a neighboring block of the enhancement layer signal is decoded according to the spatial intra prediction mode, wherein the neighboring block neighbors the current block of the enhancement layer signal;

responsive to checking the neighboring block, inserting a neighboring intra prediction parameter that includes an angular intra prediction parameter of the neighboring block-into a set of intra prediction parameters for the current block;

checking whether a co-located block of the base layer signal is decoded according to the spatial intra prediction mode, wherein the co-located block is co-located in the base layer signal relative to the current block of the enhancement layer signal;

responsive to checking the co-located block, inserting a base-layer intra prediction parameter of the co-located block of the base layer signal into the set of intra prediction parameters for the current block;

determining the current intra prediction parameter for the current block based on a syntax element present in the coded data stream specific to the current block, wherein the syntax element indicates at least one of the set of intra prediction parameters: and

forming a weighted average of an inter-layer prediction of the current block acquired from the reconstructed base layer signal, and an enhancement layer internal prediction of the current block as reconstructed using the current intra prediction parameter to acquire an enhancement layer prediction of the current block.

13. A scalable video encoder comprising:

a block-based encoding unit configured to:

encode, using a processor, a base layer signal of a video into a coded data stream by a block-wise prediction based on a selection between a spatial intra prediction and a temporal inter-prediction mode; and

encode, using a processor, an enhancement layer signal of the video into the coded data stream by the block-wise prediction that includes using a current intra prediction parameter to encode a current block of the enhancement layer signal according to a spatial intra prediction mode, comprising:

check whether a neighboring block of the enhancement layer signal is encoded according to the spatial intra prediction mode, wherein the neighboring block neighbors the current block of the enhancement layer signal;

responsive to checking the neighboring block, insert a neighboring intra prediction parameter that includes an angular intra prediction parameter of the neighboring block-into a set of intra prediction parameters for the current block;

check whether a co-located block of the base layer signal is encoded according to the spatial intra prediction mode, wherein the co-located block is co-located in the base layer signal relative to the current block of the enhancement layer signal;

responsive to checking the co-located block, insert a base-layer intra prediction parameter of the co-located block of the base layer signal into the set of intra prediction parameters for the current block;

determine the current intra prediction parameter for the current block based on a syntax element present in the coded data stream specific to the current block, wherein the syntax element indicates at least one of the set of intra prediction parameters; and

form a weighted average of an inter-layer prediction of the current block acquired from the reconstructed base layer signal, and an enhancement layer internal prediction of the current block as reconstructed using the current intra prediction parameter to acquire an enhancement layer prediction of the current block.

14. A scalable video encoding method comprising:

encoding a base layer signal of a video into a coded data stream by a block-wise prediction based on a selection between a spatial intra prediction and a temporal inter-prediction mode; and

encoding an enhancement layer signal of the video into the coded data stream by the block-wise prediction that includes using a current intra prediction parameter to encode a current block of the enhancement layer signal according to a spatial intra prediction mode, comprising

checking whether a neighboring block of the enhancement layer signal is encoded according to the spatial intra prediction mode, wherein the neighboring block neighbors the current block of the enhancement layer signal;

responsive to checking the neighboring block, inserting a neighboring intra prediction parameter that includes an angular intra prediction parameter of the neighboring block-into a set of intra prediction parameters for the current block;

checking whether a co-located block of the base layer signal is encoded according to the spatial intra prediction mode, wherein the co-located block is co-located in the base layer signal relative to the current block of the enhancement layer signal;

responsive to checking the co-located block, insert a base-layer intra prediction parameter of the co-located block of the base layer signal into the set of intra prediction parameters for the current block;

determining the current intra prediction parameter for the current block based on a syntax element present in the coded data stream specific to the current block, wherein the syntax element indicates at least one of the set of intra prediction parameters; and

forming a weighted average of an inter-layer prediction of the current block acquired from the reconstructed base layer signal, and an enhancement layer internal prediction of the current block as reconstructed using the current intra prediction parameter to acquire an enhancement layer prediction of the current block.

15. A non-transitory computer readable medium including a computer program comprising a program code for performing, when running on a computer, a method according to claim 12 .

16. A non-transitory computer readable medium including a computer program comprising a program code for performing, when running on a computer, a method according to claim 14 .

Assignments (3)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0694 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0113 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2015
From: HINZ, TOBIAS; LAKSHMAN, HARICHARAN; STEGEMANN, JAN; HELLE, PHILIPP; SIEKMANN, MISCHA; SUEHRING, KARSTEN; MARPE, DETLEV; SCHWARZ, HEIKO; BARTNIK, CHRISTIAN; KHAIRAT ABDELHAMID, ALI ATEF IBRAHIM; KIRCHHOFFER, HEINER; WIEGAND, THOMAS
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 035686/0091 →
Continuity (3)
Continuation PCTEP2013070492 · Oct 1, 2013
Provisional Application 61708201 · Oct 1, 2012
Related Publication 20160014416A1 · Jan 14, 2016
Cited By (2)
US 12,200,221 US 12,720,068