Granted Patent B2

US 12,574,557 · App. 18/660,193 · Granted Mar 10, 2026

Inventors: Tobias Hinz (Berlin, DE); Haricharan Lakshman (Berlin, DE); Jan Stegemann (Berlin, DE); Philipp Helle (Berlin, DE); Mischa Siekmann (Berlin, DE); Karsten Suehring (Berlin, DE); Detlev Marpe (Berlin, DE); Heiko Schwarz (Berlin, DE); Christian Bartnik (Berlin, DE); Ali Atef Ibrahim Khairat Abdelhamid (Berlin, DE); Heiner Kirchhoffer (Berlin, DE); Thomas Wiegand (Berlin, DE)

Assignee: DOLBY VIDEO COMPRESSION, LLC

H04N19/70H04N19/105H04N19/107H04N19/117H04N19/119H04N19/136H04N19/137H04N19/157H04N19/159H04N19/176H04N19/18H04N19/187H04N19/198H04N19/30H04N19/33H04N19/48H04N19/503H04N19/587H04N19/59H04N19/593H04N19/61H04N19/615H04N19/82H04N19/865H04N19/11H04N19/34H04N19/36H04N19/463

Abstract

Claims (36)

1 . A scalable video decoder comprising:

a processor; and

a predictive decoder configured to process, using the processor, information from a data stream to reconstruct an enhancement layer signal of a video based on block-wise predictive coding that includes:

gathering, for a current block of a frame of the enhancement layer signal, a set of enhancement layer motion parameter candidates from already reconstructed neighboring blocks of the frame, the already reconstructed neighboring blocks neighboring the current block,

gathering a set of one or more base layer motion parameters of a block of a base layer signal,

enlarging the set of enhancement layer motion parameter candidates with one or more base layer motion parameters of the set of one or more base layer motion parameters or a scaled version thereof to obtain an extended motion parameter candidate set, each of the set of enhancement layer motion parameter candidates and the one or more base layer motion parameters or a scaled version thereof in the extended motion parameter candidate set is a separate element of the extended motion parameter candidate set, wherein the one or more base layer motion parameters are scaled according to a spatial resolution ratio between the base layer signal and the enhancement layer signal to acquire the scaled version of the one or more base layer motion parameters,

extracting, from the data stream, identifying information indicating one of motion parameter candidates of the extended motion parameter candidate set to be selected for the current block,

selecting the one of the motion parameter candidates of the extended motion parameter candidate set based on the identifying information,

generating, by motion compensated prediction, a prediction of the current block of the enhancement layer signal using the selected one of the motion parameter candidates of the extended motion parameter candidate set, and

reconstructing at least a portion of the enhancement layer signal based on the prediction of the current block and a residual signal.

2 . The scalable video decoder according to claim 1 , the gathering, for the current block of the frame of the enhancement layer signal, of the set of enhancement layer motion parameter candidates is performed from temporally or spatially neighboring already reconstructed blocks of the enhancement layer signal by copying or combining motion parameters of the neighboring already reconstructed blocks.

3 . The scalable video decoder according to claim 1 , wherein the block of the base layer signal, collocated to the current block of the frame of the enhancement layer signal, is identified by checking as to which block of a temporally corresponding frame of the base layer signal overlays a position spatially corresponding a predetermined sample position of the block of the frame of the enhancement layer signal.

4 . The scalable video decoder according to claim 1 , wherein the set of one or more base layer motion parameters are checked to determine whether the set of one or more base layer motion parameters are obtained by merging with another block of the base layer signal.

5 . The scalable video decoder according to claim 1 , wherein the identifying information includes a syntax element in the data stream, the syntax element corresponding to the current block.

6 . A scalable video encoder comprising:

a processor; and

an encoder configured to encode into a data stream, using the processor, an enhancement layer signal of a video based on block-wise predictive coding that includes:

gathering, for a current block of a frame of the enhancement layer signal, a set of enhancement layer motion parameter candidates from already reconstructed neighboring blocks of the frame, the already reconstructed neighboring blocks neighboring the current block,

gathering a set of one or more base layer motion parameters of a block of a base layer signal,

enlarging the set of enhancement layer motion parameter candidates with one or more base layer motion parameters of the set of one or more base layer motion parameters or a scaled version thereof to obtain an extended motion parameter candidate set, each of the set of enhancement layer motion parameter candidates and the one or more base layer motion parameters or a scaled version thereof in the extended motion parameter candidate set is a separate element of the extended motion parameter candidate set, wherein the one or more base layer motion parameters are scaled according to a spatial resolution ratio between the base layer signal and the enhancement layer signal to acquire the scaled version of the one or more base layer motion parameters,

selecting one of motion parameter candidates of the extended motion parameter candidate set based on identifying information indicating the one of the motion parameter candidates of the extended motion parameter candidate set to be selected for the current block,

generating, by motion compensated prediction, a prediction of the current block of the enhancement layer signal using the selected one of the motion parameter candidates of the extended motion parameter candidate set, and

obtaining a residual signal for the current block based on a difference of the current block and the prediction of the current block, wherein the residual signal and a syntax element are encoded into the data stream.

7 . The scalable video encoder according to claim 6 , the gathering, for the block of the frame of the enhancement layer signal, of the set of enhancement layer motion parameter candidates is performed from temporally or spatially neighboring already reconstructed blocks of the enhancement layer signal by copying or combining motion parameters of the neighboring already reconstructed blocks.

8 . The scalable video encoder according to claim 6 , wherein the block of the base layer signal, collocated to the block of the frame of the enhancement layer signal, is identified by checking as to which block of a temporally corresponding frame of the base layer signal overlays a position spatially corresponding a predetermined sample position of the block of the frame of the enhancement layer signal.

9 . The scalable video encoder according to claim 6 , wherein the set of one or more base layer motion parameters are checked to determine whether the set of one or more base layer motion parameters are obtained by merging with another block of the base layer signal.

10 . The scalable video encoder according to claim 6 , wherein the identifying information includes a syntax element encoded in the data stream, the syntax element corresponding to the current block.

11 . A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information associated with an array of information samples representing a spatially sampled portion of a video, the encoded information including a residual signal and a syntax element, wherein the data stream is obtained based on a plurality of operations including:

encoding an enhancement layer signal of a video based on block-wise predictive coding that includes:

gathering, for a current block of a frame of the enhancement layer signal, a set of enhancement layer motion parameter candidates from already reconstructed neighboring blocks of the frame, the already reconstructed neighboring blocks neighboring the current block,

gathering a set of one or more base layer motion parameters of a block of a base layer signal,

enlarging the set of enhancement layer motion parameter candidates with one or more base layer motion parameters of the set of one or more base layer motion parameters or a scaled version thereof to obtain an extended motion parameter candidate set, each of the set of enhancement layer motion parameter candidates and the one or more base layer motion parameters or a scaled version thereof in the extended motion parameter candidate set is a separate element of the extended motion parameter candidate set, wherein the one or more base layer motion parameters are scaled according to a spatial resolution ratio between the base layer signal and the enhancement layer signal to acquire the scaled version of the one or more base layer motion parameters,

selecting one of motion parameter candidates of the extended motion parameter candidate set based on identifying information indicating the one of the motion parameter candidates of the extended motion parameter candidate set to be selected for the current block,

generating, by motion compensated prediction, a prediction of the current block of the enhancement layer signal using the selected one of the motion parameter candidates of the extended motion parameter candidate set, and

obtaining the residual signal for the current block based on a difference of the current block and the prediction of the current block, wherein the residual signal and a syntax element are encoded into the data stream.

Assignments (1)

Continuity (5)

References Cited (347)