CLUSTER-BASED DEPENDENCY SIGNALING
The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with. In accordance with this concept, emphasis may be shifted between increased diversity of the signalizable inter-layer dependencies on the one hand and reduced side-information overhead for signaling the inter-layer dependencies on the other hand.
1 - 20 . (canceled)
21 . A device configured to process a multi-layered data stream into which a video is coded at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, the device configured to:
read, from the multi-layered data stream,
a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and
a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID, and
construct, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers.
22 . The device according to claim 21 , wherein the device is configured to read a plurality of instantiations of the second inter-dependency structure from the multi-layer data stream, namely for different pairs (j,k) of values 0<k≤j≤n<N representable by the base layer-ID, with N being the number of values representable by the base layer-ID, by
reading, or suppressing reading, the second inter-dependency structure from the multi-layer data stream for pair (j,k) conditionally depending on the first inter-dependency syntax structure indicating a presence or non-presence of interdependency between pair (j,k),
wherein the instantiation of the second inter-dependency structure read for a pair (j,k) with j=k, indicates which layers among those comprising base layer-ID j are inter-layer prediction dependent on other layers among those comprising base layer-ID j, and the instantiation of the second inter-dependency structure read for pair (j,k), with k<j indicates which layers among those comprising base layer-ID j are inter-layer prediction dependent on layers among those comprising base layer-ID k.
23 . The device according to claim 21 , wherein the device is configured to:
read one instantiation of the second inter-dependency structure from the multi-layer data stream, the one instantiation of the second inter-dependency structure indicating, with N being the number of values representable by the base layer-ID, either
commonly for each value 0<i≤n<N representable by the base layer-ID, which layers among those comprising base layer-ID i are inter-layer prediction dependent on other layers among those comprising base layer-ID i, or
commonly for each of a set of pairs (j,k) with 0<k<j≤n<N, which layers among those comprising base layer-ID j are inter-layer prediction dependent on layers among those comprising base layer-ID k, respectively.
24 . The device according to claim 21 , wherein the device is configured to
read instantiations of the second inter-dependency structure from the multi-layer data stream, along with, for each instantiation of the second inter-dependency structure, an association syntax structure which associates the respective instantiation of the second inter-dependency structure with a respective subset of pairs (j,k) of values 0<k≤j≤n<N representable by the base layer-ID, with N being the number of values representable by the base layer-ID.
25 . The device according to claim 24 , wherein the association syntax structure comprises a flag for each pair (j,k) and the device is configured to parse the association syntax structure with skipping pairs (j,k) of values 0<k≤j≤n<N for which the first inter-dependency syntax structure indicates the non-presence of interdependency between pair (j,k).
26 . The device according to claim 21 , wherein the number of values representable by the extension layer-ID is M and the second inter-dependency syntax structure comprises
one binary value for each pair (p,q) of extension values 0<q<p≤m<M, in order to indicate which layers among those comprising base layer-ID j are inter-layer prediction dependent on other layers among those comprising base layer-ID j, and
one binary value for each pair (p,q) of extension values 0<p,q≤m<M, in order to indicate which layer with extension value p and comprising base layer-ID j is inter-layer prediction dependent on layer with extension value q and comprising base layer-ID k<j.
27 . The device according to claim 21 , wherein the device is configured to derive n from an explicitly signaling of a maximally assumed value among the N values representable by the base layer-ID, in the data stream, and/or derive m from an explicitly signaling of a maximally assumed value among the M values representable by the extension layer-ID, in the data stream.
28 . The device according to claim 21 , where the first inter-dependency syntax structure defines interdependencies between different sets of layers and the second inter-dependency structure defines interdependencies between layers in dependent sets.
29 . The device according to claim 21 , wherein the multi-layered video signal has the video material coded thereinto at the different layers using inter-layer prediction such that any layer inter-layer predicted from another layer adds one or more of further views;
depth information;
alpha blending information;
color component information;
spatial resolution refinement; and
SNR resolution refinement.
30 . A device configured to process a multi-layered data stream into which a video material is coded at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, the device configured to:
read, from the multi-layered data stream,
a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and
a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID, and
construct, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers.
31 . An encoder configured to encode into a multi-layered data stream a video material at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, configured to:
insert, into the multi-layered data stream,
a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and
a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID,
with setting the first and second inter-dependency syntax structures such that, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers is constructible.
32 . A method for encoding into a multi-layered data stream a video material at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, comprising:
inserting, into the multi-layered data stream,
a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and
a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID,
with setting the first and second inter-dependency syntax structures such that, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers is constructible.
33 . A non-transitory digital storage medium having computer-readable code stored thereon to perform, when said storage medium is run by a computer, a method according to claim 32 .