Scalable data stream and network entity
The handling of scalable data streams by network entities is rendered less complex by, in the data stream, accompanying packets which actually carry data by packets of a different packet type which have a scalability axes descriptor defining the number of scalability axes and a semantic meaning thereof. In another aspect, the handling of scalable data streams by network entities is rendered more efficient by conveying level and/or profile descriptors using packets other than the data carrying packets, with profile and/or level descriptors being divided up into a first set explicitly signaling the definition of the available coding option set and/or available syntax element value range for a respective operation point, and a second set of profile and/or level descriptors which signal the definition of the available coding option set and/or available syntax element value range for their respective operation points by reference another profile and/or level descriptor.
1. An apparatus comprising:
a memory device; and
a processor comprising hardware configured to:
process a data stream including packets having encoded information related to a video, the packets including packets of first and second packet types out of a plurality of packet types, wherein each packet of the first packet type comprises (i) a fixed-bit-length syntax element identifying an operation point out of a plurality of operation points associated with the respective packet, and (ii) data, which when parsed by a decoder, contribute to reconstruction of at least a portion of the video at the operation point associated with the respective packet,
read, from a packet of the second packet type, a scalability descriptor including first information defining a total number n of a plurality of scalability types and second information, which when parsed by the decoder, indicates an association of n portions of the fixed-bit-length syntax element with the n scalability types, respectively,
interpret an operation point identifier for each packet of the first packet type in accordance with the scalability descriptor, and
decode the data of each packet of the first packet type based on the operation point identifier to reconstruct at least a portion of the video.
2. The apparatus of claim 1 , wherein each operation point identifier further comprises a scenario syntax element, wherein the processor is configured to use the scenario syntax element to determine an association of n portions of the fixed-bit-length syntax element with the n scalability types so that the n th portion is an ordinal measure of a position of the respective operation point along the n th scalability type.
3. The apparatus of claim 1 , wherein the processor is configured to render a selection of the packets of the first packet type.
4. The apparatus of claim 1 , wherein the processor is configured to read, from the packet of the second packet type, a sequence of profile or level descriptors individually associated with at least a subset of the plurality of operation points, each profile or level descriptor defining an available coding option set or an available syntax element value range which a syntax of packets having the operation point associated with the respective profile or level descriptor, associated therewith, obey,
wherein the processor is configured to,
responsive to a signaling in the data stream, read from a first set of the profile or level descriptors the definition of the available coding option set or available syntax element value range, and
read, for a second, disjoint non-empty set of the profile or level descriptors, a reference to another, profile or level descriptor and derive the definition of the available coding option set or available syntax element value range of the second, disjoint non-empty set of the profile or level descriptors from the respective referenced profile or level descriptor.
5. The apparatus of claim 4 , wherein each profile or level descriptor comprises a field identifying the operation point the respective profile or level descriptor is associated with.
6. The apparatus of claim 5 , wherein the second, disjoint non-empty set of the profile or level descriptors signal the definition of the available coding option set or available syntax element value range by referencing another profile or level descriptor using an explicit signaling of the field of the referenced profile or level descriptor.
7. The apparatus of claim 4 , wherein the processor is configure to read, from the packets of the second packet type, also, for each of at least a subset of the plurality of operation points, a syntax identifying other operation points of the plurality of operation points, identified by lower operation point identifiers, which the respective operation point is an extension of, thereby indicating the sequential operation point order.
8. The apparatus of claim 7 , wherein each field identifies the respective operation point using a bit-sequence common to the operation point identifiers identifying the respective operation point.
9. The apparatus of claim 8 , wherein each operation point identifier further comprises a scenario syntax element, the scenario syntax element signaling an association of n portions of the fixed-bit-length syntax element with the n scalability types, wherein the bit-sequence is common to the fixed-bit-length syntax element.
10. A method for decoding a video, comprising:
processing a data stream including packets having encoded information related to a video, the packets including packets of first and second packet types out of a plurality of packet types, wherein each packet of the first packet type comprises (i) a fixed-bit-length syntax element identifying an operation point out of a plurality of operation points associated with the respective packet, and (ii) data, which when parsed by a decoder, contribute to reconstruction of at least a portion of the video at the operation point associated with the respective packet;
reading, from a packet of the second packet type, a scalability descriptor including first information defining a total number n of a plurality of scalability types and second information, which when parsed by the decoder, indicates an association of n portions of the fixed-bit-length syntax element with the n scalability types, respectively;
interpreting an operation point identifier for each packet of the first packet type in accordance with the scalability descriptor; and
decoding the data of each packet of the first packet type based on the operation point identifier to reconstruct at least a portion of the video.
11. The method of claim 10 , wherein each operation point identifier further comprises a scenario syntax element, wherein the method comprises using the scenario syntax element to determine an association of n portions of the fixed-bit-length syntax element with the n scalability types so that the n th portion is an ordinal measure of a position of the respective operation point along the n th scalability type.
12. The method of claim 10 , further comprising rendering a selection of the packets of the first packet type.
13. The method of claim 10 , further comprising
reading, from the packet of the second packet type, a sequence of profile or level descriptors individually associated with at least a subset of the plurality of operation points, each profile or level descriptor defining an available coding option set or an available syntax element value range which a syntax of packets having the operation point associated with the respective profile or level descriptor, associated therewith, obey;
responsive to a signaling in the data stream, reading from a first set of the profile or level descriptors the definition of the available coding option set or available syntax element value range; and
reading, for a second, disjoint non-empty set of the profile or level descriptors, a reference to another, profile or level descriptor and derive the definition of the available coding option set or available syntax element value range of the second, disjoint non-empty set of the profile or level descriptors from the respective referenced profile or level descriptor.
14. The method of claim 13 , wherein each profile or level descriptor comprises a field identifying the operation point the respective profile or level descriptor is associated with.
15. The method of claim 14 , wherein the second, disjoint non-empty set of the profile or level descriptors signal the definition of the available coding option set or available syntax element value range by referencing another profile or level descriptor using an explicit signaling of the field of the referenced profile or level descriptor.
16. The method of claim 13 , wherein the processor is configure to read, from the packets of the second packet type, also, for each of at least a subset of the plurality of operation points, a syntax identifying other operation points of the plurality of operation points, identified by lower operation point identifiers, which the respective operation point is an extension of, thereby indicating the sequential operation point order.
17. The method of claim 16 , wherein each field identifies the respective operation point using a bit-sequence common to the operation point identifiers identifying the respective operation point.
18. The method of claim 17 , wherein each operation point identifier further comprises a scenario syntax element, the scenario syntax element signaling an association of n portions of the fixed-bit-length syntax element with the n scalability types, wherein the bit-sequence is common to the fixed-bit-length syntax element.
19. A non-transitory computer-readable medium for storing data associated with a video, comprising:
a data stream stored in the non-transitory computer-readable medium, the data stream including packets having encoded information related to the video, the packets including packets of first and second packet types out of a plurality of packet types, wherein each packet of the first packet type comprises (i) a fixed-bit-length syntax element identifying an operation point out of a plurality of operation points associated with the respective packet, and (ii) data, which when parsed by a decoder, contribute to reconstruction of at least a portion of the video at the operation point associated with the respective packet, and
wherein each packet of the second packet type comprises a scalability descriptor including first information defining a total number n of a plurality of scalability types and second information, which when parsed by the decoder, indicates an association of n portions of the fixed-bit-length syntax element with the n scalability types, respectively.
20. The computer-readable medium of claim 19 , wherein each operation point identifier further comprises a scenario syntax element, the scenario syntax element signaling an association of n portions of the fixed-bit-length syntax element with the n scalability types so that the n th portion is an ordinal measure of a position of the respective operation point along the n th scalability type.
21. The computer-readable medium of claim 19 , wherein the scalability descriptor comprises a syntax element the possible states of which are individually associated with different combinations of values for n and a corresponding semantic meaning of the n scalability types.
22. The computer-readable medium of claim 19 , wherein each packet of the second packet type comprises a sequence of profile or level descriptors associated with one or more of at least a subset of the plurality of operation points, each profile or level descriptor defining an available coding option set or an available syntax element value range which a syntax of packets having an operation point associated with the respective profile or level descriptor, associated therewith, obey,
wherein a first set of the profile or level descriptors explicitly signal the definition of the available coding option set or available syntax element value range, and a second, disjoint non-empty set of the profile or level descriptors signal the definition of the available coding option set or available syntax element value range by referencing another profile or level descriptor.
23. The computer-readable medium of claim 22 , wherein each profile or level descriptor comprises a field identifying the operation point the respective profile or level descriptor is associated with.
24. The computer-readable medium of claim 23 , wherein the second, disjoint non-empty set of the profile or level descriptors signal the definition of the available coding option set or available syntax element value range by referencing another profile or level descriptor using an explicit signaling of the field of the referenced profile or level descriptor.
25. The computer-readable medium of claim 19 , wherein each packet of the second packet type comprises, for each of at least a subset of the plurality of operation points, a syntax identifying other operation points of the plurality of operation points, identified by lower operation point identifiers, which the respective operation point is an extension of, thereby indicating the sequential operation point order.
26. The computer-readable medium of claim 23 , wherein each field identifies the respective operation point using a bit-sequence common to the operation point identifiers identifying the respective operation point.
27. The computer-readable medium of claim 26 , wherein each operation point identifier further comprises a scenario syntax element, the scenario syntax element signaling an association of n portions of the fixed-bit-length syntax element with the n scalability types, wherein the bit-sequence is common to the fixed-bit-length syntax element.
28. An encoder comprising:
a memory device; and
a processor comprising hardware configured to:
encode, into a data stream, packets having information related to a video, the packets including packets of first and second packet types out of a plurality of packet types, wherein each packet of the first packet type comprises (i) a fixed-bit-length syntax element identifying an operation point out of a plurality of operation points associated with the respective packet, and (ii) data, which when parsed by a decoder, contribute to reconstruction of at least a portion of the video at the operation point associated with the respective packet,
wherein each packet of the second packet type comprises a scalability descriptor including first information defining a total number n of a plurality of scalability types and second information indicates an association of n portions of the fixed-bit-length syntax element with the n scalability types, respectively.
29. The encoder of claim 28 , wherein each operation point identifier further comprises a scenario syntax element, wherein the processor is configured to use the scenario syntax element to determine an association of n portions of the fixed-bit-length syntax element with the n scalability types so that the n th portion is an ordinal measure of a position of the respective operation point along the n th scalability type.
30. The encoder of claim 28 , wherein the processor is configured to encoder, into the packet of the second packet type, a sequence of profile or level descriptors individually associated with at least a subset of the plurality of operation points, each profile or level descriptor defining an available coding option set or an available syntax element value range which a syntax of packets having the operation point associated with the respective profile or level descriptor, associated therewith, obey.