Video data stream concept
Decoder retrieval timing information, ROI information and tile identification information are conveyed within a video data stream at a level which allows for an easy access by network entities such as MANEs or decoder. In order to reach such a level, information of such types are conveyed within a video data stream by way of packets interspersed into packets of access units of a video data stream. In accordance with an embodiment, the interspersed packets are of a removable packet type, i.e. the removal of these interspersed packets maintains the decoder's ability to completely recover the video content conveyed via the video data stream.
1. An apparatus for decoding a data stream to reconstruct video content, comprising:
a buffer; and
a decoder configured for
extracting, from the data stream, a sequence of packets organized into a plurality of access units related to the video content, wherein each access unit includes one or more decoding units and each of the one or more decoding units includes at least one payload packet, and subsets of the sequence of packets are arranged in slices,
identifying, in each of the plurality of access units, a timing control packet corresponding to the one or more decoding units, wherein the timing control packet is indicative of a decoder buffer retrieval time by which content of the corresponding decoding unit is to be retrieved from the buffer,
retrieving, from the buffer, the content including the at least one payload packet of each decoding unit in accordance with a decoder buffer retrieval time associated with the decoding unit, wherein each packet of the sequence of packets includes a packet type field in a packet header of the respective packet, the packet type field for the at least one payload packet being different than the packet type field for the timing control packet, and
decoding the one or more decoding units using predictive decoding to reconstruct the video content.
2. The apparatus of claim 1 , wherein the at least one payload packet is of a non-removable packet type and each of the one or more timing control packets is of a removable packet type.
3. The apparatus of claim 1 , wherein:
the sequence of packets includes Supplemental Enhancement Information (SEI) packets of different types;
each of the SEI packets includes an SEI packet type field; and
content of an SEI packet type field of a timing control packet differs from that of a different type of SEI packet.
4. The apparatus of claim 3 , wherein the different type of SEI packet includes a Region of Interest (ROI) packet.
5. The apparatus of claim 1 , wherein the at least one payload packet includes encoded information of a sub-portion of a picture of the video content.
6. The apparatus of claim 1 , wherein:
different types of packets in the sequence of packets are arranged in accordance with a pre-determined organization; and
an organization of the packets in the sequence of packets can be determined in accordance with the pre-determined organization when one or more removable packets are removed from the sequence of packets.
7. An apparatus for encoding video content into a data stream, comprising:
a buffer; and
an encoder configured for, based on the video content,
encoding video content into a sequence of packets organized into a plurality of access units related to the video content, wherein each of the plurality of access units includes one or more decoding units and each of the one or more decoding units includes at least one payload packet, and subsets of the sequence of packets are arranged in slices, and
interspersing, in each of the plurality of access units, a timing control packet corresponding to the one or more decoding units, respectively, wherein the timing control packet is indicative of a decoder buffer retrieval time by which content including the at least one payload packet of the corresponding decoding unit is to be retrieved from the buffer,
wherein each packet of the sequence of packets includes a packet type field in a packet header of the respective packet, the packet type field for the at least one payload packet being different than the packet type field for the timing control packet.
8. The apparatus of claim 7 , wherein the at least one payload packet is of a non-removable packet type and each of the one or more timing control packets is of a removable packet type.
9. The apparatus of claim 7 , wherein:
the sequence of packets includes Supplemental Enhancement Information (SEI) packets of different types;
each of the SEI packets includes an SEI packet type field; and
content of an SEI packet type field of a timing control packet differs from that of a different type of SEI packet.
10. The apparatus of claim 9 , wherein the different type of SEI packet includes a Region of Interest (ROI) packet.
11. The apparatus of claim 7 , wherein the at least one payload packet includes encoded information of a sub-portion of a picture of the video content.
12. The apparatus of claim 7 , wherein:
different types of packets in the sequence of packets are arranged in accordance with a pre-determined organization; and
an organization of the packets in the sequence of packets can be determined in accordance with the pre-determined organization when one or more removable packets are removed from the sequence of packets.
13. A machine readable non-transitory medium for storing data associated with video content, comprising:
a data stream stored in the non-transitory machine readable medium, the data stream comprising a sequence of packets, wherein
subsets of the sequence of packets are arranged in slices,
the sequence of packets is organized into a plurality of access units related to the video content,
each of the plurality of access units includes one or more decoding units,
each of the one or more decoding units includes at least one payload packet,
each of the plurality of access units has a timing control packet corresponding to the one or more decoding units, the timing control packet is indicative of a decoder buffer retrieval time by which content including the at least one payload packet of the corresponding decoding unit is to be retrieved from a buffer, and
each packet of the sequence of packets includes a packet type field in a packet header of the respective packet, the packet type field for the at least one payload packet being different than the packet type field for the timing control packet.
14. The machine readable non-transitory medium of claim 13 , wherein the at least one payload packet is of a non-removable packet type.
15. The machine readable non-transitory medium of claim 13 , wherein:
the sequence of packets includes Supplemental Enhancement Information (SEI) packets of different types;
each of the SEI packets includes an SEI packet type field; and
content of an SEI packet type field of a timing control packet differs from that of a different type of SEI packet.
16. The machine readable non-transitory medium of claim 15 , wherein the different type of SEI packet includes a Region of Interest (ROI) packet.
17. The machine readable non-transitory medium of claim 13 , wherein the at least one payload packet includes encoded information of a sub-portion of a picture of the video content.
18. The machine readable non-transitory medium of claim 13 , wherein different types of packets in the sequence of packets are arranged in accordance with a pre-determined organization.
19. The machine readable non-transitory medium of claim 13 , wherein each of the one or more timing control packets is of a removable packet type.