Backward-compatible characterization of aggregated media data units
View Patent ↗A system and method for conveying information that is helpful for a network middlebox or a media player to decided which coded data units to forward or process within an RTP payload or a file format data unit in an easy-to-access manner. This mechanism can be used to provide indications of items such as redundant coded pictures, temporal level switching points, gradual decoding refresh access points, view identifiers, and view random access points. A middlebox and/or receiver can then use this information to determine whether certain coded data units need to be processed and/or transmitted.
1. A method, comprising:
packetizing a plurality of data units into a Real-Time Transport Protocol (RTP) packet for real-time transport of a video sequence,
wherein a first data unit of the plurality of data units comprises at least a portion of an encoded bitstream, wherein a second data unit of the plurality of data units comprises information summarizing the contents of the portion of the encoded bitstream, and wherein the second data unit is placed before any of the other data units of the plurality of data units in the RTP packet;
providing, in the second data unit, an indication indicative of a characteristic of the encoded bitstream representative of a the video sequence, wherein the indication comprises at least one of:
an indication of redundant coded pictures within the plurality of data units;
an indication of temporal level switching points within the plurality of data units;
an indication of gradual decoding access points within the plurality of data units;
an indication of views to which the plurality of data units belong; or
an indication of view random access pictures within the plurality of data units; and
transmitting the plurality of data units, including the first data unit and the second data unit, in accordance with the Real-Time Transport Protocol.
2. The method of claim 1 , further comprising providing, in the second data unit, an indication indicative of a characteristic that is common to all of the plurality of data units.
3. A computer program product, embodied in a non-transitory computer-readable medium, comprising computer code for performing the processes of claim 1 .
4. An apparatus, comprising:
a processor; and
a memory unit communicatively connected to the processor and including
computer code for packetizing a plurality of data units into a Real-Time Transport Protocol (RTP) packet for real-time transport of the video sequence,
wherein a first data unit of the plurality of data units comprises at least a portion of an encoded bitstream, wherein a second data unit of the plurality of data units comprises information summarizing the contents of the portion of the encoded bitstream, and wherein the second data unit is placed before any of the other data units of the plurality of data units in the RTP packet; and
computer code for providing, in the second data unit, an indication indicative of a characteristic of the encoded bitstream representative of the video sequence, wherein the indication comprises at least one of:
an indication of redundant coded pictures within the plurality of data units;
an indication of temporal level switching points within the plurality of data units;
an indication of gradual decoding access points within the plurality of data units;
an indication of views to which the plurality of data units belong; or
an indication of view random access pictures within the plurality of data units; and
computer code for transmitting the plurality of data units, including the first data unit and the second data unit, in accordance with the Real-Time Transport Protocol.
5. The apparatus of claim 4 , wherein the memory unit further comprises computer code for providing, in the second data unit, an indication indicative of a characteristic that is common to all of the plurality of data units.
6. A method comprising:
reading a plurality of data units from a Real-Time Transport Protocol (RTP) packet received in real-time transport of a video sequence, wherein a first data unit of the plurality of data units comprises at least a portion of an encoded bitstream, wherein a second data unit of the plurality of data units comprises information summarizing the contents of the portion of the encoded bitstream, and wherein the second data unit is located before any of the other data units of the plurality of data units in the RTP packet;
retrieving, from the second data unit, an indication indicative of a characteristic of the encoded bitstream representative of the video sequence, wherein the indication comprises at least one of:
an indication of redundant coded pictures within the plurality of data units;
an indication of temporal level switching points within the plurality of data units;
an indication of gradual decoding access points within the plurality of data units;
an indication of views to which the plurality of data units belong; or
an indication of view random access pictures within the plurality of data units; and
processing the plurality of data units, including the first data unit and the second data unit, based upon information contained within the second data unit.
7. The method of claim 6 , wherein the second data unit includes an indication indicative of a characteristic that is common to all of the plurality of data units.
8. A computer program product, embodied in a non-transitory computer-readable medium, comprising computer code for performing the processes of claim 6 .
9. An apparatus, comprising:
a processor; and
a memory unit communicatively connected to a processor and including:
computer code for reading a plurality of data units from a Real-Time Transport Protocol (RTP) packet received in real-time transport of the video sequence, wherein a first data unit of the plurality of data units comprises at least a portion of an encoded bitstream, wherein a second data unit of the plurality of data units comprises information summarizing the contents of the portion of the encoded bitstream, and wherein the second data unit is located before any of the other data units of the plurality of data units in the RTP packet;
computer code for retrieving, from the second data unit, an indication indicative of a characteristic of the encoded bitstream representative of the video sequence, wherein the indication comprises at least one of:
an indication of redundant coded pictures within the plurality of data units;
an indication of temporal level switching points within the plurality of data units;
an indication of gradual decoding access points within the plurality of data units;
an indication of views to which the plurality of data units belong; or
an indication of view random access pictures within the plurality of data units; and
computer code for processing the plurality of data units, including the first data unit and the second data unit, based upon information contained within the second data unit.
10. The apparatus of claim 9 , wherein the second data unit includes an indication indicative of a characteristic that is common to all of the plurality of data units.