Carriage of SEI messages in RTP payload format
View Patent ↗A system and method of modifying error resiliency features by conveying temporal level 0 picture indices, such as t10_pic_idx, within an SEI message instead of optionally including them in the NAL unit header is provided. In addition, a mechanism is provided for enabling repetition of any SEI messages in Real-Time Transport Protocol (RTP) packets. Enabling such repetition of any SEI messages facilitates detection of lost temporal level 0 pictures on the basis of any received packet.
1. A method for packetizing a temporal scalable bitstream representative of an image sequence, the method comprising:
packetizing, by a processor, at least a portion of the image sequence into a first packet, wherein the first packet comprises first information summarizing the contents of the at least a portion of the encoded image sequence, and
providing in the first packet second information indicative of a decoding order of an image within a lowest temporal layer in a temporal layer hierarchy.
2. The method of claim 1 , wherein the second information comprises a temporal level picture index.
3. The method of claim 2 , wherein the temporal level picture index comprises a plurality of network abstraction layer units in a scalable video coding bitstream.
4. The method of claim 2 , wherein, if the image represents an instantaneous decoding refresh picture, the value of the temporal level picture index is equal to one of a zero value and any other value in a predetermined range.
5. The method of claim 2 , wherein, if the image does not represent an instantaneous decoding refresh picture, the value of the temporal level picture index is a function of a modulo-operated value of a temporal level picture index of a previous picture having a temporal level of zero.
6. A computer program product, embodied in a non-transitory computer-readable medium, comprising computer code configured to perform the processes of claim 1 .
7. An apparatus, comprising:
a processor; and
a memory unit communicatively connected to the processor and including:
computer code for packetizing at least a portion of an image sequence into a first packet, wherein the first packet comprises first information summarizing the contents of the at least a portion of the encoded image sequence, and
computer code for providing in the first packet second information indicative of a decoding order of an image within a lowest temporal layer in a temporal layer hierarchy.
8. The apparatus of claim 7 , wherein the second information comprises a temporal level picture index.
9. The apparatus of claim 8 , wherein the temporal level picture index comprises a plurality of network abstraction layer units in a scalable video coding bitstream.
10. The apparatus of claim 8 , wherein, if the image represents an instantaneous decoding refresh picture, the value of the temporal level picture index is equal to one of a zero value and any other value in a predetermined range.
11. The apparatus of claim 8 , wherein, if the image does not represent an instantaneous decoding refresh picture, the value of the temporal level picture index is a function of a modulo-operated value of a temporal level picture index of a previous picture having a temporal level of zero.
12. A method for depacketizing encoded video, comprising:
depacketizing, by a processor, from a first packet at least a portion of an encoded image sequence, wherein the first packet comprises first information summarizing the contents of the at least a portion of the encoded image sequence, and
obtaining from the first packet second information indicative of a decoding order of an image within a lowest temporal layer in a temporal layer hierarchy.
13. The method of claim 12 , wherein the second information comprises a temporal level picture index.
14. The method of claim 13 , wherein the temporal level picture index comprises a plurality of network abstraction layer units in a scalable video coding bitstream.
15. The method of claim 13 , wherein, if the image represents an instantaneous decoding refresh picture, the value of the temporal level picture index is equal to one of a zero value and any other value in a predetermined range.
16. The method of claim 13 , wherein, if the image does not represent an instantaneous decoding refresh picture, the value of the temporal level picture index is a function of a modulo-operated value of a temporal level picture index of a previous picture having a temporal level of zero.
17. A computer program product, embodied in a non-transitory computer-readable medium, comprising computer code configured to perform the processes of claim 12 .
18. An apparatus, comprising:
a processor; and
a memory unit operatively connected to the processor and including:
computer code for depacketizing from a first packet at least a portion of an encoded image sequence, wherein the first packet comprises first information summarizing the contents of the at least a portion of the encoded image sequence, and
computer code for obtaining from the first packet second information indicative of a decoding order of an image within a lowest temporal layer in a temporal layer hierarchy.
19. The apparatus of claim 18 , wherein the second information comprises a temporal level picture index.
20. The apparatus of claim 19 , wherein the temporal level picture index comprises a plurality of network abstraction layer units in a scalable video coding bitstream.
21. The apparatus of claim 19 , wherein, if the image represents an instantaneous decoding refresh picture, the value of the temporal level picture index is equal to one of a zero value and any other value in a predetermined range.
22. The apparatus of claim 19 , wherein, if the coded picture does not represent an instantaneous decoding refresh picture, the value of the temporal level picture index is a function of a modulo-operated value of a temporal level picture index of a previous picture having a temporal level of zero.