Adaptive management of a media buffer
Embodiments disclosed herein provide systems, methods, and computer readable media that perform adaptive management of a media buffer. In a particular embodiment, a method provides receiving packets representing a media stream into the adaptive media buffer, wherein the media stream comprises a sequence of media segments structured into segment layers, and detecting loss of one or more of the packets representing one of the media segments. The method further provides estimating a round trip delay for packets between the adaptive media buffer and a sender of the media stream and determining a current depth of the media segments within the adaptive media buffer. In response to detecting the packet loss, the method provides discarding media segments within the adaptive media buffer based on the round trip delay, the current depth, and a layer of the segment layers into which each of the one or more media segments is included.
1. A method of managing an adaptive media buffer, comprising:
receiving a plurality of packets representing a media stream into the adaptive media buffer of a receiver system configured to present the media stream, wherein the media stream comprises a sequence of media segments structured into a plurality of segment layers, wherein the plurality of segment layers comprise a hierarchy for the sequence of media segments such that higher media segments in the hierarchy include data representative of differences from respective lower media segments in the hierarchy;
detecting loss of one or more packets of the plurality of packets, wherein the one or more packets represent a media segment of the plurality of media segments;
estimating a round trip delay for packets between the adaptive media buffer and a sender of the media stream;
determining a current depth of the media segments within the adaptive media buffer, wherein the current depth comprises an indication of a number of media segments within the adaptive media buffer that can be passed to a decoder of the receiver system before the media segment represented by the one or more packets is reached; and
in response to detecting the loss of the one or more packets, discarding one or more media segments of the media segments within the adaptive media buffer based on the round trip delay, the current depth, and a layer of the plurality of segment layers into which each of the one or more media segments is included.
2. The method of claim 1 , further comprising:
in response to detecting the loss of the one or more packets, determining whether to request retransmission of the one or more packets based on the round trip delay and the current depth.
3. The method of claim 2 , further comprising:
upon determining to request retransmission, requesting the one or more packets from the sender and holding frames starting with the media segment until the one or more packets are received from the sender; and
upon determining not to request retransmission, discarding the media segment and other media segments that refer to the media segment from the adaptive media buffer.
4. The method of claim 3 , further comprising:
upon receiving the one or more packets from the sender, passing the media segment to the decoder and passing remaining media segments to the decoder at a rate that speeds up presentation of the media stream until buffer delay returns to a threshold delay value.
5. The method of claim 1 , wherein the plurality of segment layers include a base layer, which is lowest in the hierarchy, and a plurality of enhanced layers, which are at successive higher layers in the hierarchy, that each refer either to a media segment of the base layer or to a media segment of a lower enhanced layer of the plurality of enhanced layers.
6. The method of claim 5 , wherein a media segment included in a higher level enhanced layer is more likely to be discarded than a media segment in either a lower level enhanced layer or a base layer.
7. The method of claim 1 , wherein discarding the one or more media segments is further based on content priority indicators associated with the media segments.
8. The method of claim 1 , wherein estimating the round trip delay comprises:
measuring a depth of the media segments within the buffer during one or more packet retransmission events; and
determining the round trip delay based on the depths of the media segments within the buffer during the one or more packet retransmission events.
9. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor system of a receiver system configured to present a media stream, direct the processor system to perform a method of managing an adaptive media buffer, the method comprising:
receiving a plurality of packets representing the media stream into the adaptive media buffer of the receiver system, wherein the media stream comprises a sequence of media segments structured into a plurality of segment layers, wherein the plurality of segment layers comprise a hierarchy for the sequence of media segments such that higher media segments in the hierarchy include data representative of differences from respective lower media segments in the hierarchy;
detecting loss of one or more packets of the plurality of packets, wherein the one or more packets represent a media segment of the plurality of media segments;
estimating a round trip delay for packets between the adaptive media buffer and a sender of the media stream;
determining a current depth of the media segments within the adaptive media buffer, wherein the current depth comprises an indication of a number of media segments within the adaptive media buffer that can be passed to a decoder of the receiver system before the media segment represented by the one or more packets is reached; and
in response to detecting the loss of the one or more packets, discarding one or more media segments of the media segments within the adaptive media buffer based on the round trip delay, the current depth, and a layer of the plurality of segment layers into which each of the one or more media segments is included.
10. The non-transitory computer readable medium of claim 9 , wherein the method further comprises:
in response to detecting the loss of the one or more packets, determining whether to request retransmission of the one or more packets based on the round trip delay and the current depth.
11. The non-transitory computer readable medium of claim 10 , wherein the method further comprises:
upon determining to request retransmission, requesting the one or more packets from the sender and holding frames starting with the media segment until the one or more packets are received from the sender; and
upon determining not to request retransmission, discarding the media segment and other media segments that refer to the media segment from the adaptive media buffer.
12. The non-transitory computer readable medium of claim 11 , wherein the method further comprises:
upon receiving the one or more packets from the sender, passing the media segment to the decoder and passing remaining media segments to the decoder at a rate that speeds up presentation of the media stream until buffer delay returns to a threshold delay value.
13. The non-transitory computer readable medium of claim 9 , wherein the plurality of segment layers include a base layer, which is lowest in the hierarchy, and a plurality of enhanced layers, which are at successive higher layers in the hierarchy, that each refer either to a media segment of the base layer or to a media segment of a lower enhanced layer of the plurality of enhanced layers.
14. The non-transitory computer readable medium of claim 13 , wherein a media segment included in a higher level enhanced layer is more likely to be discarded than a media segment in either a lower level enhanced layer or a base layer.
15. The non-transitory computer readable medium of claim 9 , wherein discarding the one or more media segments is further based on content priority indicators associated with the media segments.
16. The non-transitory computer readable medium of claim 9 , wherein estimating the round trip delay comprises:
measuring a depth of the media segments within the buffer during one or more packet retransmission events; and
determining the round trip delay based on the depths of the media segments within the buffer during the one or more packet retransmission events.
17. An adaptive media buffer management system, comprising:
a communication interface configured to receive a plurality of packets representing a media stream into an adaptive media buffer of a receiver system configured to present the media stream, wherein the media stream comprises a sequence of media segments structured into a plurality of segment layers, wherein the plurality of segment layers comprise a hierarchy for the sequence of media segments such that higher media segments in the hierarchy include data representative of differences from respective lower media segments in the hierarchy;
a processing system configured to detect loss of one or more packets of the plurality of packets, wherein the one or more packets represent a media segment of the plurality of media segments, estimate a round trip delay for packets between the adaptive media buffer and a sender of the media stream, determine a current depth of the media segments within the adaptive media buffer, wherein the current depth comprises an indication of a number of media segments within the adaptive media buffer that can be passed to a decoder of the receiver system before the media segment represented by the one or more packets is reached, and, in response to detecting the loss of the one or more packets, discarding one or more media segments of the media segments within the adaptive media buffer based on the round trip delay, the current depth, and a layer of the plurality of segment layers into which each of the one or more media segments is included; and
a memory system configured to store the adaptive media buffer.
18. The adaptive media buffer management system of claim 17 , further comprising:
the processing system configured to, in response to detecting the loss of the one or more packets, determine whether to request retransmission of the one or more packets based on the round trip delay and the current depth.
19. The adaptive media buffer management system of claim 18 , further comprising:
the processing system configured to, upon determining to request retransmission, request the one or more packets from the sender and holding frames starting with the media segment until the one or more packets are received from the sender, and, upon determining not to request retransmission, discarding the media segment and other media segments that refer to the media segment from the adaptive media buffer.
20. The adaptive media buffer management system of claim 17 , wherein the plurality of segment layers include a base layer, which is lowest in the hierarchy, and a plurality of enhanced layers, which are at successive higher layers in the hierarchy, that each refer either to a media segment of the base layer or to a media segment of a lower enhanced layer of the plurality of enhanced layers.