Real-time processing capability based quality adaptation
The quality of a media stream transmitted to a client device is dynamically adapted based on real-time availability of resources on the client device. Central processing unit resources, memory availability, buffer usage, graphics processing unit usage, etc., are continuously monitored to evaluate the ability of a device to handle media streams of particular quality levels. When it is determined that resources at a client device temporarily can not handle a high quality media stream, a lower quality stream is selected and provided to the client device without having to establish a new session.
1. A method, comprising:
sending a first request to a content server for receiving a media stream at a first quality level;
beginning playback of the media stream at a client device at the first quality level;
dynamically monitoring, by the client device, hardware resource usage at the client device;
determining that the hardware resource usage at the client device is insufficient for allowing playback of the media stream at the first quality level;
sending a signal to the content server to reduce the quality of the media stream from the first quality level to a second quality level;
sending a subsequent signal to the content server to increase the quality of the media stream from the second quality level back to the first quality level after determining that hardware resource usage at the client device has become sufficient for allowing playback of the media stream at the first quality level;
wherein determining that the hardware resource usage at the client device is insufficient for allowing playback of the media stream at the first quality level includes determining whether the hardware resource usage at the client device exceeds a threshold, wherein resource usage at the client device exceeds the threshold when decoder frame drops at the client device exceeds a decoder frame drop threshold.
2. The method of claim 1 , wherein hardware resource usage exceeds the threshold when processor usage at the client device exceeds a processor usage threshold.
3. The method of claim 1 , wherein hardware resource usage at the client device exceeds the threshold when memory at the client device exceeds a memory usage threshold.
4. The method of claim 1 , wherein the client device communicates with the content server via HTTP protocol.
5. The method of claim 1 , wherein the media stream is a fragmented MPEG-4 media stream.
6. The method of claim 1 , wherein the first quality level of the media stream is requested based on known characteristics of the client device.
7. The method of claim 1 , wherein the first quality level of the media stream is requested based on a subscription level.
8. The method of claim 1 , wherein the client device also receives the media stream at a third quality level from the content server in a same session as receiving the media stream at the first quality level.
9. A system, comprising:
a processor; and
memory, wherein the memory stores instructions for:
sending a first request to a content server for receiving a media stream at a first quality level;
beginning playback of the media stream at a client device at the first quality level;
dynamically monitoring, by the client device, hardware resource usage at the client device;
determining that the hardware resource usage at the client device is insufficient for allowing playback of the media stream at the first quality level;
sending a signal to the content server to reduce the quality of the media stream from the first quality level to a second quality level;
sending a subsequent signal to the content server to increase the quality of the media stream from the second quality level back to the first quality level after determining that hardware resource usage at the client device has become sufficient for allowing playback of the media stream at the first quality level;
wherein determining that the hardware resource usage at the client device is insufficient for allowing playback of the media stream at the first quality level includes determining whether the hardware resource usage at the client device exceeds a threshold, wherein resource usage at the client device exceeds the threshold when decoder frame drops at the client device exceeds a decoder frame drop threshold.
10. The system of claim 9 , wherein hardware resource usage exceeds the threshold when processor usage at the client device exceeds a processor usage threshold.
11. The system of claim 9 , wherein hardware resource usage at the client device exceeds the threshold when memory at the client device exceeds a memory usage threshold.
12. The system of claim 9 , wherein the client device communicates with the content server via HTTP protocol.
13. The system of claim 9 , wherein the media stream is a fragmented MPEG-4 media stream.
14. The system of claim 9 , wherein the first quality level of the media stream is requested based on known characteristics of the client device.
15. The system of claim 9 , wherein the first quality level of the media stream is requested based on a subscription level.
16. The system of claim 9 , wherein the client device also receives the media stream at a third quality level from the content server in a same session as receiving the media stream at the first quality level.