Adaptive media streaming method and apparatus according to decoding performance
A method and apparatus for streaming media without installing a plug-in in a web browser are provided. When a JavaScript decoder is used to stream media without installing a plug-in, it is difficult to support decoding of high framerate and high resolution video due to the limitations of JavaScript. When streaming media using a video element of HTML5 without installing a plug-in, a compatibility issue with a conventional video capturing apparatus using RTSP/RTP and an initial delay problem due to a container of MPEG-DASH are inherent. The present disclosure presents an adaptive media streaming method and apparatus capable of performing streaming of high framerate and high resolution video without an initial delay and compatibility issues by addressing these drawbacks.
1 . An adaptive media streaming apparatus comprising:
a receiver;
a video web worker;
a first video player;
a second video player;
the receiver receiving media data generated by a media service apparatus using a communication protocol which supports web services;
the video web worker configured to determine that a video codec used to encode video data in the media data is supported by a first video decoder and configured to determine that a decoding delay over a delay threshold has occurred in the first video player;
the first video player configured to decode a portion of the video data transmitted from the video web worker using a second video decoder; and
the second video player configured to decode another portion of the video data using the first video decoder upon determination that the video codec is supported by the first video decoder and upon determination that the decoding delay over the delay threshold has occurred, wherein
the first video decoder is embedded in a web browser of the adaptive media streaming apparatus that allows the adaptive media streaming apparatus to play the media data without installing a plug-in, and
the second video decoder is written in a script which is supported by the web browser that allows the adaptive media streaming apparatus to play the media data without installing a plug-in.
2 . The adaptive media streaming apparatus of claim 1 , wherein a decoding time measurer measures a frame rate of the video data being decoded by the first video player using a frames per second (FPS) meter to determine that the decoding delay of the first video player is over the delay threshold.
3 . The adaptive media streaming apparatus of claim 1 , further comprising:
an audio web worker determining that an audio codec of audio data included in the media data is supported by a first audio decoder embedded in the web browser;
a first audio player, in response to the audio codec of the audio data being unsupported by the first audio decoder embedded in the web browser, decoding the audio data transmitted from the audio web worker using a second audio decoder written in the script; and
a second audio player, in response to the audio codec of the audio data being supported by the first audio decoder embedded in the web browser, decoding the audio data transmitted from the audio web worker using the first audio decoder embedded in the web browser.
4 . The adaptive media streaming apparatus of claim 1 , wherein the script is JavaScript.
5 . The adaptive media streaming apparatus of claim 3 , wherein the first video decoder and the first audio decoder are a video tag and an audio tag, respectively, according to a HTML5 standard.
6 . The adaptive media streaming apparatus of claim 3 , wherein the video web worker is further configured to transmit the video data to the first video player or the second video player according to the video codec used to encode the video data and whether the decoding delay over the delay threshold has occurred, and
wherein the audio web worker is further configured to transmit the audio data to the first audio player or the second audio player according to the audio codec of the audio data.
7 . An adaptive media streaming apparatus comprising:
a receiver;
a video web worker;
a first video player;
a second video player;
the receiver receiving media data generated by a media service apparatus using a communication protocol which supports web services;
the video web worker configured to determine that a video codec used to encode video data in the media data is supported by a first video decoder and configured to determine that a decoding delay over a delay threshold has occurred in the first video player;
the first video player configured to decode a portion of the video data transmitted from the video web worker using a second video decoder; and
the second video player configured to decode another portion of the video data using the first video decoder upon determination that the video codec is supported by the first video decoder and upon determination that the decoding delay over the delay threshold has occurred, wherein
the first video decoder is embedded in a web browser of the adaptive media streaming apparatus, and
the second video decoder is written in a script which is supported by the web browser.
8 . The adaptive media streaming apparatus of claim 7 , wherein a decoding time measurer measures a frame rate of the video data being decoded by the first video player using a frames per second (FPS) meter to determine that the decoding delay of the first video player is over the delay threshold.
9 . The adaptive media streaming apparatus of claim 7 , wherein the video web worker is configured to adjust, through machine learning, a threshold value used for determining the decoding time received from a decoding time measurer.
10 . The adaptive media streaming apparatus of claim 7 , further comprising:
an audio web worker determining that an audio codec of audio data included in the media data is supported by a first audio decoder embedded in the web browser;
a first audio player, in response to the audio codec of the audio data being unsupported by the first audio decoder embedded in the web browser, decoding the audio data transmitted from the audio web worker using a second audio decoder written in the script; and
a second audio player, in response to the audio codec of the audio data being supported by the first audio decoder embedded in the web browser, decoding the audio data transmitted from the audio web worker using the first audio decoder embedded in the web browser.
11 . The adaptive media streaming apparatus of claim 7 , wherein the script is JavaScript.
12 . The adaptive media streaming apparatus of claim 10 , wherein the first video decoder and the first audio decoder are a video tag and an audio tag, respectively, according to a HTML5 standard.
13 . The adaptive media streaming apparatus of claim 10 , wherein the video web worker is further configured to transmit the video data to the first video player or the second video player according to the video codec used to encode the video data and whether the decoding delay over the delay threshold has occurred, and
wherein the audio web worker is further configured to transmit the audio data to the first audio player or the second audio player according to the audio codec of the audio data.