Advanced trick-play modes for streaming video
Enhanced trick-play modes for video content that is being streamed to a client from a server are described. In an embodiment, the enhanced trick-play modes are provided with relatively low latency and high quality using trick-play optimization techniques for a streaming environment, avoiding the need to stream the entire contents of the portions through which the viewer is fast forwarding. By employing sophisticated selection criteria of which parts of the content to download at what time, the quality of the playback experience is improved versus that which would conventionally be possible when using a simple sequential frame data download. The streaming client maintains a cache of nearby significant frames, such as nearby key frames, in forward and/or reverse directions of the current playback position, without having to download the entire portions of the video stream in which the significant frames reside. The trick-play modes utilize these frames.
1. A method comprising:
playing a video content item in a trick-play mode using a normal buffer window maintained within a buffer having a boundary of continuous video content;
generating a trick-play window that extends the boundary of the normal buffer window to incorporate the trick-play window, wherein the trick-play window is created in response to determining that a moving playback position in the normal buffer window will move outside of the normal buffer window during the trick-play mode;
populating the generated trick-play window with a subset of sampled frames from a low-bandwidth video stream;
determining that the normal buffer window in the trick-play mode is filling up faster than a predetermined pace; and
in response to determining that the normal buffer window in the trick-play mode is filling up faster than the predetermined pace:
switching from the low-bandwidth video stream to a high-bandwidth video stream; and
populating the generated trick-play window with a subset of sampled frames from the high-bandwidth video stream.
2. The method of claim 1 , further comprising:
determining a context of the video content being played;
determining a level of sampling granularity based on the determined context; and
using the determined sampling granularity to select the subset of sampled frames from a low-bandwidth video stream.
3. The method of claim 2 , wherein the sampling granularity relates to sampling every key frame, every other key frame, or a particular number of key frames per second.
4. The method of claim 1 , further comprising using adaptive streaming logic to switch from the low-bandwidth video stream to the high-bandwidth video stream.
5. The method of claim 1 , wherein switching from the low-bandwidth video stream to the high-bandwidth video stream further comprises:
accessing a plurality of available streams that are associated with the video content;
analyzing the plurality of available streams based on a) frames displayed per second and b) quality of those frames; and
selecting the high-bandwidth video stream, from the plurality of available streams, based on a trade-off between the frames displayed per second and the quality of those frames.
6. The method of claim 5 , wherein the trade-off is based on a type of the video content being played in the trick-play mode.
7. The method of claim 1 , wherein the predetermined pace is determined based on speed of a trick-play operation associated with the trick-play mode.
8. The method of claim 1 , wherein the trick-play mode is associated with a fast-forward operation.
9. The method of claim 1 , further comprising:
requesting frames outside of the normal buffer window for buffering; and
selecting the subset of sampled frames from the requested frames for buffering in the trick-play window.
10. The method of claim 9 , wherein the request for frames outside of the normal buffer window is made prior to extending the boundary of the normal buffer window to incorporate the trick-play window.
11. A system comprising:
a user input interface for receiving a request to execute a trick-play mode;
memory configured to store a buffered video content item; and
control circuitry configured to:
play a video content item in a trick-play mode using a normal buffer window maintained within a buffer having a boundary of continuous video content;
generate a trick-play window that extends the boundary of the normal buffer window to incorporate the trick-play window, wherein the trick-play window is created in response to determining that a moving playback position in the normal buffer window will move outside of the normal buffer window during the trick-play mode;
populate the generated trick-play window with a subset of sampled frames from a low-bandwidth video stream;
determine that the normal buffer window in the trick-play mode is filling up faster than a predetermined pace; and
in response to determining that the normal buffer window in the trick-play mode is filling up faster than the predetermined pace:
switch from the low-bandwidth video stream to a high-bandwidth video stream; and
populate the generated trick-play window with a subset of sampled frames from the high-bandwidth video stream.
12. The system of claim 11 , further comprising, the control circuitry configured to:
determine a context of the video content being played;
determine a level of sampling granularity based on the determined context; and
use the determined sampling granularity to select the subset of sampled frames from a low-bandwidth video stream.
13. The system of claim 12 , wherein the sampling granularity relates to sampling every key frame, every other key frame, or a particular number of key frames per second.
14. The system of claim 11 , further comprising the control circuitry configured to use adaptive streaming logic to switch from the low-bandwidth video stream to the high-bandwidth video stream.
15. The system of claim 11 , wherein switching from the low-bandwidth video stream to the high-bandwidth video stream further comprises, the control circuitry configured to:
access a plurality of available streams that are associated with the video content;
analyze the plurality of available streams based on a) frames displayed per second and b) quality of those frames; and
select the high-bandwidth video stream, from the plurality of available streams, based on a trade-off between the frames displayed per second and the quality of those frames.
16. The system of claim 15 , wherein the trade-off is based on a type of the video content being played in the trick-play mode.
17. The system of claim 11 , wherein the predetermined pace is determined by the control circuitry based on speed of a trick-play operation associated with the trick-play mode.
18. The system of claim 11 , wherein the trick-play mode is associated with a fast-forward operation.
19. The system of claim 11 , further comprising, the control circuitry configured to:
request frames outside of the normal buffer window for buffering; and
select the subset of sampled frames from the requested frames for buffering in the trick-play window.
20. The system of claim 19 , wherein the request for frames outside of the normal buffer window is made by the control circuitry prior to extending the boundary of the normal buffer window to incorporate the trick-play window.