IP Library › Granted Patent US 12,250,404

Granted Patent B2

US 12,250,404 · App. 18/807,838 · Granted Mar 11, 2025

Systems and methods for performing adaptive bitrate streaming

Inventors: Jason Braness (San Diego, CA); Auke Sjoerd van der Schaar (Los Angeles, CA); Kourosh Soroushian (San Diego, CA)

Assignee: DIVX, LLC

H04N19/593 G11B27/005 G11B27/11 G11B27/322 H04L65/612 H04L65/613 H04L65/70 H04N19/172 H04N19/177 H04N19/40 H04N21/234345 H04N21/23439 H04N21/2387 H04N21/26258 H04N21/2662 H04N21/42607 H04N21/435 H04N21/44004 H04N21/44008 H04N21/44209 H04N21/6587 H04N21/8455 H04N21/8456 H04N21/8543 H04N21/85406

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12,250,404
App. No.: 18/807,838
Granted: Mar 11, 2025
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Systems and methods for performing trick play functionality using trick play streams during adaptive bitrate streaming in accordance with embodiments of the invention are disclosed. One embodiment includes requesting a video container index from a video container file containing a video stream from a plurality of alternative streams of video; requesting at least one portion of the video stream using at least one entry from the video container index; decoding the at least one portion of the video stream; receiving at least one user instruction to perform a visual search of the media; requesting a trick play container index from a trick play container file containing a trick play stream; requesting at least one frame of video from the at least one trick play stream; and decoding and displaying the at least one frame of video from the trick play stream.

Claims (114)

1. A method of performing adaptive bitrate streaming using a playback device that selects between different streams of encoded media during playback according to streaming conditions experienced by the playback device, the method comprising:

obtaining, using a playback device via a network, a top level index file for a piece of media content that includes an audio sequence and a video sequence, where the top level index file identifies:

alternative streams of encoded video that are available to the playback device, where:

each of the alternative streams of encoded video is an encoding of the video sequence;

each of the alternative streams of encoded video is encoded as a plurality of portions of encoded video; and

the alternative streams of encoded video are encoded at different bitrates; at least one stream of encoded audio, where:

each of the at least one stream of encoded audio is an encoding of the audio sequence; and

each of the at least one stream of encoded audio is encoded as a plurality of portions of encoded video; and

separate index files that contain information concerning the locations of container files that contain the identified alternative streams of encoded video and the identified at least one stream of encoded audio;

selecting, using the playback device, a first stream of encoded video to utilize to commence playback from the alternative streams of encoded video identified in the top level index file;

obtaining, using a playback device via the network, a first index file from the separate index files identified in the top level index file, where the first index file is an index file for the first stream of encoded video and contains information concerning the location of at least one container file that contains the first stream of encoded video;

obtaining, using the playback device via the network utilizing information from the first index file, a header for the first stream of encoded video;

configuring a video decoder within the playback device using information contained within the header for the first stream of encoded video;

selecting, using the playback device, a first stream of encoded audio to utilize to commence playback from the at least one stream of encoded audio identified in the top level index file;

obtaining, using a playback device via the network, an audio index file from the separate index files identified in the top level index file, where the audio index file is an index file for the first stream of encoded audio and contains information concerning the location of at least one container file that contains the first stream of encoded audio;

obtaining, using the playback device via the network utilizing information from the audio index file, a header for the first stream of encoded audio;

configuring an audio decoder within the playback device using information contained within the header for the first stream of encoded audio;

obtaining, using the playback device via the network utilizing information from the first index file, at least a first portion of encoded video from the first stream of encoded video;

obtaining, using the playback device via the network utilizing information from the audio index file, at least a first portion of encoded audio from the first stream of encoded audio;

commencing playback of the media content by:

decoding, using the video decoder within the playback device, encoded video within the at least a first portion of encoded video from the first stream of encoded video; and

decoding, using the audio decoder within the playback device, encoded audio within the at least a first portion of encoded audio from the first stream of encoded audio;

as the playback device obtains additional portions of encoded media, evaluating at the playback device, current streaming conditions experienced by the playback device;

selecting, using the playback device based upon the current streaming conditions experienced by the playback device, a second stream of encoded video from the alternative streams of encoded video identified in the top level index file;

storing, within memory of the playback device, the index file and the information contained within the header for the first stream of encoded video used to configure the video decoder;

obtaining, using the playback device via the network, a second index file from the separate index files identified in the top level index file, where the second index file is an index file for the second stream of encoded video and contains the locations of at least one container file that contains the plurality of portions of encoded video of the second stream of encoded video;

obtaining, using the playback device via the network utilizing information from the second index file, a header for the second stream of encoded video;

configuring a video decoder within the playback device using information contained within the header for the second stream of encoded video;

obtaining, using the playback device via the network utilizing information from the second index file, at least one portion of encoded video from the second stream of encoded video;

obtaining, using the playback device via the network utilizing information from the audio index file, at least one additional portion of encoded audio from the first stream of encoded audio; and

continuing playback of the media content by:

decoding, using the video decoder within the playback device, encoded video within the at least one portion of encoded video from the second stream of encoded video; and

decoding, using the audio decoder within the playback device, encoded audio within the at least one additional portion of encoded audio from the first stream of encoded audio.

2. The method of claim 1 , further comprising:

as the playback device obtains further additional portions of encoded media, evaluating present streaming conditions experienced by the playback device;

selecting, using the playback device based upon the present streaming conditions experienced by the playback device, the first stream of encoded video from the alternative streams of encoded video identified in the top level index file;

retrieving, from the memory of the playback device, the index file and the information contained within the retrieved header for the first stream of encoded video used to configure the video decoder;

configuring a video decoder within the playback device using the information contained within the header for the first stream of encoded video that was retrieved from the memory of the playback device;

obtaining, using the playback device via the network utilizing information from the first index file retrieved from the memory of the playback device, at least one portion of encoded video from the first stream of encoded video;

obtaining, using the playback device via the network utilizing information from the audio index file, at least one further portion of encoded audio from the first stream of encoded audio; and

continuing playback of the media content by:

decoding, using the video decoder within the playback device, encoded video within the at least one portion of encoded video from the first stream of encoded video; and

decoding, using the audio decoder within the playback device, encoded audio within the at least one further portion of encoded audio from the first stream of encoded audio.

3. The method of claim 1 , wherein storing the information contained within the header for the first stream of encoded video used to configure the video decoder comprises storing the retrieved header from the first stream of encoded video.

4. The method of claim 1 , wherein evaluating current streaming conditions comprises evaluating at least one streaming condition selected from the group consisting of buffer occupancy, network bandwidth and playback device processor capacity.

5. The method of claim 1 , wherein the playback device obtains the second index file and the header for the second stream of encoded video prior to selecting the second stream based upon the current streaming conditions.

6. The method of claim 5 , wherein the playback device retrieves the second index file and the header for the second stream of encoded video prior to commencing playback.

7. The method of claim 1 , wherein:

the first index file contains:

information concerning the location of a container file that contains the first stream of encoded video; and

information concerning locations of portions of video within the container file; and

the at least a first portion of encoded video from the first stream of encoded video is obtained by the playback device via the network using a byte range request generated using the information concerning locations of portions of video within the container file.

8. The method of claim 7 , wherein the information concerning the locations of portions of video within the container file comprises information for each portion of encoded video that is selected from the group consisting of a starting location and a size.

9. The method of claim 1 , wherein:

the first index file contains information concerning the locations of a plurality of container files that each contain a portion of encoded video from the first stream of encoded video; and

the at least a first portion of encoded video from the first stream of encoded video is obtained by the playback device via the network by requesting one of the plurality of container files using the information concerning the location of the plurality of container files.

10. The method of claim 1 , wherein each portion of encoded video from the at least one portion of encoded video from the second stream of encoded video comprises a closed Group of Pictures (GOP) that commences with an Instantaneous Decoder Refresh (IDR) frame.

11. The method of claim 1 , wherein:

the top level index file contains Extensible Markup Language (XML) that includes a list of Uniform Resource Identifiers (URIs) describing streams of media including the alternative streams of encoded video; and

the method further comprises:

parsing the top level index file, using the playback device, to identify the URIs describing each of the alternative streams of encoded video.

12. The method of claim 11 , wherein the list of URIs includes at least one URI describing an audio stream.

13. The method of claim 12 , wherein the list of URIs includes at least one URI describing a subtitle stream.

14. The method of claim 11 , wherein the list of URIs includes at least one URI describing a trick play stream.

15. The method of claim 11 , wherein the top level index file is obtained by the playback device via the network using an HTTP request.

16. The method of claim 1 , wherein the second stream of encoded video is selected based upon at least one factor selected from the group consisting of:

portions of encoded video that have already been requested from a server system by the playback device; and

portions of encoded video that are buffered by the playback device.

17. The method of claim 1 , wherein each of the at least one container file that contains the first stream of encoded video is an Extensible Binary Markup Language (EBML) file.

18. The method of claim 1 , wherein each of the alternative streams of encoded video has a different maximum bitrate.

19. The method of claim 1 , wherein a plurality of the alternative streams of encoded video have different resolutions.

20. The method of claim 1 , wherein a plurality of the alternative streams of encoded video have pixels with different sample aspect ratios.

21. A method of performing adaptive bitrate streaming using a playback device that selects between different streams of encoded media during playback according to streaming conditions experienced by the playback device, the method comprising: