IP Library › Granted Patent US 12,726,665
Granted Patent B1
US 12,726,665 · App. 19/091,248 · Granted Sep 1, 2026

Methods and systems for providing a hybrid bitrate stream of digital content

Inventor: Tao Chen (Palo Alto, CA)
Assignee: Adeia Guides Inc.
H04N21/2402H04N21/2343
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,726,665
App. No.
19/091,248
Granted
Sep 1, 2026
Kind
B1
Abstract

Systems and methods are described for providing hybrid streams of digital content. Device network parameters, comprising a bitrate capacity, are determined, for receiving a hybrid stream of digital content. A first stream of the digital content is selected based on the network parameters, each stream stored at a storage and associated with corresponding encoding parameters indicative of a bitrate. A bitrate differential is determined between the bitrate capacity and a first bitrate of the first stream. First encoded video frames of the first stream and second encoded video frames of a second stream are determined based on the bitrate differential, the second stream encoding parameters indicative of a second bitrate higher than the first bitrate. The hybrid stream is constructed to comprise the first encoded video frames and the second encoded video frames. The hybrid stream is provided for presentation of the digital content at the device.

Claims (59)

1 . A method of providing hybrid streams of digital content, the method comprising:

determining one or more network parameters of a device configured to receive a hybrid stream of video frames of a digital content, the one or more network parameters comprising a bitrate capacity;

selecting, based on the one or more network parameters, a first stream from a plurality of streams of the digital content, each stream of the plurality of streams stored at a storage and associated with a corresponding one or more encoding parameters used to encode the video frames, the one or more encoding parameters indicative of a bitrate;

determining a bitrate differential between the bitrate capacity and a first bitrate of the first stream stored at a storage;

determining based on the bitrate differential: (i) a first one or more encoded video frames of the first stream stored at a storage, and (ii) a second one or more encoded video frames of a second stream of the plurality of streams stored at a storage, the second stream associated with one or more encoding parameters indicative of a second bitrate higher than the first bitrate;

constructing the hybrid stream comprising the determined first one or more encoded video frames of the first stream and the determined second one or more encoded video frames of the second stream; and

providing the hybrid stream for presentation of the digital content at the device.

2 . The method of claim 1 , wherein the one or more encoding parameters comprises one or more selected from the group: a resolution; a frame rate; a quantization level; a group of pictures structure; a quality metric;

wherein the first stream is associated with a first encoding parameter indicative of the first bitrate, and the second stream is associated with a second encoding parameter indicative of the second bitrate higher than the first bitrate.

3 . The method of claim 1 , wherein at least one of the determined video frames of the second stream is an independently decodable frame.

4 . The method of claim 1 , further comprising:

determining, based on the bitrate differential, a threshold number of video frames of the second stream;

wherein determining the second one or more encoded video frames of a second stream is based on the threshold number.

5 . The method of claim 1 , wherein determining the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream comprises:

determining, based on the bitrate differential, a threshold temporal distance between a first video frame of the second stream and a second video frame of the second stream; and

determining, based on the threshold temporal distance, the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream for constructing the hybrid stream.

6 . The method of claim 1 , wherein determining the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream comprises:

determining a quality metric associated with the video frames of the first stream and the video frames of the second stream;

determining a difference between the quality metric of the video frames of the first stream and the quality metric of the video frames of the second stream; and

determining, based on the difference, the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream for constructing the hybrid stream.

7 . The method of claim 1 , wherein determining the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream comprises:

determining one or more visual characteristics of the video frames of the first stream; and

determining, based on the one or more visual characteristics, the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream for constructing the hybrid stream.

8 . The method of claim 1 , wherein providing the hybrid stream comprises:

streaming the determined first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream to the device.

9 . The method of claim 1 , wherein providing the hybrid stream comprises:

modifying a manifest file associated with the digital content to identify the determined first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream.

10 . A method of receiving hybrid streams of digital content, the method comprising:

determining one or more network parameters of a device configured to receive a hybrid stream of video frames of a digital content, the one or more network parameters comprising a bitrate capacity;

communicating the one or more network parameters to a server for selecting, based on the one or more network parameters, a first stream from a plurality of streams of the digital content stored at a storage of one or more server devices, each stream of the plurality of streams associated with a corresponding one or more encoding parameters used to encode the video frames, the one or more encoding parameters indicative of a bitrate;

receiving, after communicating the one or more network parameters and based on a bitrate differential between the bitrate capacity and a first bitrate of the first stream, a hybrid stream including: (i) a first one or more encoded video frames of the first stream stored at a storage; and (ii) a second one or more encoded video frames of a second stream of the plurality of streams stored at a storage, the second stream associated with one or more encoding parameters indicative of a second bitrate higher than the first bitrate; and

displaying each of the received first one or more encoded video frames of the first stream and the received second one or more encoded video frames of the second stream to provide the hybrid stream of digital content.

11 . A system for providing hybrid streams of digital content, the system comprising control circuitry configured to:

determine one or more network parameters of a device configured to receive a hybrid stream of video frames of a digital content, the one or more network parameters comprising a bitrate capacity;

select, based on the one or more network parameters, a first stream from a plurality of streams of the digital content, each stream of the plurality of streams stored at a storage and associated with a corresponding one or more encoding parameters used to encode the video frames, the one or more encoding parameters indicative of a bitrate;

determine a bitrate differential between the bitrate capacity and a first bitrate of the first stream stored at a storage;

determine based on the bitrate differential: (i) a first one or more encoded video frames of the first stream stored at a storage, and (ii) a second one or more encoded video frames of a second stream of the plurality of streams stored at a storage, the second stream associated with one or more encoding parameters indicative of a second bitrate higher than the first bitrate;

construct the hybrid stream comprising the determined first one or more encoded video frames of the first stream and the determined second one or more encoded video frames of the second stream; and

provide the hybrid stream for presentation of the digital content at the device.

12 . The system of claim 11 , wherein the one or more encoding parameters comprises one or more selected from the group: a resolution; a frame rate; a quantization level; a group of pictures structure; a quality metric;

wherein the first stream is associated with a first encoding parameter indicative of the first bitrate, and the second stream is associated with a second encoding parameter indicative of the second bitrate higher than the first bitrate.

13 . The system of claim 11 , wherein at least one of the determined video frames of the second stream is an independently decodable frame.

14 . The system of claim 11 , wherein the control circuitry is further configured to:

determine, based on the bitrate differential, a threshold number of video frames of the second stream;

wherein determining the second one or more encoded video frames of a second stream is based on the threshold number.

15 . The system of claim 11 , wherein determining the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream comprises:

determining, based on the bitrate differential, a threshold temporal distance between a first video frame of the second stream and a second video frame of the second stream; and

determining, based on the threshold temporal distance, the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream for constructing the hybrid stream.

16 . The system of claim 11 , wherein determining the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream comprises:

determining a quality metric associated with the video frames of the first stream and the video frames of the second stream;

determining a difference between the quality metric of the video frames of the first stream and the quality metric of the video frames of the second stream; and

determining, based on the difference, the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream for constructing the hybrid stream.

17 . The system of claim 11 , wherein determining the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream comprises:

determining one or more visual characteristics of the video frames of the first stream; and

determining, based on the one or more visual characteristics, the first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream for constructing the hybrid stream.

18 . The system of claim 11 , wherein providing the hybrid stream comprises:

streaming the determined first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream to the device.

19 . The system of claim 11 , wherein providing the hybrid stream comprises:

modifying a manifest file associated with the digital content to identify the determined first one or more encoded video frames of the first stream and the second one or more encoded video frames of the second stream.

References Cited (66)
US 5978035A · Geshwind · 1999 [cited by applicant]
US 6480541B1 · Girod et al. · 2002 [cited by applicant]
US 6631240B1 · Salesin et al. · 2003 [cited by applicant]
US 7463683B2 · Van Der Schaar et al. · 2008 [cited by applicant]
US 7817576B1 · Breau et al. · 2010 [cited by applicant]
US 8184712B2 · Mukherjee · 2012 [cited by applicant]
US 8681871B2 · Vilei et al. · 2014 [cited by applicant]
US 8989519B2 · Irani et al. · 2015 [cited by applicant]
US 10157447B2 · Bar-On et al. · 2018 [cited by applicant]
US 10869087B2 · Syed · 2020 [cited by applicant]
US 10887612B2 · Rossato et al. · 2021 [cited by applicant]
US 20010033295A1 · Phillips · 2001 [cited by applicant]
US 20010043751A1 · Takahashi et al. · 2001 [cited by applicant]
US 20020191116A1 · Kessler et al. · 2002 [cited by applicant]
US 20040213345A1 · Holcomb et al. · 2004 [cited by applicant]
US 20050165911A1 · Homiller · 2005 [cited by applicant]
US 20050169386A1 · Spalink et al. · 2005 [cited by applicant]
US 20050195899A1 · Han · 2005 [cited by applicant]
US 20050195900A1 · Han · 2005 [cited by applicant]
US 20060083315A1 · Sato et al. · 2006 [cited by applicant]
US 20060127059A1 · Fanning · 2006 [cited by applicant]
US 20060146931A1 · Boyce · 2006 [cited by applicant]
US 20070081794A1 · Baynger et al. · 2007 [cited by applicant]
US 20070086519A1 · Lim · 2007 [cited by applicant]
US 20070147804A1 · Zhang et al. · 2007 [cited by applicant]
US 20070195878A1 · Bruls et al. · 2007 [cited by applicant]
US 20100098152A1 · Glenn · 2010 [cited by applicant]
US 20100142836A1 · Joshi et al. · 2010 [cited by applicant]
US 20120128262A1 · Eppolito · 2012 [cited by applicant]
US 20120297082A1 · Sim · 2012 [cited by applicant]
US 20130051767A1 · Soroushian et al. · 2013 [cited by applicant]
US 20130322517A1 · Zurpal et al. · 2013 [cited by applicant]
US 20140140407A1 · Yu et al. · 2014 [cited by applicant]
US 20140328569A1 · Strobl et al. · 2014 [cited by applicant]
US 20150036736A1 · Lundberg · 2015 [cited by applicant]
US 20150124165A1 · Mendenhall et al. · 2015 [cited by applicant]
US 20150195485A1 · Wan et al. · 2015 [cited by applicant]
US 20150324952A1 · Namboodiri et al. · 2015 [cited by applicant]
US 20160100128A1 · Butterworth et al. · 2016 [cited by applicant]
US 20200169766A1 · Chirokov · 2020 [cited by examiner]
US 20220385911A1 · Ferrara et al. · 2022 [cited by applicant]
US 20230179781A1 · Kelly · 2023 [cited by applicant]
EP 1631089A1 · 2006 [cited by applicant]
EP 1721465A1 · 2006 [cited by applicant]
EP 1787473A1 · 2007 [cited by applicant]
EP 3151563A1 · 2017 [cited by applicant]
EP 4362465A1 · 2024 [cited by applicant]
WO 2007003340A2 · 2007 [cited by applicant]
WO 2007020278A2 · 2007 [cited by applicant]
WO 2013017565A1 · 2013 [cited by applicant]
WO 2024201025A1 · 2024 [cited by applicant]
“Streaming learning center”, retrieved at https://streaminglearningcenter.com/encoding/everything-you-ever-wanted-to-knowabout-idr-frames-but-were-afraid-to-ask.html, retrieved on Jun. 5, 2025, 3 pages. [cited by applicant]
Ancuti, C., et al., “Video super-resolution using high quality photographs”, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, 2010, pp. 862-865. [cited by applicant]
Cao, J., et al., “Reference-Based Image Super-Resolution with Deformable Attention Transformer”, Computer Vision—ECCV 2022, Nov. 3, 2022, pp. 325-342. [cited by applicant]
Chen T., U.S. Appl. No. 18/660,747, filed May 10, 2024. Title: Methods and System for Progressive Streaming of Video Segments . . . (Not provided; USPTO in possession of specification, claims and prosecution history). [cited by applicant]
Chris: “Frame Types, The I, P & B's of video encoding”, Flaeri's tech talk, retrieved at https://blog.otterbro.com/frame-types-framing-the-whole-picture/, retrieved on Nov. 8, 2020, 5 pages. [cited by applicant]
Freedman, G., et al., “Image and video upscaling from local self-examples”, ACM Transactions on Graphics (TOG), vol. 30, No. 2, Article No. 12, Apr. 22, 2011, pp. 1-11. [cited by applicant]
Hu, Y., et al., “Standard Compliant Video Coding Using Low Complexity, Switchable Neural Wrappers”, 2024 IEEE International Conference on Image Processing (ICIP), contentarXiv: 2407.07395v1 [cs.CV], Jul. 10, 2024, 26 pa… [cited by applicant]
Ioannis Katsavounidis, “Dynamic optimizer—a perceptual video encoding optimization framework”, Netflix TechBlog, Mar. 5, 2018, 24 pages. [cited by applicant]
ireplay.tv :“Video Streaming Definitions”, retrieved at https://ireplay.tv/video-streaming-definitions/what-is-an-idr-instantaneous-decoderrefresh/, retrieved on Jun. 5, 2025, 12 pages. [cited by applicant]
Per-Title Encode Optimization, “Per-Title Encode Optimization”, retrieved from <https://netflixtechblog.com/per-title-encode-optimization-7e99442b62a2>, Dec. 14, 2015, 17 pages. [cited by applicant]
Rhee, H., et al., “Lightweight Hybrid Video Compression Framework Using Reference-Guided Restoration Network”, arXiv:2303.11592, Mar. 21, 2023, 11 pages. [cited by applicant]
Sun, W., et al., “Attention-guided video super-resolution with recurrent multi-scale spatial-temporal transformer”, Complex & Intelligent Systems, vol. 9, 2023, pp. 3989-4002. [cited by applicant]
Yang, R., et al., “Decoder-side HEVC quality enhancement with scalable convolutional neural network”, 2017 IEEE International Conference on Multimedia and Expo (ICME), Jul. 10-14, 2017, pp. 817-822. [cited by applicant]
Zhang, X., et al., “Real-world video superresolution enhancement method based on the adaptive down-sampling model”, Nature, Scientific Reports, vol. 14, No. 1, Sep. 4, 2024, 16 pages. [cited by applicant]
Zhou, X., et al., “Video Super-Resolution Transformer with Masked Inter&Intra-Frame Attention”, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, pp. 25399-25408. [cited by applicant]