IP Library Granted Patent US 11,979,627
Granted Patent B2
US 11,979,627 · App. 17/740,176 · Granted May 7, 2024

Optimization of encoding profiles for media streaming

Inventors: Yuriy Reznik (Seattle, WA); Karl Lillevold (Seattle, WA); Abhijith Jagannath (Seattle, WA); Manish Rao (Tempe, AZ); Justin Greer (Waunakee, WI)
Assignee: Brightcove Inc.
H04N21/2662H04N19/40H04N19/46H04N21/234309H04N21/23439H04N21/2402H04N21/258H04N21/26258H04N21/8456H04N21/64769
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,979,627
App. No.
17/740,176
Granted
May 7, 2024
Kind
B2
Abstract

Techniques described herein are directed toward creating one or more “dynamic profiles” for media (video) streaming in which an encoding bit rate (and optionally other profile settings) is optimized for particular content. More specifically, techniques involve performing one or more “probe” encodings of the particular content to determine an encoding bit rate (and optionally other profile settings) that results in an encoding having a quality value sufficiently near (within a threshold) a target quality value.

Claims (43)

1. A method of optimization in encoding source content, the method comprising:

obtaining, by a computer system, the source content from an input request, wherein the source content comprises a video in a first electronic format;

defining a set of resolutions based on resolution, aspect ratio, and framerate of the video of the source content;

determining encoding parameters for at least one probe encoding based on the set of resolutions, and a target quality value defining a metric associated with a perceptual-weightage of the video;

conducting the at least one probe encoding, the at least one probe encoding comprising an encoding of a portion of the source content;

computing the perceptual-weightage for the probe encoding using an optical modulation transfer function;

defining allowed ranges for a set of bitrates provided by the input request; and

generating, with the computer system, a profile for encoding the source content, wherein the profile for encoding the source content:

indicates how the source content is to be encoded to a second electronic format, and

includes information indicative of the encoding parameters for a final encoding.

2. The method of optimization in encoding source content of claim 1 , further comprising determining the encoding parameters based on a target quality value, wherein the target quality value comprises a perceptually-weighted target quality value.

3. The method of optimization in encoding source content of claim 1 , wherein the profile comprises an encoding ladder that includes information indicative of encoding parameters for the final encoding, wherein:

the encoding parameters for the final encoding include a number of encodings, video resolutions and bitrates for each encoding,

the encoding parameters for the final encoding is determined using a Figure of Merit function, and

a combination of the number of encodings, the set of bitrates, and the set of resolutions is determined as the encoding parameters for optimizing the Figure of Merit function, wherein:

the optimization occurs wherein the allowed ranges of the set of bitrates and the set of resolutions are scanned, and

the combination of the number of encodings, the allowed ranges of set of bitrates, and the set of resolutions achieving a maximum of the Figure of Merit is selected.

4. The method of optimization in encoding source content of claim 3 , wherein the encoding ladder includes information indicative of additional encoding parameters for one or more additional encodings of the source content.

5. The method of optimization in encoding source content of claim 1 , wherein generating the profile for encoding the source content comprises solving an optimization problem for a Figure of Merit function to determine one or more of the encoding parameters for the final encoding.

6. The method of optimization in encoding source content of claim 1 , wherein determining the encoding parameters for the final encoding is further based on a target quality value indicative of a Structural Similarity Index Metric (SSIM), Peak Signal-To-Noise Ratio (PSNR), Video Multimethod Assessment Fusion (VMAF), and Picture Quality Rating (PQR).

7. A system of optimization in encoding source content, the system comprising:

a communication interface;

a memory; and

a processing unit communicatively coupled with the communication interface and the memory and configured to cause a server to:

obtain the source content from an input request, wherein the source content comprises a video in a first electronic format;

define a set of resolutions based on resolution, aspect ratio, and framerate of the video of the source content;

determine encoding parameters for at least one probe encoding based on the set of resolutions and a target quality value defining a metric associated with a perceptual-weightage of the video;

conduct the at least one probe encoding, the at least one probe encoding comprising an encoding of a portion of the source content;

computing the perceptual-weightage for the probe encoding using an optical modulation transfer function;

define allowed ranges for a set of bitrates provided by the input request; and

generate a profile for encoding the source content, wherein the profile for encoding the source content:

indicates how the source content is to be encoded to a second electronic format, and

includes information indicative of the encoding parameters for a final encoding.

8. The system of optimization in encoding source content of claim 7 , wherein the processing unit is further configured to determine the encoding parameters based on a target quality value, wherein the target quality value comprises a perceptually-weighted target quality value.

9. The system of optimization in encoding source content of claim 7 , wherein the profile comprises an encoding ladder that includes information indicative of encoding parameters for the final encoding, wherein:

the encoding parameters for the final encoding include a number of encodings, video resolutions and bitrates for each encoding,

the encoding parameters for the final encoding is determined using a Figure of Merit function, and

a combination of the number of encodings, the set of bitrates, and the set of resolutions is determined as the encoding parameters for optimizing the Figure of Merit function, wherein:

the optimization occurs wherein the allowed ranges of the set of bitrates and the set of resolutions are scanned, and

the combination of the number of encodings, the allowed ranges of set of bitrates, and the set of resolutions achieving a maximum of the Figure of Merit is selected.

10. The system of optimization in encoding source content of claim 9 , wherein the encoding ladder includes information indicative of additional encoding parameters for one or more additional encodings of the source content.

11. The system of optimization in encoding source content of claim 7 , wherein generating the profile for encoding the source content comprises solving an optimization problem for a Figure of Merit function to determine one or more of the encoding parameters for the final encoding.

12. The system of optimization in encoding source content of claim 7 , wherein determining the encoding parameters for the final encoding is further based on a target quality value indicative of a Structural Similarity Index Metric (SSIM), Peak Signal-To-Noise Ratio (PSNR), Video Multimethod Assessment Fusion (VMAF), and Picture Quality Rating (PQR).

Assignments (4)
CHANGE OF NAME Recorded Mar 31, 2026
From: ADEIA MEDIA HOLDINGS LLC
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 075304/0073 →
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 4, 2024
From: BRIGHTCOVE INC.
To: ADEIA MEDIA HOLDINGS LLC
Reel/Frame 067609/0435 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2022
From: REZNIK, YURIY; LILLEVOLD, KARL; JAGANNATH, ABHIJITH; GREER, JUSTIN; RAO, MANISH
To: BRIGHTCOVE INC.
Reel/Frame 059876/0251 →