IP Library Granted Patent US 10,701,370
Granted Patent B2
US 10,701,370 · App. 16/195,415 · Granted Jun 30, 2020

System and method for automatic encoder adjustment based on transport data

Inventors: David Pui Keung Sze (Waterloo, CA); Akos Horvath (Kitchener, CA); Bogdan Frusina (Kitchener, CA); Barry Gilhuly (Waterloo, CA); Cameron Kenneth Smith (Oakville, CA); Joseph Robert Wayne Mallet (Kitchener, CA); Anthony Todd Schneider (Waterloo, CA); Robert Flatt (Kitchener, CA); Hagen Kaye (Waterloo, CA)
Assignee: DEJERO LABS INC.
H04N19/166H04L5/003H04L5/0053H04L5/0058H04L65/4076H04L65/4092H04L65/607H04L65/80H04N19/115H04N19/172H04N19/89H04N21/2343H04N21/23406H04N21/44004H04N21/4622H04N21/6131H04N21/631H04N21/6373H04N21/6377H04N21/658
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,701,370
App. No.
16/195,415
Granted
Jun 30, 2020
Kind
B2
Abstract

A system and method for transmission of a video stream are provided. The system may include: an encoder adapted to generate a video stream comprising a plurality of encoded frames, encoded according to at least one encoding parameter; a comparator in communication with the encoder, the comparator adapted to compare encoded frames of the plurality of encoded frames with input frames to determine a fitness metric reflective of visual quality of the encoded frames; and a controller in communication with the comparator, the controller adapted to adjust the at least one encoding parameter based on the fitness metric.

Claims (31)

1. A system for transmission of a video stream as individual data streams to be communicated across a plurality of connected networks, each of the networks having a corresponding available bandwidth, the system comprising:

a processor operating in conjunction with computer memory configured to:

encode frames of the video stream for generating the individual video streams according to at least one encoding parameter for said each network of the plurality of connected networks for transmission at an estimated maximum bit rate derived based on a predicted available bandwidth available across all of the plurality of connected networks;

compare the encoded frames of the plurality of encoded frames with input frames to determine a fitness metric reflective of visual quality of the encoded frames upon detecting a change in the predicted available bandwidth determined from feedback data corresponding to said each network; and

receive data corresponding to the corresponding available bandwidth for said each network of the plurality of connected networks over which the video stream is transmitted; and

adjust the at least one encoding parameter for each of the individual video streams based on the corresponding available bandwidth of said each network and on the fitness metric by iteratively adjusting the at least one encoding parameter until the fitness metric meets or exceeds a pre-defined minimum value to optimize visual quality of the video stream for a bit rate determined based at least on the corresponding available bandwidth of said each network of the plurality of networks.

2. The system of claim 1 , wherein the input frames are provided from a video capture device.

3. The system of claim 1 , further comprising a pre-processor that processes frames prior to encoding, and wherein the input frames are provided to the processor from the pre-processor.

4. The system of claim 3 , wherein the input frames are scaled versions of frames captured by a video capture device.

5. The system of claim 1 , wherein the processor is configured to transmit encoded frames over a network of the plurality of networks.

6. The system of claim 1 , wherein the processor applies at least one of Structural Simularity (SSIM), Peak Signal to Noise Ratio (PSNR), Mean Squared Error (MSE), and Multi-Scale SSIM (MS-SSIM) to determine the fitness metric.

7. The system of claim 1 , wherein the at least one encoding parameter comprises one or more of a frame rate, an encoding rate and a frame size.

8. The system of claim 1 , wherein the processor is adapted to adjust the at least one encoding parameter based on a complexity level of the video stream.

9. The system of claim 8 , wherein the complexity level of the video stream is determined based on motion estimation analysis of the input frames of the video stream.

10. A method for transmitting a video stream as individual data streams to be communicated across a plurality of connected networks, each of the networks having a corresponding available bandwidth, the method comprising:

encoding frames of the video stream for generating the individual video streams according to at least one encoding parameter for said each network of the plurality of connected networks for transmission at an estimated maximum bit rate derived based on a predicted available bandwidth available across all of the plurality of connected networks;

comparing the encoded frame with an input frame to determine a fitness metric reflective of visual quality of the encoded frame upon detecting a change in the predicted available bandwidth determined from feedback data corresponding to said each network;

receive data corresponding to the corresponding available bandwidth for said each network of the plurality of connected networks over which the video stream is transmitted; and

adjusting the at least one encoding parameter for each of the individual video streams based on the corresponding available bandwidth of said each network and on the fitness metric by iteratively adjusting the at least one encoding parameter until the fitness metric meets or exceeds a pre-defined minimum value to optimize visual Quality of the video stream for a bit rate determined based at least on the corresponding available bandwidth of said network of the plurality of networks.

11. The method of claim 10 , further comprising:

encoding a further frame of the video stream according to the adjusted at least one encoding parameter.

12. The method of claim 10 , further comprising capturing the input frame.

13. The method of claim 10 , further comprising:

pre-processing the input frame, the pre-processing comprising scaling the input frame.

14. The method of claim 10 , wherein the fitness metric is determined based on at least one of Structural Similarity (SSIM), Peak Signal to Noise Ratio (PSNR), Mean Squared Error (MSE), and Multi-Scale SSIM (MS-SSIM).

15. The method of claim 10 , wherein the at least one encoding parameter comprises one or more of a frame rate, an encoding rate and a frame size.

16. The method of claim 10 , further comprising adjusting the at least one encoding parameter based on a correlated parameter.

17. The method of claim 16 , wherein the correlated parameter is a packet loss rate.

18. The method of claim 10 , further comprising adjusting the at least one encoding parameter based on a maximum bit rate.

19. The method of claim 10 , further comprising adjusting the at least one encoding parameter based on a complexity level of the video stream.

20. The method of claim 19 , wherein the complexity level of the video stream is determined based on motion estimation analysis of the input frames of the video stream.

Assignments (7)
SECURITY INTEREST Recorded Jan 6, 2026
From: DEJERO LABS INC.
To: MULTIPLIER GROWTH PARTNERS, LP, AS ADMINISTRATIVE AGENT
Reel/Frame 074213/0282 →
RELEASE OF SECURITY INTEREST Recorded Nov 20, 2025
From: RUNWAY GROWTH FINANCE CORP.
To: DEJERO LABS INC.
Reel/Frame 072980/0220 →
SECURITY INTEREST Recorded Jan 11, 2022
From: DEJERO LABS INC.
To: RUNWAY GROWTH FINANCE CORP.
Reel/Frame 058613/0966 →
RELEASE OF SECURITY INTEREST Recorded Jan 26, 2021
From: RUNWAY GROWTH CREDIT FUND INC.
To: DEJERO LABS INC.
Reel/Frame 055026/0539 →
SECURITY INTEREST Recorded Jan 4, 2021
From: DEJERO LABS INC.
To: COMERICA BANK
Reel/Frame 054802/0177 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2020
From: SZE, DAVID PUI KEUNG; HORVATH, AKOS; FRUSINA, BOGDAN; GILHULY, BARRY; SMITH, CAMERON KENNETH; MALLET, JOSEPH ROBERT WAYNE; SCHNEIDER, ANTHONY TODD; FLATT, ROBERT; KAYE, HAGEN
To: DEJERO LABS INC.
Reel/Frame 052614/0387 →
SECURITY INTEREST Recorded Jun 11, 2019
From: DEJERO LABS INC.
To: RUNWAY GROWTH CREDIT FUND INC.
Reel/Frame 049428/0137 →
Continuity (8)
Continuation 14815363 · Jul 31, 2015
Continuation In Part 14341057 · Jul 25, 2014
Continuation In Part 12499151 · Jul 8, 2009
Continuation In Part 13439352 · Apr 4, 2012
Continuation In Part 13183652 · Jul 15, 2011
Provisional Application 62031407 · Jul 31, 2014
Provisional Application 61364598 · Jul 15, 2010
Related Publication 20190089964A1 · Mar 21, 2019
Cited By (1)
US 12,621,510