IP Library Granted Patent US 11,758,182
Granted Patent B2
US 11,758,182 · App. 17/105,356 · Granted Sep 12, 2023

Video encoding through non-saliency compression for live streaming of high definition videos in low-bandwidth transmission

Inventors: Umar Asif (Melbourne, AU); Lenin Mehedy (Doncaster East, AU); Jianbin Tang (Doncaster East, AU)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
H04N19/54G06N20/00G06V10/462H04N19/23H04N21/23418
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,758,182
App. No.
17/105,356
Granted
Sep 12, 2023
Kind
B2
Abstract

A computer-implemented method of encoding video streams for low-bandwidth transmissions includes identifying a salient data and a non-salient data in a high-resolution video stream. The salient data and the non-salient data is segmented. The non-salient data is compressed to a lower resolution. The salient data and the compressed non-salient data are transmitted in a low-bandwidth transmission.

Claims (33)

1. A computer-implemented method of encoding a video stream for high-definition video in a low-bandwidth transmission, the method comprising:

automatically determining a domain including domain-specific characteristics in a high-resolution video stream;

identifying a salient data and a non-salient data in the high-resolution video stream, wherein the identifying of the salient data includes identifying one or more domain-specific characteristics of objects in the video stream;

segmenting the salient data and the non-salient data;

compressing the non-salient data to a lower resolution; and

transmitting the salient data and the compressed non-salient data.

2. The computer-implemented method of claim 1 , further comprising encoding the non-salient data prior to performing the compressing of the non-salient data.

3. The computer-implemented method according to claim 1 , further comprising compressing the salient data at a lower compression ratio than the non-salient data prior to transmitting the salient data and the compressed non-salient data.

4. The computer-implemented method of claim 1 , further comprising identifying at least one of the non-salient data and the salient data in the video stream by a machine learning model.

5. The computer-implemented method of claim 4 , wherein the machine learning model comprises a General Adversarial Network (GAN) machine learning model; and further comprising:

training the GAN machine learning model with data of one or more non-salient features from previously recorded video streams to identify the non-salient data.

6. The computer-implemented method of claim 5 , further comprising providing to a user device one or more of a link to access or a code to execute the GAN machine learning model prior to transmitting the salient data and the compressed non-salient data of the video stream to the user device.

7. The computer-implemented method of claim 1 , wherein the identifying of the salient data includes applying a domain-specific Artificial Intelligence (AI) model for one or more of facial recognition or object recognition.

8. The computer-implemented method of claim 7 , wherein the applying of the domain-specific AI model further comprises identifying a remainder of information of the video stream as the non-salient data.

9. The computer-implemented method of claim 1 , further comprising receiving a plurality of video streams, each video stream having respectively different views of one or more objects, wherein the identifying and segmenting of the salient data and non-salient data is performed individually for at least two respectively different views that are transmitted.

10. A computing device for encoding video streams for high-definition video in a low-bandwidth transmission, the computing device comprising:

a processor;

a memory coupled to the processor, the memory storing instructions to cause the processor to perform acts comprising:

automatically determining a domain including domain-specific characteristics in a high-resolution video stream;

identifying a salient data and a non-salient data in the high-resolution video stream, wherein the identifying of the salient data includes identifying one or more domain-specific characteristics of objects in the video stream;

segmenting the salient data and the non-salient data;

encoding and compressing the non-salient data; and

transmitting the salient data and the compressed non-salient data.

11. The computing device of claim 10 , further comprising:

a General Adversarial Network (GAN) machine learning model in communication with the memory; and

wherein the instructions cause the processor to perform an additional act comprising training the GAN machine learning model with training data of non-salient features based on previously recorded video streams to perform the identifying of at least the non-salient data.

12. The computing device of claim 11 , wherein the instructions cause the processor to perform additional acts comprising:

receiving refined results from the selected agents based on the fused parameters; and

generating a global training model based on the refined results.

13. The computing device of claim 10 , wherein the instructions cause the processor to perform an additional act comprising:

applying a domain-specific Artificial Intelligence (AI) model comprising one or more of facial recognition or object recognition to identify the salient data.

14. The computing device of claim 10 , wherein the instructions cause the processor to perform an additional act comprising transmitting different camera views of the salient data and the non-salient data to a plurality of recipient devices.

15. The computer-implemented method of claim 1 , wherein the compression of the non-salient data is based on transmission of the video stream using the low-bandwidth transmission.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2020
From: ASIF, UMAR; MEHEDY, LENIN; TANG, JIANBIN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 054473/0486 →
Continuity (1)
Related Publication 20220167005A1 · May 26, 2022
Cited By (1)
US 12,482,057