IP Library Granted Patent US 12,455,858
Granted Patent B2
US 12,455,858 · App. 17/387,935 · Granted Oct 28, 2025

Saliency-based compression

Inventors: Nezare Chafni (Santa Monica, CA); Shaun Moore (Siesta Key, FL)
Assignee: 214 TECHNOLOGIES, INC.
G06F16/164G06N20/00G06T9/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,455,858
App. No.
17/387,935
Granted
Oct 28, 2025
Kind
B2
Abstract

A method may include obtaining a machine learning model configured to label media files of a given type. The method may include obtaining a saliency map including multiple elements corresponding to aspects of the given type of media files, each element corresponding to encoding parameters. A given encoding parameter of an associated element may be based on an identified salience of the associated element in the machine learning model determining a label. The method may include obtaining a first media sample of the given type. The method may include deriving a second media sample from the first media sample based on applying the given encoding parameter to the associated element of the first media sample according to the saliency map. The method may include labeling, by the machine learning model, the second media sample.

Claims (70)

1. A method, comprising:

obtaining a machine learning model configured to label media files of a given type corresponding to a type of training media samples, wherein the given type of the media files comprises at least one of an image type, an audio type, or a video type;

assigning, by the machine learning model, a label to a training media sample comprising a plurality of elements;

modifying an element of the plurality of elements to generate an updated training media sample;

assigning, by the machine learning model, a label to the updated training media sample;

comparing the label assigned to the training media sample to the label assigned to the updated training media sample;

determining, using the machine learning model, a salience of the element that was modified based on the comparison of the labels;

generating, using the machine learning model, a saliency map based on a plurality of training media samples, the saliency map including a plurality of values corresponding to elements of the saliency map, each element of the plurality of elements corresponding to at least one value, each of the values correspond to the salience of the corresponding element for perception of the media files by a computer determined by the machine learning model, and each of the values indicate an importance of a corresponding element of the saliency map in assigning a label to a media sample;

obtaining a first media sample of the given type, the first media sample having a first sample size;

compressing elements of the first media sample according to the values corresponding to the plurality of elements of the saliency map to generate a second media sample having a second sample size, wherein the second sample size is smaller than the first sample size;

identifying, using the machine learning model, a pattern between the elements of the second media sample and elements of the training media sample; and

assigning, by the machine learning model, a label to the second media sample based on the identified pattern between the elements of the second media sample and the elements of the training media sample.

2. The method of claim 1 , further comprising verifying labeling accuracy of the machine learning model, wherein verifying the labeling accuracy comprises:

labeling, by the machine learning model, the first media sample;

comparing a first label corresponding to the first media sample as labeled by the machine learning model and a second label corresponding to the second media sample as labeled by the machine learning model; and

updating one or more of the values of the saliency map responsive to the first label and the second label being different based on the comparing.

3. The method of claim 1 , further comprising verifying labeling accuracy of the machine learning model, wherein verifying the labeling accuracy comprises:

labeling, by the machine learning model, the first media sample;

comparing a first label corresponding to the first media sample as labeled by the machine learning model and a second label corresponding to the second media sample as labeled by the machine learning model; and

storing the second media sample in a database responsive to the first label and the second label being the same based on the comparing.

4. The method of claim 1 , wherein:

each of the values included in the saliency map describes a degree of compression of a respective element corresponding to a respective encoding parameter.

5. The method of claim 1 , wherein labeling media files by the machine learning model includes at least one of license plate identification, emotion detection, lie detection, background segmentation, facial recognition, or biometrics recognition.

6. One or more non-transitory computer-readable storage media configured to store instructions that, in response to being executed, cause a system to perform operations, the operations comprising:

obtaining a machine learning model configured to label media files of a given type corresponding to a type of training media samples, wherein the given type of the media files comprises at least one of an image type, an audio type, or a video type;

assigning, by the machine learning model, a label to a training media sample comprising a plurality of elements;

modifying an element of the plurality of elements to generate an updated training media sample;

assigning, by the machine learning model, a label to the updated training media sample;

comparing the label assigned to the training media sample to the label assigned to the updated training media sample;

determining, using the machine learning model, a salience of the element that was modified based on the comparison of the labels;

generating, using the machine learning model, a saliency map based on a plurality of training media samples, the saliency map including a plurality of values corresponding to elements of the saliency map, each element of the plurality of elements corresponding to at least one value, each of the values correspond to the salience of the corresponding element for perception of the media files by a computer determined by the machine learning model, and each of the values indicate an importance of a corresponding element of the saliency map in assigning a label to a media sample;

obtaining a first media sample of the given type, the first media sample having a first sample size;

compressing elements of the first media sample according to the values corresponding to the plurality of elements of the saliency map to generate a second media sample having a second sample size, wherein the second sample size is smaller than the first sample size;

identifying, using the machine learning model, a pattern between the elements of the second media sample and elements of the training media sample; and

assigning, by the machine learning model, a label to the second media sample based on the identified pattern between the elements of the second media sample and the elements of the training media sample.

7. The one or more non-transitory computer-readable storage media of claim 6 , further comprising verifying labeling accuracy of the machine learning model, wherein verifying the labeling accuracy comprises:

labeling, by the machine learning model, the first media sample;

comparing a first label corresponding to the first media sample as labeled by the machine learning model and a second label corresponding to the second media sample as labeled by the machine learning model; and

updating one or more of the values of the saliency map responsive to the first label and the second label being different based on the comparing.

8. The one or more non-transitory computer-readable storage media of claim 6 , further comprising verifying labeling accuracy of the machine learning model, wherein verifying the labeling accuracy comprises:

labeling, by the machine learning model, the first media sample;

comparing a first label corresponding to the first media sample as labeled by the machine learning model and a second label corresponding to the second media sample as labeled by the machine learning model; and

storing the second media sample in a database responsive to the first label and the second label being the same based on the comparing.

9. The one or more non-transitory computer-readable storage media of claim 6 , wherein:

each of the values included in the saliency map describes a degree of compression of a respective element corresponding to a respective encoding parameter.

10. The one or more non-transitory computer-readable storage media of claim 6 , wherein labeling media files by the machine learning model includes at least one of license plate identification, emotion detection, lie detection, background segmentation, facial recognition, or biometrics recognition.

11. A system comprising:

one or more processors; and

one or more non-transitory computer-readable storage media configured to store instructions that, in response to being executed, cause the system to perform operations, the operations comprising:

obtaining a machine learning model configured to label media files of a given type corresponding to a type of training media samples, wherein the given type of the media files comprises at least one of an image type, an audio type, or a video type;

assigning, by the machine learning model, a label to a training media sample comprising a plurality of elements;

modifying an element of the plurality of elements to generate an updated training media sample;

assigning, by the machine learning model, a label to the updated training media sample;

comparing the label assigned to the training media sample to the label assigned to the updated training media sample;

determining, using the machine learning model, a salience of the element that was modified based on the comparison of the labels;

generating, using the machine learning model, a saliency map based on a plurality of training media samples, the saliency map including a plurality of values corresponding to elements of the saliency map, each element of the plurality of elements corresponding to at least one value, each of the values correspond to the salience of the corresponding element for perception of the media files by a computer determined by the machine learning model, and each of the values indicate an importance of a corresponding element of the saliency map in assigning a label to a media sample;

obtaining a first media sample of the given type, the first media sample having a first sample size;

compressing elements of the first media sample according to the values corresponding to the plurality of elements of the saliency map to generate a second media sample having a second sample size, wherein the second sample size is smaller than the first sample size; and

assigning, by the machine learning model, a label to the second media sample.

12. The system of claim 11 , further comprising verifying labeling accuracy of the machine learning model, wherein verifying the labeling accuracy comprises:

labeling, by the machine learning model, the first media sample;

comparing a first label corresponding to the first media sample as labeled by the machine learning model and a second label corresponding to the second media sample as labeled by the machine learning model; and

updating one or more of the values of the saliency map responsive to the first label and the second label being different based on the comparing.

13. The system of claim 11 , further comprising verifying labeling accuracy of the machine learning model, wherein verifying the labeling accuracy comprises:

labeling, by the machine learning model, the first media sample;

comparing a first label corresponding to the first media sample as labeled by the machine learning model and a second label corresponding to the second media sample as labeled by the machine learning model; and

storing the second media sample in a database responsive to the first label and the second label being the same based on the comparing.

14. The system of claim 11 , wherein:

each of the values included in the saliency map describes a degree of compression of a respective element corresponding to a respective encoding parameter.

15. The system of claim 11 , wherein labeling media files by the machine learning model includes at least one of license plate identification, emotion detection, lie detection, background segmentation, facial recognition, or biometrics recognition.

Assignments (6)
RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT R/F 069809/0685 Recorded Jan 26, 2026
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: 214 TECHNOLOGIES INC.
Reel/Frame 074494/0978 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2025
From: CHAFNI, NEZARE
To: 214 TECHNOLOGIES INC.
Reel/Frame 072375/0763 →
RELEASE OF SECURITY INTEREST Recorded Dec 30, 2024
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: 214 TECHNOLOGIES, INC.
Reel/Frame 069700/0921 →
NOTES PATENT SECURITY AGREEMENT Recorded Dec 30, 2024
From: 214 TECHNOLGIES, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 069809/0685 →
SECURITY INTEREST Recorded May 22, 2024
From: 214 TECHNOLOGIES INC.
To: BANK OF AMERICA, N.A., AS THE COLLATERAL AGENT
Reel/Frame 067493/0179 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2024
From: MOORE, SHAUN
To: 214 TECHNOLOGIES, INC.
Reel/Frame 066875/0504 →
Continuity (1)
Related Publication 20230029608A1 · Feb 2, 2023
References Cited (4)
US 20140270553A1 · Zund · 2014 [cited by examiner]
US 20210132688A1 · Kim · 2021 [cited by examiner]
US 20210174497A1 · Yoo · 2021 [cited by examiner]
US 20220382717A1 · Zhang · 2022 [cited by examiner]