IP Library Patent Application 17120392
Patent Application
App. No. 17/120,392

SYSTEMS AND METHODS FOR LABELING DATA

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
17/120,392
Abstract

An artificial intelligence (AI) system may be configured to efficiently annotate most if not all unlabeled image data. Some embodiments may: provide, to an object-detection, machine-learning (ML) model, a plurality of unlabeled data such that the object-detection model predicts a plurality of regions; correct at least one vertex of bounds of at least one of the regions such that the bounds fit tighter around an object; convert the regions to first subregions by cropping the first subregions from the unlabeled data; and provide the first subregions to an embedding, ML model configured to output feature vectors for each of the first subregions.

Claims (46)

1 . A method for labeling data, the method comprising the following steps:

A) providing, to an object-detection, machine-learning (ML) model, a plurality of unlabeled data such that the object-detection model predicts a plurality of regions;

B) correcting at least one vertex of bounds of at least one of the regions such that the bounds fit tighter around an object;

C) converting the regions to first subregions by cropping the first subregions from the unlabeled data; and

D) providing the first subregions to an embedding, ML model configured to output feature vectors for each of the first subregions.

2 . The method of claim 1 , further comprising:

cropping second subregions from labeled data; and

outputting, via the embedding model for each of the second subregions, feature vectors.

3 . The method of claim 2 , further comprising:

clustering the feature vectors of the first subregions into a plurality of clusters.

4 . The method of claim 3 , further comprising:

removing, via a user interface, the feature vectors of any cluster that do not resemble other objects in a same cluster.

5 . The method of claim 4 , further comprising:

automatically assigning a label to all of the feature vectors of the each first subregion in one of the clusters based on a similarity with the feature vectors of one of the second subregions; and

automatically assigning a different label to all of the feature vectors of the each first subregion in another one of the clusters based on a similarity with the feature vectors of another one of the second subregions.

6 . The method of claim 2 , further comprising:

augmenting the labeled data by storing the automatically-labeled subregions with the labeled data; and

repeating steps A-D using the augmented data and a new set of unlabeled data.

7 . The method of claim 2 , wherein the embedding model reduces dimensionality in the outputting of the feature vectors.

8 . The method of claim 6 , further comprising:

training both the object-detection model and the embedding model using the labeled data or the augmented data.

9 . A method for labeling data, the method comprising:

obtaining labeled data;

cropping second subregions from the labeled data; and

obtaining first subregions that are cropped from regions predicted by an object-detection model;

outputting, via an embedding model for each of the first and second subregions, feature vectors; and

clustering the feature vectors of the first subregions such that a label is determined for all subregions of each cluster, each of the determinations being based on the feature vectors of the second subregions.

10 . The method of claim 9 , wherein the embedding model is an ML model trained via supervised learning using the labeled data, and wherein the object-detection model is another different ML model trained via supervised learning using the labeled data.

11 . The method of claim 9 , further comprising:

removing, via a user interface, the feature vectors of any cluster that do not resemble other objects in a same cluster.

12 . The method of claim 9 , further comprising:

automatically assigning a label to all of the feature vectors of the each first subregion in one of the clusters based on a similarity with the feature vectors of one of the second subregions; and

automatically assigning a different label to all of the feature vectors of the each first subregion in another one of the clusters based on a similarity with the feature vectors of another one of the second subregions.

13 . The method of claim 12 , further comprising:

augmenting the labeled data by storing the automatically-labeled subregions with the labeled data.

14 . The method of claim 9 , wherein the embedding model reduces dimensionality in the outputting of the feature vectors.

15 . The method of claim 13 , further comprising:

training both the object-detection model and the embedding model using the augmented data.

16 . A system, comprising:

a first pipeline for creating first subregions from regions predicted in real-time; and

a second pipeline for creating second subregions from labeled regions and for labeling the first subregions, respectively in each of the clusters, using feature vectors generated from the second subregions.

17 . The system of claim 16 , wherein the first pipeline comprises a first ML model that is trained via supervised learning, and

wherein the second pipeline comprises a second ML model that is trained via triplet loss.

18 . The system of claim 17 , wherein the labeling is performed by clustering the first subregions into a plurality of clusters using feature vectors generated from the first subregions.

19 . The system of claim 18 , wherein all of the feature vectors are generated as part of the second pipeline.

20 . The system of claim 19 , wherein the first and second pipelines are reentered, and wherein the first and second ML models are retrained, using the labeled first subregions.

Assignments (3)
NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Recorded Jan 22, 2025
From: CACI, INC. - FEDERAL
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 069987/0475 →
NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Recorded Dec 13, 2021
From: CACI, INC. - FEDERAL
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 058741/0731 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2021
From: STAUDINGER, TYLER; MASSEY, ROSS; KERN, WOLFGANG; HALMES, JASEN; VON STROH, JONATHAN; WALLACE, TROY; HUNTLEY, THOMAS GORDON WALTER; PULA, JON KYLE
To: CACI, INC. - FEDERAL
Reel/Frame 055560/0831 →