IP Library › Granted Patent US 11,861,418
Granted Patent B2
US 11,861,418 · App. 18/155,529 · Granted Jan 2, 2024

Systems and methods to improve data clustering using a meta-clustering model

Inventors: Austin Walters (Savoy, IL); Jeremy Goodsitt (Champaign, IL); Anh Truong (Champaign, IL); Reza Farivar (Champaign, IL)
Assignee: CAPITAL ONE SERVICES, LLC
G06F9/541G06F8/71G06F9/54G06F9/547G06F11/3608G06F11/3628G06F11/3636G06F16/2237G06F16/2264G06F16/248G06F16/2423G06F16/24568G06F16/254G06F16/258G06F16/283G06F16/285G06F16/288G06F16/335G06F16/906G06F16/9038G06F16/90332G06F16/90335G06F16/93G06F17/15G06F17/16G06F17/18G06F18/213G06F18/214G06F18/217G06F18/2115G06F18/2148G06F18/2193G06F18/22G06F18/23G06F18/24G06F18/2411G06F18/2415G06F18/285G06F18/40G06F21/552G06F21/60G06F21/6245G06F21/6254G06F30/20G06F40/117G06F40/166G06F40/20G06N3/04G06N3/044G06N3/045G06N3/08G06N3/088G06N5/00G06N5/02G06N5/04G06N7/00G06N7/01G06N20/00G06Q10/04G06T7/194G06T7/246G06T7/248G06T7/254G06T11/001G06V10/768G06V10/993G06V30/194G06V30/1985H04L63/1416H04L63/1491H04L67/306H04L67/34H04N21/23412H04N21/8153G06T2207/10016G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,861,418
App. No.
18/155,529
Granted
Jan 2, 2024
Kind
B2
Abstract

Systems and methods for clustering data are disclosed. For example, a system may include one or more memory units storing instructions and one or more processors configured to execute the instructions to perform operations. The operations may include receiving data from a client device and generating preliminary clustered data based on the received data, using a plurality of embedding network layers. The operations may include generating a data map based on the preliminary clustered data using a meta-clustering model. The operations may include determining a number of clusters based on the data map using the meta-clustering model and generating final clustered data based on the number of clusters using the meta-clustering model. The operations may include and transmitting the final clustered data to the client device.

Claims (70)

1. A user device, comprising:

one or more memory units storing instructions;

a user interface configured to receive user input; and

one or more processors configured to execute the instructions to perform operations including:

transmitting, to a server, a clustering request, the request configured to cause the server to:

generate, using a plurality of embedding network layers, preliminary data clusters; and

transmit, to the user device for display, a request for user input;

displaying, at the user interface, the request for user input; and

receiving, at the user interface, a user input configured to cause the server to:

generate, using a meta-clustering model, final data clusters based on the preliminary data clusters; and

store the final data clusters.

2. The user device of claim 1 , wherein the request is further configured to cause the server to:

generate an updated embedding network by training a first embedding network layer of the plurality of embedding network layers; and

generate, using the updated embedding network, updated data clusters.

3. The user device of claim 1 , wherein the operations further comprise:

determining to request user input based on a predetermined command to perform supervised model training.

4. The user device of claim 3 , wherein the received user input identifies a data classification category.

5. The user device of claim 1 , wherein the received user input associates tags with data cluster samples.

6. The user device of claim 1 , wherein the operations further comprise receiving, at the user interface, an additional user input configured to cause the server to:

send, to the user device for display on the user interface, at least one of:

the final data clusters;

a visual representation of the final data clusters;

a number of clusters in the final data clusters; or

the meta-clustering model.

7. The user device of claim 6 , wherein the number of clusters is larger than a maximum count of clusters in the preliminary data clusters.

8. The user device of claim 1 , wherein the operations further comprise transmitting, to a server, a clustering request, the clustering request configured to cause the server to:

generate data cluster samples based on the preliminary data clusters; and

generate tags associated with the data cluster samples using the meta-clustering model.

9. The user device of claim 1 , wherein generating preliminary data clusters comprises:

receiving training data;

generating a first embedding network layer of the plurality of embedding network layers;

training the generated first embedding network layer to classify training data; and

training the generated first embedding network layer to cluster training data.

10. The user device of claim 9 , wherein generating preliminary data clusters comprises repeating generating steps, the generating steps comprising:

adding a trained embedding network layer to the plurality of embedding network layers;

generating data clusters using the added trained embedding network layer; and

tagging the data clusters.

11. The user device of claim 10 , wherein the generation of preliminary data clusters terminates when a performance criterion is satisfied.

12. The user device of claim 1 , wherein the preliminary data clusters comprises image data and the embedding network layer comprises a convolutional neural network.

13. The user device of claim 1 , wherein the preliminary data clusters comprises text data and the embedding network layers are part of a language representation model.

14. The user device of claim 1 , wherein the plurality of embedding network layers comprises at least one of a Bidirectional Encoder Representations from Transformers (BERT) model or an Embeddings from Language Models (ELMo) representation model.

15. The user device of claim 1 , wherein the received user input comprises a selection of a multi-clustering model.

16. The user device of claim 1 , wherein generating preliminary data clusters comprises performing at least one of a binary classification or one-hot encoding.

17. A method for clustering data, comprising:

transmitting, to a server, a clustering request configured to cause the server to:

generate, at the server using a plurality of embedding network layers, preliminary data clusters; and

transmit, to a user device for display, a request for user input;

displaying, at the user device, the request for user input; and

receiving, at the user device, a user input configured to cause the server to:

generate, using a meta-clustering model, final data clusters based on the preliminary data clusters; and

store the final data clusters.

18. The method of claim 17 , wherein the received user input associates tags with data cluster samples.

19. A user device for clustering data comprising:

one or more memory units storing instructions;

a user interface configured to receive user input; and

one or more processors configured to execute the instructions to perform operations including:

transmitting, to a server, a clustering request, the clustering request configured to cause the server to generate, using a plurality of embedding network layers, preliminary data clusters;

displaying, at the user interface, a request for user input received from the server; and

receiving, at the user interface, a user input configured to cause the server to:

generate, using a meta-clustering model trained using reduced-dimensionality data clusters, final data clusters based on the preliminary data clusters; and

store the final data clusters.

20. The user device of claim 19 , wherein training the meta-clustering model comprises iteratively repeating training steps until the performance criterion is satisfied, the training steps comprising:

determining, using the meta-clustering model, a number of clusters based on the data map;

generating an updated embedding network based on the number of clusters;

generating updated data clusters using the updated embedding network;

updating the meta-clustering model;

reducing a dimensionality of the updated data clusters;

generating, using the updated meta-clustering model, updated encoded data based on the reduced-dimensionality updated data clusters;

generating an updated data map based on the updated encoded data; and

determining whether the performance criterion is satisfied based on the updated data map.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2023
From: WALTERS, AUSTIN; GOODSITT, JEREMY; TRUONG, ANH; FARIVAR, REZA
To: CAPITAL ONE SERVICES, LLC
Reel/Frame 062398/0659 →
Continuity (4)
Continuation 16889363 · Jun 1, 2020
Continuation 16503428 · Jul 3, 2019
Provisional Application 62694968 · Jul 6, 2018
Related Publication 20230153177A1 · May 18, 2023
Cited By (1)
US 12,657,475