IP Library Granted Patent US 11,775,408
Granted Patent B2
US 11,775,408 · App. 16/983,146 · Granted Oct 3, 2023

Sparse intent clustering through deep context encoders

Inventors: Allan Barcelos (Porto Alegre, BR); Fernanda Tosca (Porto Alegre, BR); Israel Oliveira (Porto Alegre, BR); Leandro Bianchini (Porto Alegre, BR); Renata Palazzo (Porto Alegre, BR)
Assignee: ADP, INC.
G06F11/3072G06F16/35G06N3/045G06N3/084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,775,408
App. No.
16/983,146
Granted
Oct 3, 2023
Kind
B2
Abstract

A method of sparse intent clustering is provided. The method comprises identifying features in a number of electronic user reports created by a user and contained in a database, wherein the features include a title and description. The features of each user report are encoded into a binary vector. The binary vector for each user report is fed into an autoencoder neural network that creates a N-dimensional vector representing the user report. The float vectors representing the user reports are projected into a N-dimensional space. The float vectors are clustered according to cosine similarities, wherein each vector cluster represents an intent of the user in creating the reports. The intent of each vector cluster is then labeled.

Claims (63)

1. A computer-implemented method of sparse intent clustering, the method comprising:

using a number of processors to perform the steps of:

identifying features in a number of electronic user reports created by a user and contained in a database, wherein the features include a title and description;

encoding the features of each user into a binary vector to form a matrix representing the number of electronic user reports, wherein each row of the matrix represents a vector of different user report and, each column of the matrix represents a different features of the features for the user report;

feeding the binary vector for each user report from the matrix into an autoencoder neural network, wherein the autoencoder neural network generates float vectors by generating a N-dimensional float vector representing the user report for each user report, and wherein the N-dimensional float vector comprises floating point numbers with fractional parts;

projecting the float vectors representing the user reports into a N-dimensional space;

clustering the float vectors into vector clusters according to cosine similarities, wherein each vector cluster represents an intent of the user in creating the reports;

labeling the intent of each vector cluster;

receiving input from the user to create a new user report, wherein the input includes a title and description for the new user report;

determining an intent of the new user report according to the input;

identifying a vector cluster labeled with an intent that matches the intent of the new user report; and

providing the user with suggested features for the new user report according to features in the vector cluster identified with the matching intent.

2. The method of claim 1 , wherein encoding the features of each user report comprises one-hot encoding a number of fields in the user report.

3. The method of claim 1 , wherein encoding the features of each user report comprises:

decomposing equations of a number of filters in the user report to produce decomposed filters; and

one-hot encoding the decomposed filters.

4. The method of claim 1 , wherein encoding the features of each user report comprises:

decomposing equations of a number of custom fields in the user report to produce decomposed custom fields; and

one-hot encoding the decomposed custom fields.

5. The method of claim 1 , wherein encoding the features of each user report comprises encoding the title and description with embeddings from language models.

6. The method of claim 1 , wherein vectors within each cluster have cosine similarities above 0.5.

7. A system for sparse intent clustering, the system comprising:

a storage device configured to store program instructions; and

one or more processors operably connected to the storage device and configured to execute the program instructions to cause the system to:

identify features in a number of electronic user reports created by a user and contained in a database, wherein the features include a title and description;

encode the features of each user report into a binary vector to form a matrix representing the number of electronic user reports, wherein each row of the matrix represents a vector of different user report and, each column of the matrix represents a different feature of the features for the user report;

feed the binary vector for each user report from the matrix into an autoencoder neural network, wherein the autoencoder neural network generates float vectors by generating a N-dimensional float vector representing the user report for each user report, and wherein the N-dimensional float vector comprises floating point numbers with fractional parts;

project the float vectors representing the user reports into a N-dimensional space;

cluster the float vectors into vector clusters according to cosine similarities, wherein each vector cluster represents an intent of the user in creating the reports;

label the intent of each vector cluster

receive input from the user to create a new user report, wherein the input includes a title and description for the new user report;

determine an intent of the new user report according to the input;

identify a vector cluster labeled with an intent that matches the intent of the new user report; and

provide the user with suggested features for the new user report according to features in the vector cluster identified with the matching intent.

8. The system of claim 7 , wherein encoding the features of each user report comprises one-hot encoding a number of fields in the user report.

9. The system of claim 7 , wherein encoding the features of each user report comprises:

decomposing equations of a number of filters in the user report to produce decomposed filters; and

one-hot encoding the decomposed filters.

10. The system of claim 7 , wherein encoding the features of each user report comprises:

decomposing equations of a number of custom fields in the user report to produce decomposed custom fields; and

one-hot encoding the decomposed custom fields.

11. The system of claim 7 , wherein encoding the features of each user report comprises encoding the title and description with embeddings from language models.

12. A computer program product for sparse intent clustering, the computer program product comprising:

a computer-readable storage medium having program instructions embodied thereon to perform the steps of:

identifying features in a number of electronic user reports created by a user and contained in a database, wherein the features include a title and description;

encoding the features of each user report into a binary vector to form a matrix representing the number of electronic user reports, wherein each row of the matrix represents a vector of different user report and, each column of the matrix represents a different feature of the features for the user report;

feeding the binary vector for each user report from the matrix into an autoencoder neural network, wherein the autoencoder neural network generates float vectors by generating a N-dimensional float vector representing the user report for each user report, and wherein the N-dimensional float vector comprises floating point numbers with fractional parts;

projecting the float vectors representing the user reports into a N-dimensional space;

clustering the float vectors into vector clusters according to cosine similarities, wherein each vector cluster represents an intent of the user in creating the reports; and

labeling the intent of each vector cluster

receiving input from the user to create a new user report, wherein the input includes a title and description for the new user report;

determining an intent of the new user report according to the input;

identifying a vector cluster labeled with an intent that matches the intent of the new user report; and

providing the user with suggested features for the new user report according to features in the vector cluster identified with the matching intent.

13. The computer program product of claim 12 , wherein encoding the features of each user report comprises one-hot encoding a number of fields in the user report.

14. The computer program product of claim 12 , wherein encoding the features of each user report comprises:

decomposing equations of a number of filters in the user report to produce decomposed filters; and

one-hot encoding the decomposed filters.

15. The computer program product of claim 12 , wherein encoding the features of each user report comprises:

decomposing equations of a number of custom fields in the user report to produce decomposed custom fields; and

one-hot encoding the decomposed custom fields.

16. The computer program product of claim 12 , wherein encoding the features of each user report comprises encoding the title and description with embeddings from language models.

17. The computer program product of claim 12 , wherein vectors within each cluster have cosine similarities above 0.5.

Assignments (2)
CHANGE OF NAME Recorded Feb 4, 2022
From: ADP, LLC
To: ADP, INC.
Reel/Frame 058959/0729 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2020
From: BARCELOS, ALLAN; TOSCA, FERNANDA; OLIVEIRA, ISRAEL; BIANCHINI, LEANDRO; PALAZZO, RENATA
To: ADP, LLC
Reel/Frame 053381/0686 →