IP Library Granted Patent US 11,645,625
Granted Patent B2
US 11,645,625 · App. 16/546,849 · Granted May 9, 2023

Machine learning systems for predictive targeting and engagement

Inventors: Christina R. Whitehead (Charleston, SC); Joseph W. Hanna (Charleston, SC)
Assignee: JOB MARKET MAKER, LLC
G06Q10/1053G06N5/04G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,645,625
App. No.
16/546,849
Granted
May 9, 2023
Kind
B2
Abstract

Machine learning systems for predictive targeting and optimizing engagement are described herein. In various embodiments, the system includes 1) training a first machine learning computer model to generate machine predicted outcomes; (2) determining weights based on the machine predicted outcomes; (3) generating a second machine learning computer model based on the weights; and (4) generating machine learned predictions for candidates.

Claims (482)

1. A machine learning process for optimized engagement, comprising:

training, with a training set, at least one primary machine learning computer model to generate a plurality of machine predicted outcomes;

determining one or more weights based on the plurality of machine predicted outcomes and the training set;

generating at least one secondary machine learning computer model based on the one or more weights;

generating, via the at least one secondary machine learning computer model, one or more machine learned predictions;

assigning a respective classification to each individual of a plurality of individuals based on the one or more machine learned predictions;

receiving a set of candidate criteria;

processing the set of candidate criteria to identify a subset of individuals from the plurality of individuals that satisfies the set of candidate criteria;

determining a ranking of the subset of individuals based on the respective classification assigned to individual ones of the subset of individuals; and

generating a notification based on the ranking,

wherein the at least one secondary machine learning computer model is generated by combining one or more intermediary machine learning models according to:

E ( x ijg )= E ( f 1 ( x ijg ), . . . , f n ( x ijg ));

wherein:

E(x ijg ) represents the second machine learning model;

f is an intermediary machine learning model;

x is a vector comprising the normalized data of interest;

i is a candidate;

j is a company currently employing the candidate i; and

g is a role performed by the candidate i at the company j.

2. The machine learning process of claim 1 , further comprising:

receiving, from one or more databases, data associated with the plurality of individuals, wherein a portion of the received data is received in response to predetermined data triggers configured to monitor changes to a current status of the received data;

determining, for each individual of the plurality of individuals, data of interest within the received data, the data of interest comprising candidate information, role information, and company information;

normalizing the data of interest into a normalized format to generate normalized data; and

creating, from the normalized data of interest, the training set comprising known parameters and known outcomes.

3. The machine learning process of claim 2 , wherein generating the at least one secondary machine learning computer model comprises:

creating, from the normalized data of interest, a test set with unknown parameters; and

weighting the unknown parameters with the one or more weights.

4. The machine learning process of claim 3 , further comprising:

calculating the one or more weights from the plurality of machine predicted outcomes and the training set; and

weighting the known parameters with the one or more weights via the at least one primary machine learning computer model.

5. The machine learning process of claim 2 , wherein normalizing the data of interest further comprises performing entity resolution on the data of interest.

6. The machine learning process of claim 1 , further comprising:

calculating, for each parameter of each identified individual, an impact score;

determining, for each parameter and based on each impact score, at least one most impactful parameter;

generating a candidate list based on the ranking of the subset of individuals; and

providing, in the candidate list, the at least one most impactful parameter for the individual ones of the subset of individuals.

7. The machine learning process of claim 6 , wherein determining the at least one most impactful parameter comprises one or more feature importance methods.

8. The machine learning process of claim 7 , wherein determining the at least one most impactful parameter further comprises:

determining at least one most positively impactful parameter; and

determining at least one most negatively impactful parameter.

9. A machine learning process for optimized engagement, comprising:

training, with a training set, at least one primary one machine learning computer model to generate a plurality of machine predicted outcomes;

determining one or more weights based on the plurality of machine predicted outcomes and the training set;

generating at least one secondary machine learning computer model based on the one or more weights;

generating, via the at least one secondary machine learning computer model, one or more machine learned predictions;

aggregating the one or more machine learned predictions;

generating, from the aggregated machine learned predictions, a talent retention score; and

sending a notification based on the talent retention score,

wherein the at least one secondary machine learning computer model is generated by combining one or more intermediary machine learning models according to:

E ( x ijg )= E ( f 1 ( x ijg ), . . . , f n ( x ijg ));

wherein:

E(x ijg ) represents the second machine learning model;

f is an intermediary machine learning model;

x is a vector comprising the normalized data of interest;

i is a candidate;

j is a company currently employing the candidate i; and

g is a role performed by the candidate i at the company j.

10. The machine learning process of claim 9 , further comprising:

receiving, from one or more databases, data associated with a plurality of employed individuals, wherein a portion of the received data is received in response to predetermined data triggers configured to monitor changes to a current status of the received data;

determining, for each individual, data of interest within the received data, the data of interest comprising candidate information, role information, and company information;

normalizing the data of interest into a normalized format; and

creating, from the normalized data, the training set comprising known parameters and known outcomes.

11. The machine learning process of claim 10 , wherein the plurality of individuals are employed in a particular department.

12. The machine learning process of claim 10 , wherein the plurality of individuals are employed in a particular location.

13. The machine learning process of claim 10 , wherein the plurality of individuals present a particular experience level.

14. The machine learning process of claim 10 , wherein generating the at least one secondary machine learning computer model comprises:

creating, from the normalized data of interest, a test set with unknown parameters; and

weighting the unknown parameters with the one or more weights.

15. The machine learning process of claim 9 , further comprising:

comparing the talent retention score to one or more predefined thresholds; and

based on the comparison, assigning a classification to the talent retention score, wherein the classification is selected from a group comprising of low, average, and high.

16. A machine learning system for optimized engagement, comprising:

at least one database; and

at least one processor in communication with the at least one database, the at least one processor being configured to:

train, with a training set, at least one primary one machine learning computer model to generate a plurality of machine predicted outcomes;

determine one or more weights based on the plurality of machine predicted outcomes and the training set;

generate at least one secondary machine learning computer model based on the one or more weights;

generate, via the at least one secondary machine learning computer model, one or more machine learned predictions; and

assign a respective classification to each individual of a plurality of individuals based on the one or more machine learned predictions,

wherein the at least one processor, to generate the at least one secondary machine learning model, is further configured to generate the at least one secondary model by combining one or more intermediary machine learning models according to:

E ( x ijg )= E ( f 1 ( x ijg ), . . . , f n ( x ijg ));

wherein:

E(x ijg ) represents the second machine learning model;

f is an intermediary machine learning model;

x is a vector comprising the normalized data of interest;

i is a candidate;

j is a company currently employing the candidate i; and

g is a role performed by the candidate i at the company j.

17. The machine learning system of claim 16 , wherein the at least one processor is further configured to:

receive one or more predetermined triggers configured to monitor changes to a current status of data associated with the plurality of individuals, wherein the one or more predetermined triggers cause the at least one processor to retrieve, from the at least one database, the data associated with the plurality of individuals;

determine a respective data of interest within the retrieved data for each of the plurality of individuals, the respective data of interest comprising candidate information, role information, and company information;

normalize the respective data of interest for each of the plurality of individuals into a normalized format; and

create the training set from the normalized data, the training set comprising known parameters and known outcomes.

18. The machine learning system of claim 17 , wherein:

the candidate information comprises current tenure, average tenure in previous roles, number of previous roles with current company, number of previous roles at other companies, skills, education level, relative pay, previous industries, previous company size, previous company age, geography, and commute time;

the role information comprises title, level, functions, similar open positions, and open growth opportunities; and

the company information comprises company type, company size, age, brand measurements, news and events, and trends in news and events.

19. The machine learning system of claim 18 , wherein the company type is selected from a group comprising: public, private, government, and school.

20. The machine learning system of claim 17 , wherein training comprises:

calculating, from the plurality of machine predicted outcomes and the training set, one or more weights; and

weighting, with the one or more weights and via the at least one primary machine learning computer model, the known parameters.

21. The machine learning system of claim 16 , wherein generating the at least one secondary machine learning computer model comprises:

creating, from normalized data of interest, a test set with unknown parameters; and

weighting the unknown parameters with the one or more weights.

22. The machine learning system of claim 16 , wherein the at least one processor is further configured to:

compare the one or more machine learned predictions and the classifications to third-party data from the at least one database;

determine particular language comprising subject lines and keywords from the third-party data that is likely to elicit a response from each of the plurality of individuals, based on the one or more machine learned predictions and the classifications; and

generate one or more strings of text via natural language processing, wherein the one or more strings of text comprise language substantially similar to the particular language.

23. The machine learning system of claim 22 , wherein the at least one processor, to generate the one or more strings of text, is further configured to select at least a portion of the one or more strings of text using at least one conditional logic process.

24. A machine learning system for optimized engagement, comprising:

at least one database; and

at least one processor in communication with the at least one database, the at least one processor being configured to:

train, with a training set, at least one primary one machine learning computer model to generate a plurality of machine predicted outcomes;

determine one or more weights based on the plurality of machine predicted outcomes and the training set;

generate at least one secondary machine learning computer model based on the one or more weights;

generate, via the at least one secondary machine learning computer model, one or more machine learned predictions; and

assign a respective classification to each individual of a plurality of individuals based on the one or more machine learned predictions,

wherein the at least one processor, to assign the classification, is configured to evaluate and assign each of the one or more machine learned predictions according to:

c

(

x

ijg

)

=

{

candidate

is

least

likely

to

ENGAGE

if

h

(

x

ijg

)

<

h

0

candidate

may

ENGAGE

if

h

0

<

h

(

x

ijg

)

<

h

1

candidate

is

more

likely

to

ENGAGE

h

1

<

h

(

x

ijg

)

<

h

2

candidate

is

most

likely

to

ENGAGE

h

(

x

ijg

)

>

h

2

;

wherein:

h(x ijg ) is a machine learned prediction from the one or more machine learned predictions;

h 0 is a predefined will-not-engage threshold;

h 1 is a predefined may-engage threshold;

h 2 is a predefined more-likely-to-engage threshold; and

c(x ijg ) is the classification to which each one the one or more machine learned predictions is assigned.

25. The machine learning system of claim 16 , wherein the at least one processor is further configured to:

retrieve, from the at least one database, a plurality of historical classifications associated with the plurality of individuals;

determine, for each individual, if a historical classification matches the assigned classification;

upon determining, for a particular individual, that the assigned classification does not match the historical classification, determine if the particular individual is included on a recruitment watch list; and

upon determining, that the particular individual is included on the recruitment watch list, automatically generate and transmit, to a profile associated with the recruitment watch list, an alert describing that a classification for the particular individual has changed.

26. The machine learning system of claim 25 , wherein the assigned classification of the particular individual is determined to exceed the historical classification.

27. The machine learning system of claim 16 , wherein the at least one processor is further configured to generate, for each individual, a data visualization comprising the classification and the one or more machine learned predictions.

28. The machine learning system of claim 27 , wherein the data visualization is a radar chart.

29. A machine learning process for optimized engagement, comprising:

training, with a training set, at least one primary machine learning computer model to generate a plurality of machine predicted outcomes;

determining one or more weights based on the plurality of machine predicted outcomes and the training set;

generating at least one secondary machine learning computer model based on the one or more weights;

generating, via the at least one secondary machine learning computer model, one or more machine learned predictions;

assigning a respective classification to each individual of a plurality of individuals based on the one or more machine learned predictions;

receiving a set of candidate criteria;

processing the set of candidate criteria to identify a subset of individuals from the plurality of individuals that satisfies the set of candidate criteria;

determining a ranking of the subset of individuals based on the respective classification assigned to individual ones of the subset of individuals; and

generating a notification based on the ranking,

wherein the assigning the classification to each individual of the plurality of individuals further comprises evaluating and assigning each of the one or more machine learned predictions according to:

c

(

x

ijg

)

=

{

candidate

is

least

likely

to

ENGAGE

if

h

(

x

ijg

)

<

h

0

candidate

may

ENGAGE

if

h

0

<

h

(

x

ijg

)

<

h

1

candidate

is

more

likely

to

ENGAGE

h

1

<

h

(

x

ijg

)

<

h

2

candidate

is

most

likely

to

ENGAGE

h

(

x

ijg

)

>

h

2

wherein:

h(x ijg ) is a machine learned prediction from the one or more machine learned predictions;

h 0 is a predefined will-not-engage threshold;

h 1 is a predefined may-engage threshold;

h 2 is a predefined more-likely-to-engage threshold; and

c(x ijg ) is the classification to which each one the one or more machine learned predictions is assigned.

30. A machine learning process for optimized engagement, comprising:

training, with a training set, at least one primary one machine learning computer model to generate a plurality of machine predicted outcomes;

determining one or more weights based on the plurality of machine predicted outcomes and the training set;

generating at least one secondary machine learning computer model based on the one or more weights;

generating, via the at least one secondary machine learning computer model, one or more machine learned predictions;

assigning a respective classification to each individual of a plurality of individuals based on the one or more machine learned predictions;

aggregating the one or more machine learned predictions;

generating, from the aggregated machine learned predictions, a talent retention score; and

sending a notification based on the talent retention score,

wherein the assigning the classification to each individual of the plurality of individuals further comprises evaluating and assigning each of the one or more machine learned predictions according to:

c

(

x

ijg

)

=

{

candidate

is

least

likely

to

ENGAGE

if

h

(

x

ijg

)

<

h

0

candidate

may

ENGAGE

if

h

0

<

h

(

x

ijg

)

<

h

1

candidate

is

more

likely

to

ENGAGE

h

1

<

h

(

x

ijg

)

<

h

2

candidate

is

most

likely

to

ENGAGE

h

(

x

ijg

)

>

h

2

wherein:

h(x ijg ) is a machine learned prediction from the one or more machine learned predictions;

h 0 is a predefined will-not-engage threshold;

h 1 is a predefined may-engage threshold;

h 2 is a predefined more-likely-to-engage threshold; and

c(x ijg ) is the classification to which each one the one or more machine learned predictions is assigned.

Assignments (4)
CHANGE OF NAME Recorded Jun 26, 2023
From: JOB MARKET MAKER, LLC
To: MAGNIT JMM, LLC
Reel/Frame 064106/0891 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 21, 2021
From: APC WORKFORCE SOLUTIONS, LLC; JOB MARKET MAKER, LLC
To: CITIZENS BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 058219/0853 →
SECURITY INTEREST Recorded Oct 20, 2021
From: RAPTOR ACQUISITION HOLDINGS, LLC; RAPTOR ACQUISITION, LLC.; ZEROCHAOS PARENT, LLC.; ZEROCHAOS HOLDINGS, LLC.; APC WORKFORCE SOLUTIONS III, LLC.; ENGAGE TALENT, LLC.; QUICK ACQUISITION, LLC.; APC WORKFORCE SOLUTIONS, LLC.; APC WORKFORCE SOLUTIONS II, LLC.; ZEROCHAOS, LLC.; JOB MARKET MAKER, LLC.
To: U.S. BANK NATIONAL ASSOCIATION, AS THE COLLATERAL AGENT
Reel/Frame 057850/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2019
From: WHITEHEAD, CHRISTINA R.; HANNA, JOSEPH W.
To: JOB MARKET MAKER, LLC
Reel/Frame 050213/0162 →
Continuity (2)
Provisional Application 62720580 · Aug 21, 2018
Related Publication 20200065772A1 · Feb 27, 2020