IP Library Granted Patent US 10,942,627
Granted Patent B2
US 10,942,627 · App. 16/660,603 · Granted Mar 9, 2021

User interface based variable machine modeling

Inventors: Matthew Maclean (New York, NY); Benjamin Duffield (New York, NY); Mark Elliot (London, GB)
Assignee: Palantir Technologies Inc.
G06F3/0482G06F3/04817G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,942,627
App. No.
16/660,603
Granted
Mar 9, 2021
Kind
B2
Abstract

In various example embodiments, a comparative modeling system is configured to receive selections of a data set, a transform scheme, and one or more machine-learning algorithms. In response to a selection of the one or more machine-learning algorithms, the comparative modeling system determines parameters within the one or more machine-learning algorithms. The comparative modeling system generates a plurality of models for the one or more machine-learning algorithms, determines comparison metric values for the plurality of models, and causes presentation of the comparison metric values for the plurality of models.

Claims (59)

1. A method, comprising:

causing, by one or more processors of a machine, presentation of a graphical user interface having a set of selectable graphical interface elements including a first graphical interface element representing a set of data sets, a second graphical interface element representing a set of model families, each model family comprising a family identification and a set of code for a particular machine-learning algorithm that generates a particular machine-learning model for one or more values;

receiving, by the one or more processors of the machine, a selection of a particular data set through the graphical user interface, the particular data set including a set of values;

receiving, by the one or more processors of the machine, a selection of a first machine-learning algorithm and a second machine-learning algorithm through the graphical user interface, the first machine-learning algorithm configured to generate a first machine-learning model for the set of values and the second machine-learning algorithm configured to generate a second machine-learning model for the set of values; and

in response to selection of the first machine-learning algorithm and the second machine-learning algorithm:

iteratively executing, by the one or more processors of the machine, the first machine-learning algorithm, using a first iteration order, using two or more first parameters, a first iteration interval for each of the two or more first parameters, and a first iteration value for the two or more first parameters, to process the set of values of the particular data set and generate a plurality of first machine-learning models, each first iteration value representing a upper bound or a lower bound for a respective first parameter;

iteratively executing, by the one or more processors of the machine, the second machine-learning algorithm, using a second iteration order, using two or more second parameters, a second iteration interval for each of the two or more second parameters, and a second iteration value for the two or more second parameters, to process the set of values of the particular data set and generate a plurality of second machine-learning models, each second iteration value representing a upper bound or a lower bound for a respective second parameter;

determining, by the one or more processors of the machine, one or more comparison metric values for data output by each of the plurality of first machine-learning models and the plurality of second machine-learning models; and

causing presentation, by the one or more processors of the machine, of the comparison metric values for the data output by the plurality of first machine-learning models and the plurality of second machine-learning models, the presentation comprising a selectable user interface element configured to cause the presentation of a result of at least one of a first machine learning model or a second machine learning model, the result comprising at least one of the comparison metric values.

2. The method of claim 1 , further comprising:

determining a first iteration order for a first parameter within the first machine-learning algorithm and a second iteration order for a second parameter within the second machine-learning algorithm, the first machine-learning algorithm being executed according to the first iteration order and the second machine-learning algorithm being executed according to the second iteration order.

3. The method of claim 1 , wherein executing the first machine-learning algorithm further comprises:

generating a first set of machine-learning models for the set of values, each machine-learning model of the first set of machine-learning models corresponding to a different first iteration value of each first parameter of two or more first parameters within the first machine-learning algorithm.

4. The method of claim 1 , wherein executing the second machine-learning algorithm further comprises:

generating a second set of machine-learning models for the set of values, each machine-learning model of the second set of machine-learning models corresponding to a different second iteration value of each second parameter of two or more second parameters within the second machine-learning algorithm.

5. The method of claim 1 , wherein the set of model families comprises a predetermined set of model families, the method further comprising:

receiving an additional model family including another family identification and another set of code for an additional machine-learning algorithm for generating another model for the set of values;

incorporating the additional model family into the set of model families; and

generating a selectable graphical interface element for the additional model family within the second graphical interface element.

6. A computer implemented system, comprising:

one or more processors; and

a machine-readable storage device comprising processor-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

causing presentation of a graphical user interface having a set of selectable graphical interface elements including a first graphical interface element representing a set of data sets, a second graphical interface element representing a set of model families, each model family comprising a family identification and a set of code for a particular machine-learning algorithm that generates a particular machine-learning model for one or more values;

receiving a selection of a particular data set through the graphical user interface, the particular data set including a set of values;

receiving a selection of a first machine-learning algorithm and a second machine-learning algorithm through the graphical user interface, the first machine-learning algorithm configured to generate a first machine-learning model for the set of values and the second machine-learning algorithm configured to generate a second machine-learning model for the set of values; and

in response to selection of the first machine-learning algorithm and the second machine-learning algorithm:

iteratively executing the first machine-learning algorithm, using a first iteration order, using two or more first parameters, a first iteration interval for each of the two or more first parameters, and a first iteration value for the two or more first parameters, to process the set of values of the particular data set and generate a plurality of first machine-learning models, each first iteration value representing a upper bound or a lower bound for a respective first parameter;

iteratively executing the second machine-learning algorithm, using a second iteration order, using two or more second parameters, a second iteration interval for each of the two or more second parameters, and a second iteration value for the two or more second parameters, to process the set of values of the particular data set and generate a plurality of second machine-learning models, each second iteration value representing a upper bound or a lower bound for a respective second parameter;

determining one or more comparison metric values for data output by each of the plurality of first machine-learning models and the plurality of second machine-learning models; and

causing presentation of the comparison metric values for the data output by the plurality of first machine-learning models and the plurality of second machine-learning models, the presentation comprising a selectable user interface element configured to cause the presentation of a result of at least one of a first machine learning model or a second machine learning model, the result comprising at least one of the comparison metric values.

7. The system of claim 6 , wherein the operations further comprise:

determining a first iteration order for a first parameter within the first machine-learning algorithm and a second iteration order for a second parameter within the second machine-learning algorithm, the first machine-learning algorithm being executed according to the first iteration order and the second machine-learning algorithm being executed according to the second iteration order.

8. The system of claim 6 , wherein executing the first machine-learning algorithm further comprises:

generating a first set of machine-learning models for the set of values, each machine-learning model of the first set of machine-learning models corresponding to a different first iteration value of each first parameter of two or more first parameters within the first machine-learning algorithm.

9. The system of claim 6 , wherein executing the second machine-learning algorithm further comprises:

generating a second set of machine-learning models for the set of values, each machine-learning model of the second set of machine-learning models corresponding to a different second iteration value of each second parameter of two or more second parameters within the second machine-learning algorithm.

10. The system of claim 6 , wherein the set of model families comprises a predetermined set of model families, the operations further comprising:

receiving an additional model family including another family identification and another set of code for an additional machine-learning algorithm for generating another model for the set of values;

incorporating the additional model family into the set of model families; and

generating a selectable graphical interface element for the additional model family within the second graphical interface element.

11. A machine-readable storage device comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

causing presentation of a graphical user interface having a set of selectable graphical interface elements including a first graphical interface element representing a set of data sets, a second graphical interface element representing a set of model families, each model family comprising a family identification and a set of code for a particular machine-learning algorithm that generates a particular machine-learning model for one or more values;

receiving a selection of a particular data set through the graphical user interface, the particular data set including a set of values;

receiving a selection of a first machine-learning algorithm and a second machine-learning algorithm through the graphical user interface, the first machine-learning algorithm configured to generate a first machine-learning model for the set of values and the second machine-learning algorithm configured to generate a second machine-learning model for the set of values; and

in response to selection of the first machine-learning algorithm and the second machine-learning algorithm:

iteratively executing the first machine-learning algorithm, using a first iteration order, using two or more first parameters, a first iteration interval for each of the two or more first parameters, and a first iteration value for the two or more first parameters, to process the set of values of the particular data set and generate a plurality of first machine-learning models, each first iteration value representing a upper bound or a lower bound for a respective first parameter;

iteratively executing the second machine-learning algorithm, using a second iteration order, using two or more second parameters, a second iteration interval for each of the two or more second parameters, and a second iteration value for the two or more second parameters, to process the set of values of the particular data set and generate a plurality of second machine-learning models, each second iteration value representing a upper bound or a lower bound for a respective second parameter;

determining one or more comparison metric values for data output by each of the plurality of first machine-learning models and the plurality of second machine-learning models; and

causing presentation of the comparison metric values for the data output by the plurality of first machine-learning models and the plurality of second machine-learning models, the presentation comprising a selectable user interface element configured to cause the presentation of a result of at least one of a first machine learning model or a second machine learning model, the result comprising at least one of the comparison metric values.

12. The machine-readable storage device of claim 11 , wherein the operations further comprise:

determining a first iteration order for a first parameter within the first machine-learning algorithm and a second iteration order for a second parameter within the second machine-learning algorithm, the first machine-learning algorithm being executed according to the first iteration order and the second machine-learning algorithm being executed according to the second iteration order.

13. The machine-readable storage device of claim 11 wherein executing the first machine-learning algorithm further comprises:

generating a first set of machine-learning models for the set of values, each machine-learning model of the first set of machine-learning models corresponding to a different first iteration value of each first parameter of two or more first parameters within the first machine-learning algorithm.

14. The machine-readable storage device of claim 11 , wherein executing the second machine-learning algorithm further comprises:

generating a second set of machine-learning models for the set of values, each machine-learning model of the second set of machine-learning models corresponding to a different second iteration value of each second parameter of two or more second parameters within the second machine-learning algorithm.

15. The machine-readable storage device of claim 11 , wherein the set of model families comprises a predetermined set of model families, the operations further comprising:

receiving an additional model family including another family identification and another set of code for an additional machine-learning algorithm for generating another model for the set of values;

incorporating the additional model family into the set of model families; and

generating a selectable graphical interface element for the additional model family within the second graphical interface element.

Assignments (3)
SECURITY INTEREST Recorded Jul 3, 2022
From: PALANTIR TECHNOLOGIES INC.
To: WELLS FARGO BANK, N.A.
Reel/Frame 060572/0506 →
SECURITY INTEREST Recorded Jun 4, 2020
From: PALANTIR TECHNOLOGIES INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 052856/0817 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2019
From: MACLEAN, MATTHEW; DUFFIELD, BENJAMIN; ELLIOT, MARK
To: PALANTIR TECHNOLOGIES INC.
Reel/Frame 050795/0377 →
Cited By (1)
US 12,681,621