IP Library Granted Patent US 11,308,423
Granted Patent B2
US 11,308,423 · App. 15/395,244 · Granted Apr 19, 2022

Update of a machine learning system

Inventor: Xavier Grehant (Colombes, FR)
Assignee: DASSAULT SYSTEMES
G06N20/20G06F16/35G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,308,423
App. No.
15/395,244
Granted
Apr 19, 2022
Kind
B2
Abstract

The invention notably relates to a computer-implemented method for updating a model of a machine learning system. The method comprises providing a first set of observations of similar events, each observation being associated with one or more variables, each variable being associated with a value, and with a target value; indexing each observation of the first set with its corresponding one or more variables and target value; receiving, on the index, a query allowing a selection of a subset of the first set of observations; returning, as a result of the query, a subset of the first set of observations; providing a second model; training the provided second model with the returned subset of the first set of observations; and loading the trained second model.

Claims (60)

1. A computer-implemented method for updating a model configured to output predictions on a system, comprising:

obtaining a first set of observations of similar events, each observation being a set of one or more variables representing a state of the system at a given point in time, each variable being associated with a value corresponding to the observation, each observation being associated with a target value, the target value being a value of a target variable of the observation, the target variable being a variable representing a prediction of a behavior of the system for the observation;

generating an index of the observations of the first set by indexing each observation of the first set with its corresponding one or more variables and target value so that each observation of the first set can be retrieved from the index with a search based on at least one exact value of a variable of the observation;

obtaining the model;

training the obtained model with the first set of observations, the model being trained for, based on a given observation, evaluating a corresponding target variable;

storing the trained model;

collecting a second set of observations of current events that are similar to the events of the first set of observations, each observation of the second set being a set of variables, the observations of the second set including at least the same variables as the observations of the first set;

filtering the variables of the observations of the second set by identifying, from the variables of the observations of the second set, variables that exhibit a smaller variance in a number of successive observations in the second set of observations than that of one or more other variables of the variables of the observations of the second set;

receiving, on the index, a query allowing a selection of a subset of the first set of observations, the query being performed with one or more of the identified variables of the second set of observations and specifying the values of the one or more of the identified variables so that the subset is retrieved based on the exact values of the one or more of the identified variables;

returning, as a result of the query, a subset of the first set of observations;

obtaining the model trained with the first set of observations;

training the model with the returned subset of the first set of observations, the model being trained for, based on a given observation, evaluating a corresponding target variable; and

loading the model trained with the returned subset of the first set of observations, for use.

2. The computer-implemented method of claim 1 , further comprising:

identifying one or more unknown variables among the variables of the second set of observations, an unknown variable being a variable having one or more missing values; and

indexing each observation of the second set associated with the identified one or more unknown variables, the indexing of each observation of the second set being performed with the corresponding one or more variables and target value of each observation of the second set.

3. The computer-implemented method of claim 1 , wherein collecting the second set of observations further comprises:

collecting in real time the second set of observations;

storing the collected second set of observations; and

providing an access to the collected second set of observations before a predetermined period of time elapsed.

4. The computer-implemented method of claim 1 , further comprising after loading the trained model:

providing one or more options by setting input variables of a set of input variables with a value; and

computing an outcome for the trained model by using the provided one or more options.

5. The computer-implemented method of claim 4 , wherein providing one or more options further comprises:

computing combinations of the values of input variables, and

wherein computing an outcome for the trained model further comprises:

computing an outcome for the trained model by using the combinations computed.

6. The computer-implemented method of claim 5 , further comprising

after computing combinations of the values of input variables:

receiving values of variables of the second set of observations,

computing combinations of the values of input variables and values of variables of the second set of observations, and

computing an outcome for the trained model by using the combinations of the values of input variables and of variables of the second set of second observations.

7. A non-transitory computer readable storage medium having recorded thereon a computer program that when executed by a computer causes the computer to implement a method for updating a model configured to output predictions on a system, the method comprising:

obtaining a first set of observations of similar events, each observation being a set of one or more variables representing a state of the system at a given point in time, each variable being associated with a value corresponding to the observation, each observation being associated with a target value, the target value being a value of a target variable of the observation, the target variable being a variable representing a prediction of a behavior of the system for the observation;

generating an index of the observations of the first set by indexing each observation of the first set with its corresponding one or more variables and target value so that each observation of the first set can be retrieved from the index with a search based on at least one exact value of a variable of the observation;

obtaining the model;

training the obtained model with the first set of observations, the model being trained for, based on a given observation, evaluating a corresponding target variable;

storing the trained model;

collecting a second set of observations of current events that are similar to the events of the first set of observations, each observation of the second set being a set of variables, the observations of the second set including at least the same variables as the observations of the first set;

filtering the variables of the observations of the second set by identifying, from the variables of the observations of the second set, variables that exhibit a smaller variance in a number of successive observations in the second set of observations than that of one or more other variables of the variables of the observations of the second set;

receiving, on the index, a query allowing a selection of a subset of the first set of observations, the query being performed with one or more of the identified variables of the second set of observations and specifying the values of the one or more of the identified variables so that the subset is retrieved based on the exact values of the one or more of the identified variables;

returning, as a result of the query, a subset of the first set of observations;

obtaining the model trained with the first set of observations;

training the model with the returned subset of the first set of observations, the model being trained for, based on a given observation, evaluating a corresponding target variable; and

loading the model trained with the returned subset of the first set of observations, for use.

8. A server comprising:

processing circuitry coupled to a memory, the memory having recorded thereon a computer program for updating a model configured to output predictions on a system, the processing circuitry implementing the computer program by being configured to:

obtain a first set of observations of similar events, each observation being a set of one or more variables representing a state of the system at a given point in time, each variable being associated with a value corresponding to the observation, each observation being associated with a target value, the target value being a value of a target variable of the observation, the target variable being a variable representing a prediction of a behavior of the system for the observation;

generate an index of the observations of the first set by indexing each observation of the first set with its corresponding one or more variables and target value so that each observation of the first set can be retrieved from the index with a search based on at least one exact value of a variable of the observation;

obtain the model;

train the obtained model with the first set of observations, the model being trained for, based on a given observation, evaluating a corresponding target variable;

store the trained model;

collect a second set of observations of current events that are similar to the events of the first set of observations, each observation of the second set being a set of variables, the observations of the second set including at least the same variables as the observations of the first set;

filter the variables of the observations of the second set by identifying, from the variables of the observations of the second set, variables that exhibit a smaller variance in a number of successive observations in the second set of observations than that of one or more other variables of the variables of the observations of the second set,

receive, on the index, a query allowing a selection of a subset of the first set of observations, the query being performed with one or more of the identified variables of the second set of observations and specifying the values of the one or more of the identified variables so that the subset is retrieved based on the exact values of the one or more of the identified variables;

return, as a result of the query, a subset of the first set of observations;

obtain the model trained with the first set of observations;

train the model with the returned subset of the first set of observations, the model being trained for, based on a given observation, evaluating a corresponding target variable; and

load the model trained with the returned subset of the first set of observations, for use.

9. The server of claim 8 , wherein the server is connected to a client computer from which the query on the index is generated.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2017
From: GREHANT, XAVIER
To: DASSAULT SYSTEMES
Reel/Frame 042687/0053 →
Priority Claims (1)
EP 15307196 · Dec 31, 2015 · regional
Continuity (1)
Related Publication 20170193402A1 · Jul 6, 2017