ENSEMBLE MANAGEMENT FOR DIGITAL TWIN CONCEPT DRIFT USING LEARNING PLATFORM
Some embodiments provide systems and methods associated with an industrial asset. An ensemble of learners (e.g., base learner models) may comprise a digital twin that corresponds to the industrial asset. A learning agent platform (e.g., associated with reinforcement learning), coupled to the ensemble of learners, may manage the ensemble by receiving information about current operation of the industrial asset. The platform may then apply learning to the received information and generate data that modifies the ensemble of learners (e.g., by adding, pruning, and/or modifying models in the ensemble). In some embodiments, a boosting scheme may be employed to enhance decision making by the learning agent platform (e.g., a learner's voting weight might be inversely proportional to its error on a previous batch of information).
1 . A system associated with an industrial asset, comprising:
an ensemble of learners that comprise a digital twin corresponding to the industrial asset; and
a learning agent platform, coupled to the ensemble of learners, to manage the ensemble, including:
a computer processor, and
a computer memory storing instructions that, when executed by the computer processor cause the learning agent platform to:
receive information about current operation of the industrial asset, and
apply learning to the received information to generate data that modifies the ensemble of learners.
2 . The system of claim 1 , wherein the learning agent platform is associated with reinforcement learning.
3 . The method of claim 2 , wherein the reinforcement learning is based on a Markov Decision Process (“MDP”).
4 . The system of claim 1 , wherein the learning agent platform is further to:
employ a boosting scheme to enhance decision making by the learning agent.
4 . The system of claim 3 , wherein the boosting scheme uses a learner's voting weight that is inversely proportional to its error on a previous batch of information.
5 . The system of claim 4 , when an aggregate decision of the ensemble is associated with one of: (i) a weighted average in a regression approach, or (ii) a weighted vote in a classification approach.
6 . The system of claim 1 , wherein the modification of the ensemble of learners includes at least one of: (i) adding a model, (ii) pruning a model, and (iii) modifying a model.
7 . The system of claim 1 , wherein the learning agent platform makes control decisions based on statistics describing the performance of the ensemble and the learners.
8 . The system of claim 7 , wherein the statistics include information about a tunable heuristic in performance space independent of any specific task and drift.
9 . The system of claim 1 , wherein the industrial asset is associated with at least one of: (i) a turbine, (ii) a gas turbine, (iii) a wind turbine, (iv) an engine, (v) a jet engine, (vi) a locomotive engine, (vii) a refinery, (viii) a power grid, (ix) a dam, and (x) an autonomous vehicle.
10 . A computerized method associated with an industrial asset, comprising:
generating a learning agent to manage an ensemble of learners that comprise a digital twin corresponding to the industrial asset;
receiving, by the learning agent, information about current operation of the industrial asset; and
applying learning to the received information to generate data that modifies the ensemble of learners.
11 . The method of claim 10 , wherein the applied learning is reinforcement learning based on a Markov Decision Process (“MDP”).
12 . The method of claim 10 , further comprising:
employing a boosting scheme to enhance decision making by the learning agent.
13 . The method of claim 12 , wherein the boosting scheme uses a learner's voting weight that is inversely proportional to its error on a previous batch of information.
14 . The method of claim 13 , when an aggregate decision of the ensemble is associated with one of: (i) a weighted average in a regression approach, or (ii) a weighted vote in a classification approach.
15 . The method of claim 10 , wherein the modification of the ensemble of learners includes at least one of: (i) adding a model, (ii) pruning a model, and (iii) modifying a model.
16 . The method of claim 10 , wherein the learning agent platform makes control decisions based on statistics describing the performance of the ensemble and the learners.
17 . The system of claim 16 , wherein the statistics include information about a tunable heuristic in performance space independent of any specific task and drift.
18 . A non-transitory, computer-readable medium storing instructions that, when executed by a computer processor, cause the computer processor to perform a method associated with an industrial asset, the method comprising:
generating a learning agent to manage an ensemble of learners that comprise a digital twin corresponding to the industrial asset;
receiving, by the learning agent, information about current operation of the industrial asset; and
applying learning to the received information to generate data that modifies the ensemble of learners.
19 . The medium of claim 18 , wherein the applied learning is reinforcement learning based on a Markov Decision Process (“MDP”).
20 . The medium of claim 18 , wherein the method further comprises:
employing a boosting scheme to enhance decision making by the learning agent.
21 . The medium of claim 18 , wherein the industrial asset is associated with at least one of: (i) a turbine, (ii) a gas turbine, (iii) a wind turbine, (iv) an engine, (v) a jet engine, (vi) a locomotive engine, (vii) a refinery, (viii) a power grid, (ix) a dam, and (x) an autonomous vehicle.