Systems and methods for processing data collected in an industrial environment using neural networks
Methods and an expert system for processing a plurality of inputs collected from sensors in an industrial environment are disclosed. A modular neural network, where the expert system uses one type of neural network for recognizing a pattern relating to at least one of: the sensors, components of the industrial environment and a different neural network for self-organizing a data collection activity in the industrial environment is disclosed. A data communication network configured to communicate at least a portion of the plurality of inputs collected from the sensors to storage device is also disclosed.
1. An expert system for processing a plurality of inputs collected from sensors in an industrial environment, comprising:
a modular neural network, including at least two types of neural networks, that receives the plurality of inputs,
wherein the expert system uses the modular neural network to:
recognize a pattern relating to at least one of the sensors or corresponding components of the industrial environment, wherein the pattern is recognized utilizing a first type of neural network of the at least two types of neural networks resulting in a recognized pattern; and
self-organize a data collection activity of the at least one of the sensors or the corresponding components of the industrial environment, wherein the data collection activity is self-organized utilizing a second type of neural network of the at least two types of neural networks based, at least in part, on the recognized pattern from the first type of neural network, resulting in a self-organized data collection activity, and
wherein the at least two types of neural networks are distinct.
2. The expert system of claim 1 ,
wherein at least one of the at least two types of neural networks is a structure-adaptive type of neural network,
wherein the structure-adaptive type of neural network is configurable, such that different types of neural networks are configured for handling different types of inputs, resulting in a configuration of the structure-adaptive type of neural network, and
wherein the configuration includes at least one of:
varying an input to a node of the structure-adaptive type of neural network, or
varying a connection between nodes of the structure-adaptive type of neural network.
3. The expert system of claim 2 , wherein the configuration includes switching a data path between a subset of nodes of the structure-adaptive type of neural network from a unidirectional data path to a bi-directional data path.
4. The expert system of claim 1 , wherein a structure of the second type of neural network is based on the recognized pattern.
5. The expert system of claim 1 , wherein at least a portion of the second type of neural network includes a physical neural network with a plurality of hardware elements, and wherein at least one of the plurality of hardware elements is used to simulate neuron behavior.
6. The expert system of claim 5 , wherein the plurality of hardware elements includes at least one of: a chip, a microprocessor, an integrated circuit, a programmable logic controller (PLC), or a field programmable gate array (FPGA).
7. The expert system of claim 5 , wherein at least one of the plurality of hardware elements is selected to optimize at least one of:
a processing speed of the second type of neural network,
an input efficiency of the second type of neural network,
an output efficiency of the second type of neural network,
an energy efficiency of the second type of neural network, or
a signal to noise ratio of the second type of neural network.
8. The expert system of claim 1 , wherein the first type of neural network includes two types of neural networks in competition.
9. The expert system of claim 1 , further including a data communication network configured to communicate at least a portion of the plurality of inputs collected from the sensors to a storage device.
10. The expert system of claim 1 ,
wherein the recognized pattern indicates a fault condition of a component of the industrial environment, resulting in an indicated fault condition, and
wherein the self-organized data collection activity includes autonomous control of at least one of:
a subset of the sensors in the industrial environment,
a data marketplace including at least a portion of data collected from the sensors, or
a data pool including at least a portion of data collected from the sensors.
11. The expert system of claim 10 , wherein the self-organized data collection activity is based, at least in part, on the indicated fault condition of the component.
12. An expert system for processing a plurality of inputs collected from sensors in an industrial environment, comprising:
a modular neural network, including at least two types of independent neural networks,
wherein the modular neural network classifies a component of the industrial environment and predicts a state of the component of the industrial environment,
wherein a first type of neural network of the at least two types of independent neural networks receives the plurality of inputs from the sensors and classifies the component of the industrial environment in real-time, resulting in a component classification,
wherein a second type of neural network of the at least two types of neural networks predicts the state of the component in real-time based, at least in part, on the component classification from the first type of neural network, and
wherein the state of the component is at least one of: a fault state, an operational state, an anticipated state, or a maintenance state.
13. The expert system of claim 12 , wherein a structure of the second type of neural network is adapted based on the component classification.
14. The expert system of claim 12 , wherein the first type of neural network includes two types of neural networks in competition based on a time of convergence rule.
15. The expert system of claim 12 , wherein classifying the component includes at least one of:
identifying a machine type of the industrial environment,
identifying an equipment type of the industrial environment, or
identifying an operational mode of the component of the industrial environment.
16. The expert system of claim 12 , wherein the first type of neural network includes at least one of: a convolutional neural network, a recurrent neural network, or a feed forward neural network.
17. The expert system of claim 12 , wherein the second type of neural network includes at least one of a recurrent neural network or a feed forward neural network.
18. A method for processing a plurality of inputs collected from sensors in an industrial environment, comprising:
recognizing a pattern relating to at least one of the sensors or corresponding components in the industrial environment using a first type of neural network;
adapting a structure of a second type of neural network, based, at least in part, on the pattern recognized using the first type of neural network; and
self-organizing a data collection activity related to the at least one of the sensors or the corresponding components in the industrial environment using the second type of neural network.
19. The method of claim 18 , wherein the adapting the structure of the second type of neural network includes switching data paths between a subset of nodes of the second type of neural network between unidirectional data paths and bi-directional data paths.
20. The method of claim 18 , wherein the first type of neural network or the second type of neural network includes at least one of: a feed forward neural network, a self-organizing neural networks, a Kohonen self-organizing neural network, a recurrent neural network, a multi-layered neural network, a convolutional neural network, an auto-encoder neural network, a probabilistic neural network, a time delay neural network, a regulatory feedback neural network, a Hopfield neural network, a Boltzmann machine neural network, a restricted Boltzmann machine neural network, a self-organizing map (“SOM”) neural network, a learning vector quantization (“LVQ”) neural network, a fully recurrent neural network, a simple recurrent neural network, an echo state neural network, a long short-term memory neural network, a bi-directional neural network, a hierarchical neural network, a stochastic neural network, a genetic scale recurrent neural network, an instantaneously trained neural network, a spiking neural network, a neocognitron neural network, a dynamic neural network, a cascading neural network, a neuro-fuzzy neural network, a compositional pattern-producing neural network, a memory neural networks, a hierarchical temporal memory neural network, a deep feed forward neural network, a gated recurrent unit (“GRU”) neural network, an auto encoder neural network, a variational auto encoder neural network, a de-noising auto encoder neural network, a sparse auto-encoder neural network, a Markov chain neural network, a deep belief neural network, a deep convolutional neural network, a deconvolutional neural network, a deep convolutional inverse graphics neural network, a generative adversarial neural network, a liquid state machine neural network, an extreme learning machine neural network, deep residual neural network, a support vector machine neural network, a neural Turing machine neural network, or holographic associative memory neural network.