IP Library Granted Patent US 11,996,900
Granted Patent B2
US 11,996,900 · App. 16/221,235 · Granted May 28, 2024

Systems and methods for processing data collected in an industrial environment using neural networks

Inventors: Charles Howard Cella (Pembroke, MA); Gerald William Duffy, Jr. (Philadelphia, PA); Jeffrey P. McGuckin (Philadelphia, PA); Mehul Desai (Oak Brook, IL)
Assignee: Strong Force IoT Portfolio 2016, LLC
H04B17/29B62D15/0215G01M13/028G01M13/04G01M13/045G05B13/028G05B19/4183G05B19/4184G05B19/41845G05B19/4185G05B19/41865G05B19/41875G05B23/0221G05B23/0229G05B23/024G05B23/0264G05B23/0283G05B23/0286G05B23/0289G05B23/0291G05B23/0294G05B23/0297G06F18/2178G06N3/006G06N3/02G06N3/044G06N3/045G06N3/047G06N3/084G06N3/088G06N5/046G06N7/01G06N20/00G06Q10/04G06Q10/0639G06Q30/02G06Q30/0278G06Q30/06G06Q50/00G06V10/7784G06V10/82G16Z99/00H02M1/12H03M1/12H04B17/23H04B17/309H04B17/318H04B17/345H04L1/0002H04L1/0041H04L1/18H04L1/1874H04L67/1097H04L67/12H04W4/38H04W4/70B62D5/0463G05B19/042G05B23/02G05B23/0208G05B2219/32287G05B2219/35001G05B2219/37337G05B2219/37351G05B2219/37434G05B2219/37537G05B2219/40115G05B2219/45004G05B2219/45129G06F17/18G06F18/21G06F18/217G06F18/25G06N3/126H04B17/40H04L1/0009H04L5/0064H04L67/306Y02P80/10Y02P90/02Y02P90/80Y04S50/00Y04S50/12Y10S707/99939
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,996,900
App. No.
16/221,235
Granted
May 28, 2024
Kind
B2
Abstract

Methods and an expert system for processing a plurality of inputs collected from sensors in an industrial environment are disclosed. A modular neural network, where the expert system uses one type of neural network for recognizing a pattern relating to at least one of: the sensors, components of the industrial environment and a different neural network for self-organizing a data collection activity in the industrial environment is disclosed. A data communication network configured to communicate at least a portion of the plurality of inputs collected from the sensors to storage device is also disclosed.

Claims (57)

1. An expert system for processing of a plurality of inputs collected from sensors in an industrial environment during real-time operation of the industrial environment, comprising:

a first neural network comprising a first type of neural network including at least one of a recurrent neural network or a feed forward neural network, implemented by at least one processor, and configured to recognize a pattern relating to at least one of:

the sensors,

components of the industrial environment, or

a data communication network configured to communicate at least a portion of the plurality of inputs collected from the sensors to a storage device,

wherein the pattern indicates a fault condition of a component of the industrial environment; and

a second neural network comprising a second type of neural network including at least one of a radial basis function neural network or a feed forward neural network, wherein the second type of neural network is different from the first type of neural network, the second neural network configured to self-organize a data collection activity of the sensors in the industrial environment that governs autonomous control of at least one of: a set of sensors comprising the sensors, a data marketplace comprising at least a portion of data collected from the sensors, or a data pool comprising at least a portion of data collected from the sensors.

2. The system of claim 1 , wherein:

the data pool is distributed across a plurality of data storage devices; and

the data storage devices are communicatively coupled to the data communication network.

3. The system of claim 2 , wherein the expert system organizes the data collection activity based at least in part on the recognized pattern.

4. An expert system for processing a plurality of inputs collected from sensors in an industrial environment, comprising:

a first neural network comprising a first type of neural network including at least one of a convolutional neural network, a recurrent neural network, or a feed forward neural network, implemented by at least one processor, and configured to classify a component of the industrial environment in real-time; and

a second neural network comprising a second type of neural network including at least one of a recurrent neural network or a feed forward neural network, wherein the second type of neural network is different from the first type of neural network, the second neural network implemented by at least one processor, and configured to predict a state of the component of the industrial environment in real-time including predicting at least one of: a fault state, an operational state, an anticipated state, or a maintenance state,

wherein the expert system reconfigures the plurality of inputs collected from the sensors based on the at least one of: the fault state, the operational state, the anticipated state, or the maintenance state.

5. The system of claim 4 , wherein classifying the component includes at least one of: identifying a machine type, identifying an equipment type, or identifying an operational mode of the component.

6. An expert system for processing a plurality of inputs collected from sensors in an industrial environment, comprising:

a first neural network comprising a first type of neural network including at least one of a recurrent neural network or a feed forward neural network, implemented by at least one processor, and configured to determine at least one of a state of a component or a context of the component, the determining being performed in real-time during operation of the component; and

a second neural network comprising a second type of neural network including at least one of a radial basis function neural network or a feed forward neural network, wherein the second type of neural network is different from the first type of neural network, implemented by at least one processor, and configured to self-organize a process involving the at least one state of the component or the context of the component, the self-organizing being performed in real-time during operation of the component,

wherein:

the self-organized process includes at least one of: a data storage process for at least a portion of data collected from the sensors, a network coding process for a network communicating at least a portion of data collected from the sensors, or a network selection process; and

a selected network communicates at least a portion of data collected from the sensor.

7. The system of claim 6 , wherein self-organizing the process further comprises reconfiguring routing inputs in varying configurations, such that different neural net configurations are enabled for handling different types of inputs.

8. The system of claim 6 , wherein:

the self-organized process further includes a data marketplace process for a data marketplace; and

the data marketplace includes at least a portion of data collected from the sensors.

9. A modular neural network expert system for processing a plurality of inputs collected from sensors in an industrial environment, comprising:

at least two neural networks, each implemented by at least one processor, each receiving at least one of the plurality of inputs collected from the sensors during real-time operation of the sensors,

wherein a first one of the at least two neural networks is a first type including at least one of a recurrent neural network or a feed forward neural network and configured to determine: one of a context or state for one of a process or a component of the industrial environment based on at least one of the plurality of inputs received in real-time, and

wherein a second one of the at least two neural networks is a second type including at least one of a radial basis function neural network or a feed forward neural network, wherein the second type is different from the first type, and configured to perform a self-organizing operation associated with the industrial environment based on at least one of the plurality of inputs received in real-time,

wherein the self-organizing operation includes providing sensor information to the process or the component of the industrial environment.

10. The expert system of claim 9 , wherein the expert system is configured to recognize a pattern relating to at least one of a sensor or a component of the industrial environment.

11. The expert system of claim 10 , wherein the pattern comprises a fault condition of the component of the industrial environment.

12. A system for collecting data in an industrial environment, comprising:

a first neural network of a first type, implemented by at least one processor; and

a second neural network of a second type different from the first type, implemented by at least one processor, comprising a physical neural network embodied in a mobile data collector,

wherein the mobile data collector includes a mobile robot and includes sensors that collect the data from the industrial environment, and the mobile data collector is configured to be reconfigured during real-time operation of the industrial environment by routing inputs in varying configurations to provide different neural network configurations, such that different neural net configurations are enabled within the mobile data collector for handling respective different types of inputs, wherein the physical neural network includes one or more hardware elements to perform neural behavior.

13. The system of claim 12 , wherein the reconfiguration occurs under control of an expert system.

14. The system of claim 13 , wherein the expert system includes a software-based neural net.

15. The system of claim 14 , wherein the software-based neural net is located on the mobile data collector.

16. The system of claim 14 , wherein the software-based neural net is located remotely from the mobile data collector.

17. A method for processing data collected from an industrial environment, the method comprising:

receiving, by at least one data collector, data streams and other inputs collected from at least one industrial environment;

transmitting, by the at least one data collector, a subset of the data streams to a cloud platform; and

analyzing the subset of the data streams, by an expert system via the cloud platform, using at least two neural networks of different types operated in parallel, the at least two neural networks of different types receiving respective different types of inputs from the at least one industrial environment, wherein a first one of the at least two neural networks includes at least one of a recurrent neural network, a feed forward neural network, a radial basis function neural network, or a convolutional neural network, and a second one of the at least two neural networks includes a different one of the recurrent neural network, the feed forward neural network, the radial basis function neural network, or the convolutional neural network,

wherein:

the at least two neural networks are structured to compete with each other under control of the expert system; and

the at least two neural networks are configured to:

process respective input data sets from a same industrial environment to provide respective outputs; and

compare the respective outputs to at least one measure of success.

18. The method of claim 17 , wherein the at least one measure of success includes at least one of: a measure of predictive accuracy, a measure of classification accuracy, an efficiency measure, a profit measure, a maintenance measure, a safety measure, or a yield measure.

19. The method of claim 17 , wherein:

the first one of the at least two neural networks determines: one of a context or state for one of a process or a component of the industrial environment; and

the second one of the at least two neural networks performs a self-organizing operation associated with the industrial environment.

20. The method of claim 17 , wherein:

one of the neural networks, among the at least two neural networks, classifies a component of the industrial environment; and

a different neural network, among the at least two neural networks, predicts a state of the component of the industrial environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2020
From: CELLA, CHARLES HOWARD; DUFFY, GERALD WILLIAM, JR; MCGUCKIN, JEFFREY P.; DESAI, MEHUL
To: STRONG FORCE IOT PORTFOLIO 2016, LLC
Reel/Frame 052486/0898 →
Continuity (14)
Continuation 16143360 · Sep 26, 2018
Continuation PCTUS2018045036 · Aug 2, 2018
Continuation 15973406 · May 7, 2018
Continuation 15973406 · May 7, 2018
Continuation In Part PCTUS2017031721 · May 9, 2017
Provisional Application 62583487 · Nov 8, 2017
Provisional Application 62562487 · Sep 24, 2017
Provisional Application 62540557 · Aug 2, 2017
Provisional Application 62540513 · Aug 2, 2017
Provisional Application 62427141 · Nov 28, 2016
Provisional Application 62412843 · Oct 26, 2016
Provisional Application 62350672 · Jun 15, 2016
Provisional Application 62333589 · May 19, 2016
Related Publication 20190129405A1 · May 2, 2019
Cited By (7)
US 12,203,799 US 12,314,060 US 12,322,412 US 12,379,729 US 12,585,282 US 12,663,771 US 12,664,505