Anomaly detection and diagnosis in factory automation system using pre-processed time-delay neural network with loss function adaptation

1. A computer-implemented pre-processed time-delay autoencoder based anomaly detection method for detecting anomalous states of machines arranged in a factory automation (FA) system or a manufacturing production line, comprising steps of:

acquiring source signals from the machines via an interface;

performing a data pre-processing process for the acquired source signals by normalizing value ranges of the acquired source signals and filtering undesired features from the acquired source signals;

performing a time-delayed data reform process for the pre-processed source signals based on a time-delay window to generate pre-processed time-delay data;

submitting pre-processed time-delay testing data to a pre-processed time-delayed autoencoder (Prep-TDAE) neural network, wherein the pre-processed time-delay testing data are collected online while the machines are operated, wherein the Prep-TDAE neural network has been pre-trained by using a pre-processed time-delay training data;

detecting, if an anomaly state is encountered with respect to the machines, by computing anomaly scores of the pre-processed time-delay testing data; and

determining, when the anomaly state is detected, anomaly occurrence time, duration and severity with respect to the anomaly state of each of the machines.

2. The method of claim 1 , wherein the data pre-processing process divides the normalized source signals into normalized analog signals and normalized binary signals.

3. The method of claim 1 , wherein in the determining step, the anomaly state is detected by computing the anomaly score of the normalized signals.

4. The method of claim 1 , wherein an input layer of the Prep-TDAE neural network is configured to accept a binary part of the pre-processed time-delay data via a binary acceptor of the input layer and accept an analog part of the pre-processed time-delay data via an analog acceptor of the input layer.

5. The method of claim 1 , wherein in the step of pre-processing, the acquired signals are divided into binary signals and analog signals, wherein the analog signals are processed by a band-pass filter followed by a high-pass filter, wherein the binary signals are processed by a unit impulse filter.

6. The method of claim 1 , wherein the Prep-TDAE neural network performs loss function adaptation by applying different loss functions to different data types.

7. The method of claim 6 , wherein binary signals are trained with a cross-entropy loss function and analog signals are trained with a squared error loss function.

8. The method of claim 1 , wherein the anomaly occurrence time corresponds to a time index of test data, at which the anomaly score exceeds a predefined threshold.

9. The method of claim 1 , wherein the anomaly duration is the length of the time during which the anomaly score of test data persistently exceeds a predefined threshold for consecutive time indices.

10. The method of claim 1 , wherein the anomaly severity is determined based on a magnitude of the anomaly score.

11. A pre-processed time-delay autoencoder based anomaly detection system for detecting anomalous states of machines arranged in a factory automation (FA) system or a manufacturing production line, comprising steps of:

an interface configured to acquire source signals from the machines;

a memory to store computer-executable programs including a data pre-processing algorithm, a time-delayed data reform process algorithm, a pre-processed time-delay autoencoder (Pre-TDAE) neural network, and an anomaly diagnosis algorithm; and

a processor configured to perform steps of:

performing a data pre-processing process algorithm for the acquired source signals by normalizing value ranges of the acquired source signals and filtering undesired features from the acquired source signals;

performing the time-delayed data reform process algorithm for the pre-processed source signals based on a time-delay window to generate pre-processed time-delay data;

submitting pre-processed time-delay testing data to a Prep-TDAE neural network, wherein the pre-processed time-delay testing data are collected online while the machines are operated, wherein the Prep-TDAE neural network has been pre-trained by using pre-processed time-delay training data;

detecting, if an anomaly state is encountered with respect to the machines, by computing anomaly scores of the pre-processed time-delay testing data; and

determining, when the anomaly state is detected, anomaly occurrence time, duration and severity with respect to the anomaly state of each of the machines.

12. The system of claim 11 , wherein the data pre-processing process divides the normalized source signals into normalized analog signals and normalized binary signals.