IP Library › Granted Patent US 12,314,149
Granted Patent B1
US 12,314,149 · App. 18/747,957 · Granted May 27, 2025

Complex device fault diagnosis method and system based on multi-dimensional features

Inventors: Yaohua Deng (Guangzhou, CN); Zilin Zhang (Guangzhou, CN)
Assignee: GUANGDONG UNIVERSITY OF TECHNOLOGY
G06F11/2733
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,314,149
App. No.
18/747,957
Granted
May 27, 2025
Kind
B1
Abstract

Disclosed are a complex device fault diagnosis method and system based on multi-dimensional features, and the method comprises the following steps of: acquiring fault data of a target complex device, and carrying out input coding mapping and position coding; utilizing a multi-head attention mechanism and multi-head dilated convolution series connection, and acquiring fault features covering global and local deep information in combination with a feedforward neural network; fusing the extracted fault features to acquire a multi-dimensional feature vector; and acquiring a fault type probability score matrix by a classifier, and outputting a fault diagnosis result of the target complex device. The global modeling advantage of multi-head self-attention and the local multi-scale feature perception advantage of multi-head dilated convolution are fused, and a device fault diagnosis model in which a Transform model and the multi-head dilated convolution are mutually fused is established.

Claims (47)

1. A complex device fault diagnosis method based on multi-dimensional features, comprising the following steps of:

acquiring fault data X of a target complex device, preprocessing the fault data X, and carrying out input coding mapping and position coding;

acquiring fault features covering global and local deep information in combination with a feedforward neural network;

fusing the fault features to acquire a multi-dimensional feature vector; and

acquiring a fault type probability score matrix according to the multi-dimensional feature vector, and outputting a fault diagnosis result of the target complex device;

wherein, an input X o1 ′ is obtained after the position coding is imported, an attention score of each of multiple attention heads is constructed and calculated, and an output X oh of each of the multiple attention heads is obtained according to the attention score; and

outputs of the multiple attention heads are combined and spliced, and mapped through linear transformation to obtain a final multi-head self-attention output X oH , and the final multi-head self-attention output X oH is subjected to layer standardization and then subjected to residual connection with the input X o1 ′ to obtain a global feature X o2 output;

wherein, the global feature X o2 is input, and a last dimension of the global feature X o2 is segmented, and subjected to dilated convolutions with dilation rates of 1, 2 and 3 respectively; and

feature matrices of three different scales of dilated convolution outputs are added with equal weights to obtain multi-head outputs, the multi-head outputs are combined and spliced, and subjected to linear mapping to obtain X oH d , and finally, layer normalization and residual connection are carried out to obtain a local feature X o3 output;

the local feature X o3 is input for fully connected mapping and nonlinear transformation, and layer normalization and residual connection are carried out to obtain an output X o4 ;

X o4 =LN (ReLU( X o3 ·W 1 F )· W 2 F )+ X o3 ;

wherein, W 1 F and W 2 F respectively represent weight parameters of the two fully connected layers, LN refers to normalization calculation, and ReLU refers to activation function calculation; and

the outputs X o2 , X o3 and X o4 are acquired, and skip residual connection between the output and the input X o1 ′ is added to finally acquire an output X o5 as the fault features; and

the fault features are fused to acquire the multi-dimensional feature vector;

the output X o5 is input, so as to fuse the fault features into a vector with a fixed length to acquire the multi-dimensional feature vector Output GAP ;

Output

GAP

=

1

M

2

⁢

∑

i

=

1

D

e

⁢

m

⁢

b

⁢

e

⁢

d

⁢

X

o

⁢

5

i

;

wherein, X o5 i ∈ 1xM 2 represents that an i th line of the X o5 has a total of M 2 feature values, M 2 represents a sequence length, and D embed represents a feature dimension size.

2. The complex device fault diagnosis method based on multi-dimensional features according to claim 1 , wherein the preprocessing the fault data X, and carrying out the input coding mapping and the position coding, specifically comprises:

acquiring the fault data X by using a sensor for sample preprocessing of normalization and slide window segmentation, reconstructing each of multiple parts of sample data into a two-dimensional feature map X 2D through an extended operation, segmenting the two-dimensional feature map X 2D into a plurality of patches through a convolution operation, and outputting a feature vector X o1 after rearrangement; and

constructing a learnable position coding matrix, and embedding the position coding matrix into the feature vector X o1 in a form of addition for the position coding to obtain the input X o1 ′.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 4, 2025
From: DENG, YAOHUA; ZHANG, ZILIN
To: GUANGDONG UNIVERSITY OF TECHNOLOGY
Reel/Frame 071308/0244 →
Priority Claims (1)
CN 202410072338.1 · Jan 18, 2024 · national
References Cited (23)
US 5469463A · Polich · 1995 [cited by examiner]
US 10452971B2 · Chung · 2019 [cited by examiner]
US 12055941B1 · Crego · 2024 [cited by examiner]
US 20170293543A1 · Xu · 2017 [cited by examiner]
US 20210192333A1 · Thiruvengadam · 2021 [cited by examiner]
US 20220207321A1 · Gulati · 2022 [cited by examiner]
US 20220414443A1 · Li · 2022 [cited by examiner]
US 20230342175A1 · Yang · 2023 [cited by examiner]
US 20240062361A1 · Remillard · 2024 [cited by examiner]
US 20240095495A1 · Banino · 2024 [cited by examiner]
US 20240404281A1 · Ishihara · 2024 [cited by examiner]
US 20250068954A1 · Senior · 2025 [cited by examiner]
CN 116502135A · 2023 [cited by applicant]
CN 116521887A · 2023 [cited by applicant]
CN 116735170A · 2023 [cited by applicant]
CN 116933125A · 2023 [cited by applicant]
CN 117034139A · 2023 [cited by applicant]
CN 117294617A · 2023 [cited by applicant]
WO WO2024127315A1 · 2024 [cited by examiner]
GTAD: Graph and Temporal Neural Network for Multivariate Time Series Anomaly Detection by Guan Entropy 2022, 24, 759. https://doi.org/10.3390/e24060759 (Year: 2022). [cited by examiner]
Convolutional-Transformer Model with Long-Range Temporal Dependencies for Bearing Fault Diagnosis Using Vibration Signals by Ahmed Machines 2023, 11, 746. https://doi.org/10.3390/machines11070746 Jul. 17, 2023 (Year: 20… [cited by examiner]
Huang Hao, Deng Yaohua et al., “Research on Multi-Component Device Life Prediction Method under Cross-Working Conditions Based on Domain Feature Fusion Network”, Journal of Electronic Measurement and Instrumentation, vo… [cited by applicant]
Zhai, Pengbo; Yang, Hao; Song, Tingting; Yu, Kang; Ma, Longxiang; Huang, Xiangsheng., “Two-path semantic segmentation algorithm combining attention mechanism”, Journal of Image and Graphics, Issue 08, Aug. 12, 2020, pp.… [cited by applicant]