IP Library › Granted Patent US 12,293,573
Granted Patent B2
US 12,293,573 · App. 17/991,908 · Granted May 6, 2025

Apparatus and method for generating learning data for artificial intelligence model

Inventors: Seung Ki Ryu (Goyang-si, KR); Yeo Hwan Yoon (Goyang-si, KR); Young Seok Kim (Seoul, KR)
Assignee: KOREA INSTITUTE of CIVIL ENGINEERING and BUILDING TECHNOLOGY
G06V10/774
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,293,573
App. No.
17/991,908
Granted
May 6, 2025
Kind
B2
Abstract

The present invention relates to an apparatus and method for generating learning data for an artificial intelligence model, which generate learning data for learning of an artificial intelligence model that detects anomalies of a plant facility, and the apparatus and method collect at least one among structured data and unstructured data, and generate a learning data set for learning of an artificial intelligence model that predicts and diagnoses anomalies of a plant facility using at least one among the structured data and the unstructured data.

Claims (25)

1. A learning data generation apparatus comprising:

a collection unit for collecting at least one among structured data and unstructured data; and

a processing unit for generating a learning data set for learning of an artificial intelligence model that predicts and diagnoses anomalies of a plant facility using at least one among the structured data and the unstructured data, wherein

the unstructured data is an external image of the plant facility acquired by an image sensor, and

when the learning data set is generated from the structured data, the processing unit extracts feature information of anomaly data by classifying the structured data into normal data corresponding to a normal pattern and anomaly data corresponding to an anomaly pattern by using a time domain analysis, extracts feature information of the anomaly data from the structured data through a frequency domain analysis in order to grasp a feature pattern that is unknown through the time domain analysis, analyzes a correlation between the anomaly data among the structured data by analyzing magnitude and frequency of occurrence by frequency for the extracted feature information of the anomaly data in consideration of a time domain and a frequency domain, and generates the learning data, after generating a plurality of matrix maps on the basis of the correlation between the analyzed anomaly data, by grouping the matrix maps by anomaly type, and

when the learning data set is generated from the unstructured data, the processing unit sets a region of interest in the external image, extracts features from the region of interest and stores the features in combination with location information of an object in the region of interest, classifies the extracted features into normal features and abnormal features, generates a labeling data set by performing labeling on the region of interest or the external image containing the anomaly features, and generates the learning data set on the basis of the labeling data set, and

wherein the processing unit generates the learning data set by fusing a learning data set based on the structured data and a learning data set based on the unstructured data.

2. The apparatus according to claim 1 , wherein the structured data includes at least one among temperature, vibration, pressure, voltage, current, and an image measured by a plurality of sensors installed in the plant facility during an operation of the plant facility.

3. A learning data generation method of a learning data generation apparatus, the method comprising the steps of:

collecting at least one among structured data and unstructured data, by the learning data generation apparatus; and

generating a learning data set for learning of an artificial intelligence model that predicts and diagnoses anomalies of a plant facility using at least one among the structured data and the unstructured data, by the learning data generation apparatus, wherein

the unstructured data is an external image of the plant facility acquired by an image sensor, and

when the learning data set is generated from the structured data, the step of generating a learning data set includes the steps of:

extracting feature information of anomaly data by classifying the structured data into normal data corresponding to a normal pattern and anomaly data corresponding to an anomaly pattern by using a time domain analysis;

extracting feature information of the anomaly data from the structured data through a frequency domain analysis in order to grasp a feature pattern that is unknown through the time domain analysis;

analyzing a correlation between the anomaly data among the structured data by analyzing magnitude and frequency of occurrence by frequency for the extracted feature information of the anomaly data in consideration of a time domain and a frequency domain; and

generating the learning data, after generating a plurality of matrix maps on the basis of the correlation between the analyzed anomaly data, by grouping the matrix maps by anomaly type, and

when the learning data set is generated from the unstructured data, the step of generating a learning data set includes the steps of:

setting a region of interest in the external image;

extracting features from the region of interest and storing the features in combination with location information of an object in the region of interest;

classifying the extracted features into normal features and abnormal features;

generating a labeling data set by performing labeling on the region of interest or the external image containing the anomaly features; and

generating the learning data set on the basis of the labeling data set, and

wherein the step of generating the learning data set includes a step of fusing a learning data set based on the structured data and a learning data set based on the unstructured data.

4. The method according to claim 3 , wherein the structured data includes at least one among temperature, vibration, pressure, voltage, current, and an image measured by a plurality of sensors installed in the plant facility during an operation of the plant facility.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2022
From: RYU, SEUNG KI; YOON, YEO HWAN; KIM, YOUNG SEOK
To: KOREA INSTITUTE OF CIVIL ENGINEERING AND BUILDING TECHNOLOGY
Reel/Frame 061849/0708 →
Priority Claims (1)
KR 10-2021-0161479 · Nov 22, 2021 · national
Continuity (1)
Related Publication 20230162484A1 · May 25, 2023
References Cited (7)
US 10866952B2 · Nixon · 2020 [cited by examiner]
US 20180247220A1 · Assem Aly Salama · 2018 [cited by examiner]
US 20220156137A1 · Yoshida · 2022 [cited by examiner]
KR 1020200052425A · 2020 [cited by applicant]
KR 1020200110979A · 2020 [cited by applicant]
Office Action of Korean Patent Application No. 10-2021-0161479 mailed Feb. 28, 2022. [cited by applicant]
Office Action of Korean Patent Application No. 10-2021-0161479 mailed May 24, 2022. [cited by applicant]