IP Library Granted Patent US 11,386,549
Granted Patent B2
US 11,386,549 · App. 17/031,004 · Granted Jul 12, 2022

Abnormality inspection device and abnormality inspection method

Inventors: Kazuyuki Miyazawa (Tokyo, JP); Kazuo Sugimoto (Tokyo, JP)
Assignee: MITSUBISHI ELECTRIC CORPORATION
G06T7/001G06T2207/20081G06T2207/20084G06T2207/20224
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,386,549
App. No.
17/031,004
Granted
Jul 12, 2022
Kind
B2
Abstract

Included are: an image acquiring unit acquiring a determination target image in which a target object to be inspected is captured; a learning result acquiring unit acquiring a result of machine learning of forward domain conversion of an image or inverse domain conversion of an image performed using a normal image in which the target object in a normal state is captured as training data; a determination target image analysis unit obtaining a domain-converted image by sequentially performing forward domain conversion and inverse domain conversion on the determination target image using the result of the machine learning; and a determination unit determining whether or not an abnormality is occurring in the target object captured in the determination target image by comparing the determination target image and the domain-converted image.

Claims (23)

1. An abnormality inspection device comprising processing circuitry

to acquire a determination target image in which a target object to be inspected is captured;

to acquire a result of machine learning of forward domain conversion of an image or inverse domain conversion of an image performed using a normal image in which the target object in a normal state is captured as training data;

to obtain a domain-converted image by sequentially performing forward domain conversion and inverse domain conversion on the determination target image, using the result of the machine learning;

to determine whether or not an abnormality is occurring in the target object captured in the determination target image by comparing the determination target image and the domain-converted image;

to obtain a forward-domain-converted image by performing forward domain conversion on the determination target image using a result of machine learning performed using the normal image as training data; and

to perform analysis on the abnormality using the forward-domain-converted image when the abnormality is determined to be occurring in the target object captured in the determination target image.

2. The abnormality inspection device according to claim 1 , wherein the processing circuitry further performs:

to acquiring the normal image; and

to perform the machine learning using the normal image.

3. The abnormality inspection device according to claim 1 ,

wherein the forward domain conversion or the inverse domain conversion is performed using a neural network.

4. The abnormality inspection device according to claim 1 ,

wherein the determination unit generates a difference image whose pixels indicate absolute values of differences between a plurality of pixels included in the determination target image and a plurality of pixels included in the domain-converted image, which positionally correspond to each other, and determines an area formed by a set of pixels having the absolute values greater than or equal to a threshold value among the pixels of the difference image as an area where an abnormality is occurring in the target object captured in the determination target image.

5. The abnormality inspection device according to claim 1 , wherein the processing circuitry further performs:

to output, to a display device, information regarding a determination result of whether or not the abnormality is occurring in the target object captured in the determination target image.

6. An abnormality inspection method comprising:

acquiring a determination target image in which a target object to be inspected is captured;

acquiring a result of machine learning of forward domain conversion of an image or inverse domain conversion of an image performed using a normal image in which the target object in a normal state is captured as training data;

obtaining a domain-converted image by sequentially performing forward domain conversion and inverse domain conversion on the determination target image, using the result of the machine learning;

determining whether or not an abnormality is occurring in the target object captured in the determination target image by comparing the determination target image and the domain-converted image;

obtaining a forward-domain-converted image by performing forward domain conversion on the determination target image using a result of machine learning performed using the normal image as training data; and

performing analysis on the abnormality using the forward-domain-converted image when the abnormality is determined to be occurring in the target object captured in the determination target image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2020
From: MIYAZAWA, KAZUYUKI; SUGIMOTO, KAZUO
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 054307/0975 →
Continuity (2)
Continuation PCTJP2018013305 · Mar 29, 2018
Related Publication 20210012476A1 · Jan 14, 2021
Cited By (1)
US 12,567,139