IP Library Granted Patent US 12,529,684
Granted Patent B2
US 12,529,684 · App. 18/008,632 · Granted Jan 20, 2026

Inspection device, inspection method, and inspection program

Inventors: Takahiro Wada (Osaka, JP); Ryota Ioka (Osaka, JP); Kaoru Shinoda (Osaka, JP); Takeru Katayama (Osaka, JP)
Assignee: Kanadevia Corporation
G01N29/069G06T7/0008G06T7/001G01N2291/023G01N2291/0289G01N2291/267G06T2207/10132G06T2207/20081G06T2207/30108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,529,684
App. No.
18/008,632
Granted
Jan 20, 2026
Kind
B2
Abstract

Determination of presence or absence of a defect having irregular position, size, shape, and/or the like in an image are made automatically. An inspection device includes: an inspection image obtaining section that obtains an inspection image used to determine presence or absence of an internal defect in an inspection target; and a defect presence/absence determining section that determines presence or absence of a defect with use of a restored image generated by inputting the inspection image into a generative model constructed by machine learning that uses, as training data, an image of an inspection target in which a defect is absent, the generative model being constructed so as to generate a new image having a similar feature to that of an image input into the generative model.

Claims (25)

1 . An inspection device comprising a processor,

the processor carrying out:

an inspection image obtaining step of obtaining an inspection image, which is an image used to determine presence or absence of a defect inside an inspection target;

a defect presence/absence determination step of determining presence or absence of a defect in the inspection target with use of a restored image generated by inputting the inspection image into a generative model, the generative model being constructed by machine learning so that the generative model generates a new image having a similar feature to that of an image input into the generative model, the generative model being constructed by using, as training data, an image of an inspection target in which a defect is absent; and

an inspection image generating step of extracting, as an inspection target area, an area sandwiched between two peripheral echo areas from an ultrasonic testing image so as to generate the inspection image, the ultrasonic testing image being an image of an echo of an ultrasonic wave propagated in the inspection target, each of the two peripheral echo areas being an area where an echo coming from a periphery of an inspection target portion of the inspection target appears repeatedly,

wherein, in the inspection image obtaining step, the processor obtains the inspection image generated in the inspection image generating step.

2 . The inspection device as set forth in claim 1 , wherein, in the defect presence/absence determination step, in a case where a variance of pixel values of pixels constituting a difference image between the inspection image and the restored image exceeds a given threshold, the processor determines that a defect is present in the inspection target.

3 . The inspection device as set forth in claim 2 , wherein the processor further carries out a defect area detecting step of detecting, as a defect area, an area of the difference image which area is constituted by pixels having a pixel value not less than a threshold.

4 . The inspection device as set forth in claim 3 , wherein the defect is a defect in a welded portion of the inspection target; and

wherein the processor further carries out a defect type determination step of determining a type of the defect related to the defect area, in accordance with a position in an image area of the difference image at which position the defect area is detected.

5 . The inspection device as set forth in claim 2 , wherein the processor further carries out:

a heat map generating step of generating a heat map representing, by colors or gradations, the pixel values of the pixels constituting the difference image; and

a defect type determination step of determining a type of the defect in accordance with an output value obtained by inputting, into a type decision model, the heat map generated by the heat map generating step, the type decision model being constructed by machine learning that uses, as training data, a heat map of a difference image generated from an inspection image of an inspection target having a defect of a known type.

6 . The inspection device as set forth in claim 1 , wherein, in the inspection image generating step, the processor extracts the inspection target area in accordance with an output value obtained by inputting the ultrasonic testing image into an extraction model for the inspection target area, the extraction model being constructed by machine learning that uses, as correct data, an area including (i) an inspection target portion and (ii) at least a part of an area where an echo coming from the periphery of the inspection target portion appears.

7 . The inspection device as set forth in claim 1 , wherein, in the defect presence/absence determination step, the processor determines presence or absence of a defect in the inspection target, with respect to a remaining image area obtained by removing, from an image area of the restored image, the area where the echo coming from the periphery of the inspection target portion appears.

8 . The inspection device as set forth in claim 1 , wherein, in the defect presence/absence determination step, the processor carries out an integrative detection step of, in a case where the processor determines that a defect is present in a plurality of ultrasonic testing images corresponding to parts of the inspection target which parts are adjacent to each other, detecting, as a single defect, the defects captured in the plurality of ultrasonic testing images.

9 . An inspection method involving use of an inspection device, comprising the steps of:

obtaining an inspection image, which is an image used to determine presence or absence of a defect inside an inspection target;

determining presence or absence of a defect in the inspection target with use of a restored image generated by inputting the inspection image into a generative model, the generative model being constructed by machine learning so that the generative model generates a new image having a similar feature to that of an image input into the generative model, the generative model being constructed by using, as training data, a first ultrasonic testing image of an inspection target in which a defect is absent; and

extracting, as an inspection target area, an area sandwiched between two peripheral echo areas from a second ultrasonic testing image so as to generate the inspection image, the second ultrasonic testing image being an image of an echo of an ultrasonic wave propagated in the inspection target, each of the two peripheral echo areas being an area where an echo coming from a periphery of an inspection target portion of the inspection target appears repeatedly,

wherein, in the step of obtaining the inspection image, the inspection image is generated by the step of extracting.

10 . A non-transitory computer readable medium storing an inspection program configured to cause a computer to function as an inspection device, the inspection program causing the computer to carry out:

an inspection image obtaining step of obtaining an inspection image, which is an image used to determine presence or absence of a defect inside an inspection target;

a defect presence/absence determination step of determining presence or absence of a defect in the inspection target with use of a restored image generated by inputting the inspection image into a generative model, the generative model being constructed by machine learning so that the generative model generates a new image having a similar feature to that of an image input into the generative model, the generative model being constructed by using, as training data, an ultrasonic image of an inspection target in which a defect is absent; and

an inspection image generating step of extracting, as an inspection target area, an area sandwiched between two peripheral echo areas from an ultrasonic testing image so as to generate the inspection image, the ultrasonic testing image being an image of an echo of an ultrasonic wave propagated in the inspection target, each of the two peripheral echo areas being an area where an echo coming from a periphery of an inspection target portion of the inspection target appears repeatedly, in the inspection image obtaining step, the inspection program causes the computer to obtain the inspection image generated in the inspection image generating step.

Assignments (2)
CHANGE OF NAME Recorded Dec 5, 2025
From: HITACHI ZOSEN CORPORATION
To: KANADEVIA CORPORATION
Reel/Frame 073868/0671 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2022
From: WADA, TAKAHIRO; IOKA, RYOTA; SHINODA, KAORU; KATAYAMA, TAKERU
To: HITACHI ZOSEN CORPORATION
Reel/Frame 062078/0465 →
Priority Claims (1)
JP 2020-101123 · Jun 10, 2020 · national
Continuity (1)
Related Publication 20230221286A1 · Jul 13, 2023
References Cited (86)
US 6756589B1 · Obara et al. · 2004 [cited by applicant]
US 20030234239A1 · Lee · 2003 [cited by examiner]
US 20060219013A1 · Baba · 2006 [cited by examiner]
US 20090255473A1 · Katz et al. · 2009 [cited by applicant]
US 20140202937A1 · Ohtake · 2014 [cited by examiner]
US 20160070987A1 · Irie et al. · 2016 [cited by applicant]
US 20180070798A1 · Kamiyama et al. · 2018 [cited by applicant]
US 20180101944A1 · Sakai et al. · 2018 [cited by applicant]
US 20180211373A1 · Stoppa · 2018 [cited by examiner]
US 20190050978A9 · Sakai et al. · 2019 [cited by applicant]
US 20190072526A1 · Kitazawa et al. · 2019 [cited by applicant]
US 20190188845A1 · Tamai · 2019 [cited by applicant]
US 20190197680A1 · Sakai et al. · 2019 [cited by applicant]
US 20190290246A1 · Huang · 2019 [cited by examiner]
US 20190323993A1 · Mendes Rodrigues et al. · 2019 [cited by applicant]
US 20190325606A1 · Oota et al. · 2019 [cited by applicant]
US 20200058115A1 · Mimura et al. · 2020 [cited by applicant]
US 20200065954A1 · Komatsu et al. · 2020 [cited by applicant]
US 20200175675A1 · Ogino et al. · 2020 [cited by applicant]
US 20200226744A1 · Cohen · 2020 [cited by examiner]
US 20200364906A1 · Shimodaira · 2020 [cited by examiner]
US 20210012476A1 · Miyazawa et al. · 2021 [cited by applicant]
US 20210295485A1 · Miyazawa · 2021 [cited by applicant]
US 20220335291A1 · Sawada et al. · 2022 [cited by applicant]
CN 104937408A · 2015 [cited by applicant]
CN 107024541A · 2017 [cited by applicant]
CN 110036279A · 2019 [cited by applicant]
CN 110388879A · 2019 [cited by applicant]
CN 110849909A · 2020 [cited by applicant]
JP 3280170A · 1991 [cited by applicant]
JP 08110326A · 1996 [cited by applicant]
JP 200030652A · 2000 [cited by applicant]
JP 2003232779A · 2003 [cited by applicant]
JP 2007048006A · 2007 [cited by applicant]
JP 2009128325A · 2009 [cited by applicant]
JP 2009236550A · 2009 [cited by applicant]
JP 2010243375A · 2010 [cited by applicant]
JP 2011516879A · 2011 [cited by applicant]
JP 2011163918A · 2011 [cited by applicant]
JP 2014048169A · 2014 [cited by applicant]
JP 2014163805A · 2014 [cited by applicant]
JP 2015130093A · 2015 [cited by applicant]
JP 2016040650A · 2016 [cited by applicant]
JP 2016057701A · 2016 [cited by applicant]
JP 2017078935A · 2017 [cited by applicant]
JP 2017129444A · 2017 [cited by applicant]
JP 2018054354A · 2018 [cited by applicant]
JP 2019025044A · 2019 [cited by applicant]
JP 6474946B · 2019 [cited by applicant]
JP 6494369B · 2019 [cited by applicant]
JP 2019106090A · 2019 [cited by applicant]
JP 2019133306A · 2019 [cited by applicant]
JP 2019197007A · 2019 [cited by applicant]
JP 2020503509A · 2020 [cited by applicant]
JP 2020028679A · 2020 [cited by applicant]
JP 2020058800A · 2020 [cited by applicant]
JP 2020187657A · 2020 [cited by applicant]
TW 201942567A · 2019 [cited by applicant]
WO 2016185617A1 · 2016 [cited by applicant]
WO 2019103772A1 · 2019 [cited by applicant]
WO WO2020031984A1 · 2020 [cited by examiner]
WO 2021053815A1 · 2021 [cited by applicant]
U.S. Appl. No. 18/552,965, filed Sep. 28, 2023. [cited by applicant]
U.S. Appl. No. 18/008,872, filed Dec. 7, 2022. [cited by applicant]
International Search Report dated Jun. 29, 2021, issued in corresponding International Application No. PCT/JP2021/014383 with English translation (9 pgs.). [cited by applicant]
Written Opinion of the International Searching Authority dated Jun. 29, 2021, issued in corresponding International Application No. PCT/JP2021/014383 (8 pgs.). [cited by applicant]
U.S. Appl. No. 18/552,965, filed Dec. 28, 2022. [cited by applicant]
Hiromitsu Fujii, “A Short Survey on Defect Detection for Inspection of Social Infrastractures”, Technical report of IEICE (Institute of Electronics, Information and Communication Engineers), Japan, vol. 116, No. 208, pp… [cited by applicant]
Office Action dated Apr. 9, 2024, issued in corresponding Japanese Patent Application No. 2020-101125 with English translation (6 pgs.). [cited by applicant]
Alex Krizhevsky et al., “ImageNet Classification with Deep Convolutional Neural Networks”, Advances in Neural Information Processing Systems, Jan. 2012, 25(2), pp. 1-9. [cited by applicant]
Chong Zhou et al., “Anomaly Detection with Robust Deep Autoencoders”, KDD 2017 Research Paper, Aug. 13-17, 2017, Halifax, NS, Canada, pp. 665-674. [cited by applicant]
International Search Report dated Jul. 27, 2021, issued in corresponding International Application No. PCT/JP2021/018459, with English translation (6 pgs.). [cited by applicant]
Written Opinion of the International Searching Authority dated Jul. 27, 2021, issued in corresponding International Application No. PCT/JP2021/018459 (6 pgs.). [cited by applicant]
G.E. Hinton et al., “Reducing the Dimensionality of Data with Neural Networks”, SCIENCE, vol. 313, Jul. 28, 2006, pp. 504-507. [cited by applicant]
Joseph Redmon et al., “YOLO9000: Better, Faster, Stronger”, University of Washington, Allen Institute for AI, pp. 1-9 http://pjreddie.com/yolo9000/. [cited by applicant]
Joseph Redmon et al., “You Only Look Once: Unified, Real-Time Object Detection”, University of Washington, Allen Institute for AI, Facebook AI Research, pp. 779-788 http://pjreddie.com/yolo/. [cited by applicant]
Kaoru Shinoda et al., “Application of Phased Array Ultrasonic Testing for Tube-to-Tubesheet Weld of Heat Exchanger Using Deep Learning”, IIW 2022 International Conference on Welding and Joining pp. 180-183. [cited by applicant]
International Search Report dated Apr. 5, 2022, issued in corresponding International Application No. PCT/JP2022/001699 with English translation (4 pgs.). [cited by applicant]
International Preliminary Report on Patentability and Written Opinion of the International Searching Authority dated Apr. 5, 2022, issued in corresponding International Application No. PCT/JP2022/001699 with English tra… [cited by applicant]
Notification of the First Office Action dated Jan. 21, 2025, issued in corresponding Chinese Patent Application No. 202180041936.7 with English translation (14 pgs.). [cited by applicant]
Non-final Office Action dated Mar. 17, 2025, issued in corresponding U.S. Appl. No. 18/008,872 (56 pgs.). [cited by applicant]
Notice of Reasons for Refusal dated Mar. 25, 2025, issued in corresponding Japanese Patent Application No. 2021-063688 with English translation (5 pgs.). [cited by applicant]
First Office Action dated Mar. 28, 2025, issued in corresponding Chinese Patent Application No. 202180041906.6 with English translation (18 pgs.). [cited by applicant]
Notice of Allowance dated Aug. 8, 2025, issued in corresponding U.S. Appl. No. 18/008,872 (27 pgs.). [cited by applicant]
Notification of the First Office Action dated Jun. 23, 2025, issued in corresponding Chinese Patent Application No. 2022800263550.0 with English translation (15 pgs.). [cited by applicant]
Office Action dated Jun. 6, 2025, issued in corresponding India Patent Application No. 202247073104 (8 pgs.). [cited by applicant]