IP Library › Granted Patent US 12,602,761
Granted Patent B2
US 12,602,761 · App. 18/344,823 · Granted Apr 14, 2026

Image analysis apparatus, image analysis method, and program

Inventor: Kimito Katsuyama (Tokyo, JP)
Assignee: FUJIFILM Corporation
G06T7/0004G06T2207/10048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,602,761
App. No.
18/344,823
Granted
Apr 14, 2026
Kind
B2
Abstract

Provided are an image analysis apparatus, an image analysis method, and a program that can reduce erroneous detection of defective portions. An image analysis apparatus includes a processor. The processor is configured to acquire an infrared thermal image that is a captured image of a structure to be inspected, acquire a visible image that is a captured image of the structure to be inspected, determine a temperature defect from the infrared thermal image, and estimate a cause of the temperature defect on the basis of, for the temperature defect, at least temperature defect information obtained from the infrared thermal image, and surface defect information obtained from the visible image.

Claims (50)

1 . An image analysis apparatus comprising a processor configured to:

acquire an infrared thermal image that is a captured image of a structure to be inspected;

acquire a visible image that is a captured image of the structure to be inspected;

determine a temperature defect from the infrared thermal image;

determine a surface defect, corresponding to the temperature defect, from the visible image;

determine a temperature defect information, wherein the temperature defect information includes at least a temperature distribution of the temperature defect;

determine a surface defect information, wherein the surface defect information includes at least a luminance distribution of the surface defect;

determine a first similarity between the temperature distribution and the luminance distribution for a region corresponding to the entire temperature defect;

determine a second similarity between the temperature distribution and the luminance distribution for a region corresponding to a portion of the temperature defect;

determine that the surface defect corresponding to the temperature defect is a crack or peeling; and

estimate a cause of the temperature defect on the basis of the temperature defect information and the surface defect information, wherein the estimate of the cause of the temperature defect is determined to be bulging accompanied by the crack or peeling when no similarity is found in the first similarity determination but similarity is found in the second similarity determination.

2 . The image analysis apparatus according to claim 1 , wherein the temperature defect information further includes information on a shape and/or a size of the temperature defect.

3 . The image analysis apparatus according to claim 1 , wherein the surface defect information further includes information on at least one of a type, a shape, or a position of the surface defect.

4 . The image analysis apparatus according to claim 1 , wherein

the processor is configured to:

in response to estimating that the cause of the temperature defect is the surface defect,

estimate a temperature distribution caused by the surface defect and reduce the temperature distribution from the infrared thermal image.

5 . The image analysis apparatus according to claim 1 , wherein

the processor is configured to:

evaluate whether the surface defect is present in a size of the temperature defect and/or in the vicinity of a boundary of the temperature defect; and

estimate that the cause of the temperature defect is bulging accompanied by the crack or peeling when the surface defect is present.

6 . The image analysis apparatus according to claim 1 , wherein

the processor is configured to:

estimate the cause of the temperature defect on the basis of a temperature gradient at a boundary of the temperature defect.

7 . The image analysis apparatus according to claim 1 , wherein the surface defect further includes at least one of a repair site, free lime, a joint, or a step.

8 . The image analysis apparatus according to claim 1 , wherein the visible image is an image obtained by imaging a reflection intensity distribution over two or more different wavelength ranges in a wavelength range of visible light.

9 . The image analysis apparatus according to claim 1 , further comprising a display device, wherein

the processor is configured to display an estimation result of the cause of the temperature defect on the display device.

10 . An image analysis method comprising:

a step of acquiring an infrared thermal image that is a captured image of a structure to be inspected;

a step of acquiring a visible image that is a captured image of the structure to be inspected;

a step of determining a temperature defect from the infrared thermal image;

a step of determining a surface defect, corresponding to the temperature defect, from the visible image;

a step of determining a temperature defect information, wherein the temperature defect information includes at least a temperature distribution of the temperature defect;

a step of determining a surface defect information, wherein the surface defect information includes at least a luminance distribution of the surface defect;

a step of determining a first similarity between the temperature distribution and the luminance distribution for a region corresponding to the entire temperature defect;

a step of determining a second similarity between the temperature distribution and the luminance distribution for a region corresponding to a portion of the temperature defect;

a step of determining that the surface defect corresponding to the temperature defect is a crack or peeling; and

a step of estimating a cause of the temperature defect on the basis of the temperature defect information and the surface defect information, wherein the estimate of the cause of the temperature defect is determined to be bulging accompanied by the crack or peeling when no similarity is found in the first similarity determination but similarity is found in the second similarity determination.

11 . A non-transitory, computer readable tangible recording medium which records thereon a program for causing, when read by a computer, the computer to execute:

a step of acquiring an infrared thermal image that is a captured image of a structure to be inspected;

a step of acquiring a visible image that is a captured image of the structure to be inspected;

a step of determining a temperature defect from the infrared thermal image;

a step of determining a surface defect, corresponding to the temperature defect, from the visible image;

a step of determining a temperature defect information, wherein the temperature defect information includes at least a temperature distribution of the temperature defect;

a step of determining a surface defect information, wherein the surface defect information includes at least a luminance distribution of the surface defect;

a step of determining a first similarity between the temperature distribution and the luminance distribution for a region corresponding to the entire temperature defect;

a step of determining a second similarity between the temperature distribution and the luminance distribution for a region corresponding to a portion of the temperature defect;

a step of determining that the surface defect corresponding to the temperature defect is a crack or peeling; and

a step of estimating a cause of the temperature defect on the basis of the temperature defect information and the surface defect information, wherein the estimate of the cause of the temperature defect is determined to be bulging accompanied by the crack or peeling when no similarity is found in the first similarity determination but similarity is found in the second similarity determination.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2023
From: KATSUYAMA, KIMITO
To: FUJIFILM CORPORATION
Reel/Frame 064120/0567 →
Priority Claims (1)
JP 2021-004419 · Jan 14, 2021 · national
Continuity (2)
Continuation PCTJP2021048467 · Dec 27, 2021
Related Publication 20230342907A1 · Oct 26, 2023
References Cited (57)
US 5719395A · Lesniak · 1998 [cited by applicant]
US 7208733B2 · Mian et al. · 2007 [cited by applicant]
US 7994480B2 · Johnson et al. · 2011 [cited by applicant]
US 8466422B2 · Johnson et al. · 2013 [cited by applicant]
US 11650112B1 · Qing et al. · 2023 [cited by applicant]
US 20020031265A1 · Higaki · 2002 [cited by examiner]
US 20030021462A1 · Sakai · 2003 [cited by examiner]
US 20060222237A1 · Du · 2006 [cited by examiner]
US 20060249679A1 · Johnson et al. · 2006 [cited by applicant]
US 20080099678A1 · Johnson et al. · 2008 [cited by applicant]
US 20100260374A1 · Akashi et al. · 2010 [cited by applicant]
US 20110062339A1 · Ruhge · 2011 [cited by examiner]
US 20110123093A1 · Alloo · 2011 [cited by examiner]
US 20170103507A1 · Fuchs · 2017 [cited by applicant]
US 20180059065A1 · Hull et al. · 2018 [cited by applicant]
US 20190289227A1 · Hirosawa · 2019 [cited by applicant]
US 20190371014A1 · Etoh · 2019 [cited by applicant]
US 20200184630A1 · Wang et al. · 2020 [cited by applicant]
US 20210272272A1 · Matsumoto · 2021 [cited by examiner]
US 20230342907A1 · Katsuyama · 2023 [cited by applicant]
US 20240177325A1 · Katsuyama · 2024 [cited by applicant]
US 20250146964A1 · Porat · 2025 [cited by examiner]
CN 108490029A · 2018 [cited by applicant]
CN 109483107A · 2019 [cited by applicant]
EP 2357466A1 · 2011 [cited by applicant]
JP H05307013A · 1993 [cited by examiner]
JP H09281065A · 1997 [cited by applicant]
JP 2005016991A · 2005 [cited by applicant]
JP 2005016995A · 2005 [cited by applicant]
JP 2005172683A · 2005 [cited by applicant]
JP 2005338359A · 2005 [cited by applicant]
JP 2006177869A · 2006 [cited by applicant]
JP 2007285778A · 2007 [cited by applicant]
JP 2011099687A · 2011 [cited by applicant]
JP 2011226936A · 2011 [cited by applicant]
JP 5140892B2 · 2013 [cited by applicant]
JP 2013096741A · 2013 [cited by applicant]
JP 2013224849A · 2013 [cited by applicant]
JP 5318728B2 · 2013 [cited by examiner]
JP 2016065809A · 2016 [cited by examiner]
JP 2017203761A · 2017 [cited by applicant]
WO 2010046967A1 · 2010 [cited by applicant]
WO 2018155267A1 · 2018 [cited by applicant]
International Search Report issued in PCT/JP2021/048467; mailed Mar. 22, 2022. [cited by applicant]
International Preliminary Report On Patentability (Chapter I) and Written Opinion of the International Searching Authority issued in PCT/JP2021/048467; issued Jul. 4, 2023. [cited by applicant]
The extended European search report issued by the European Patent Office on Jun. 10, 2024, which corresponds to European Patent Application No. 21919738.1-1001 and is related to U.S. Appl. No. 18/344,823. [cited by applicant]
International Search Report issued in PCT/JP2021/036558; mailed Dec. 14, 2021. [cited by applicant]
International Preliminary Report On Patentability (Chapter I) and Written Opinion of the International Searching Authority issued in PCT/JP2021/036558; issued May 2, 2023. [cited by applicant]
The extended European search report issued by the European Patent Office on Mar. 18, 2024, which corresponds to European Patent Application No. 21885821.5-1001. [cited by applicant]
An Office Action; “Notice of Reasons for Refusal,” mailed by the Japanese Patent Office on Mar. 17, 2025, which corresponds to Japanese Patent Application No. 2022-558949. [cited by applicant]
An Office Action mailed by China National Intellectual Property Administration on Aug. 4, 2025, which corresponds to Chinese Patent Application No. 202180073014.4. [cited by applicant]
An Office Action mailed by the United States Patent and Trademark Office on Aug. 19, 2025, which corresponds to U.S. Appl. No. 18/308,731. [cited by applicant]
Computer translation of JP 2013-224849 A, downloaded from the JPO website (Year: 2025); original document submitted on Aug. 18, 2023. [cited by applicant]
An Office Action mailed by China National Intellectual Property Administration on Sep. 30, 2025, which corresponds to Chinese Patent Application No.202180090589.7 and is related to U.S. Appl. No. 18/344,823; with Englis… [cited by applicant]
An Office Action, “Notice of Reasons for Refusal,” mailed by the Japanese Patent Office on Nov. 7, 2025, which corresponds to Japanese Patent Application No. 2022-575515; with English language translation. [cited by applicant]
An Office Action mailed by China National Intellectual Property Administration on Nov. 10, 2025, which corresponds to Chinese Patent Application No. 202180073014.4; with English language translation. [cited by applicant]
Communication pursuant to Article 94(3) EPC issued by the European Patent Office on Feb. 2, 2026, which corresponds to European Patent Application No. 21919738.1-1001 and is related to U.S. Appl. No. 18/344,823. [cited by applicant]