IP Library › Granted Patent US 12,631,566
Granted Patent B2
US 12,631,566 · App. 18/606,782 · Granted May 19, 2026

Inspection support device, inspection support method, and program

Inventor: Shuhei Horita (Tokyo, JP)
Assignee: FUJIFILM Corporation
G01N21/8851G06T7/001G06T11/203G06V10/759G06V10/86G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,631,566
App. No.
18/606,782
Granted
May 19, 2026
Kind
B2
Abstract

Provided are an inspection support device, an inspection support method, and a program capable of reducing complexity of creating a damage diagram. The inspection support device includes a processor that supports creation of a damage diagram of a structure, in which the processor acquires image data of information including a structural drawing of a target structure on a medium and damage information related to damage added by a user on the medium, recognizes the damage information by image recognition from the acquired image data, acquires drawing data corresponding to the structural drawing, aligns the structural drawing of the image data with the drawing data, and draws the damage information as a damage graphic at a corresponding position of the drawing data to create the damage diagram.

Claims (138)

1 . An inspection support device comprising a processor that supports creation of a damage diagram of a structure,

wherein the processor

acquires image data including a structural drawing of a target structure on a medium and damage information related to damage added by a user on the medium,

recognizes the damage information by image recognition from the acquired image data,

acquires drawing data corresponding to the structural drawing,

aligns the structural drawing of the image data with the drawing data,

draws the damage information as a damage graphic at a corresponding position of the drawing data to create the damage diagram, and

calculates an actual dimension of the damage from the damage graphic and dimension information included in the drawing data.

2 . The inspection support device according to claim 1 ,

wherein the processor associates the damage graphic with a character string.

3 . The inspection support device according to claim 1 ,

wherein the processor receives editing of the created damage diagram and permits the editing of the damage diagram.

4 . The inspection support device according to claim 1 ,

wherein the processor vectorizes and draws the damage graphic.

5 . The inspection support device according to claim 1 ,

wherein the processor recognizes the damage information from the image data by the image recognition by at least one of a machine learning model or an image recognition algorithm.

6 . The inspection support device according to claim 1 ,

wherein the processor recognizes additional attribute information regarding the damage information from the image data by character recognition.

7 . The inspection support device according to claim 6 ,

wherein the processor associates the damage information with the additional attribute information based on a predetermined condition.

8 . The inspection support device according to claim 6 ,

wherein the image data includes auxiliary information that specifies the additional attribute information, and

the processor specifies a position of the additional attribute information based on the auxiliary information.

9 . The inspection support device according to claim 1 ,

wherein the image data includes captured image identification information of a captured image obtained by imaging the target structure, and

the processor

acquires the captured image from the captured image identification information, and

acquires complementary information that complements the damage information from the captured image.

10 . The inspection support device according to claim 1 ,

wherein past damage information of the target structure in the past is included on the medium, and

the processor

draws a difference between the damage information and the past damage information as the damage graphic based on the damage information and the past damage information.

11 . An inspection support method of supporting creation of a damage diagram of a structure by a processor, the inspection support method comprising:

by the processor,

a step of acquiring image data of information including a structural drawing of a target structure on a medium and damage information added by a user on the medium;

a step of recognizing the damage information from the acquired image data;

a step of acquiring drawing data corresponding to the structural drawing;

a step of aligning the structural drawing of the image data with the drawing data;

a step of drawing the damage information as a damage graphic at a corresponding position of the drawing data to create the damage diagram; and

a step of calculating an actual dimension of the damage from the damage graphic and dimension information included in the drawing data.

12 . A non-transitory, computer-readable tangible recording medium which records thereon a program that causes, when read by a computer, a processor of the computer to execute an inspection support method of supporting creation of a damage diagram of a structure, the program causing the processor to execute:

a step of acquiring image data of information including a structural drawing of a target structure on a medium and damage information added by a user on the medium;

a step of recognizing the damage information from the acquired image data;

a step of acquiring drawing data corresponding to the structural drawing;

a step of aligning the structural drawing of the image data with the drawing data; a step of drawing the damage information as a damage graphic at a corresponding position of the drawing data to create a damage diagram; and

a step of calculating an actual dimension of the damage from the damage graphic and dimension information included in the drawing data.

13 . An inspection support device comprising a processor that supports creation of a damage diagram of a structure,

wherein the processor

acquires image data including a structural drawing of a target structure on a medium and damage information related to damage added by a user on the medium,

recognizes the damage information by image recognition from the acquired image data,

acquires drawing data corresponding to the structural drawing,

aligns the structural drawing of the image data with the drawing data,

draws the damage information as a damage graphic at a corresponding position of the drawing data to create the damage diagram,

recognizes additional attribute information regarding the damage information from the image data by character recognition,

wherein the image data includes auxiliary information that specifies the additional attribute information, and

specifies a position of the additional attribute information based on the auxiliary information.

14 . The inspection support device according to claim 13 ,

wherein the processor associates the damage graphic with a character string.

15 . The inspection support device according to claim 13 ,

wherein the processor receives editing of the created damage diagram and permits the editing of the damage diagram.

16 . The inspection support device according to claim 13 ,

wherein the processor vectorizes and draws the damage graphic.

17 . The inspection support device according to claim 13 ,

wherein the processor recognizes the damage information from the image data by the image recognition by at least one of a machine learning model or an image recognition algorithm.

18 . The inspection support device according to claim 13 ,

wherein the processor associates the damage information with the additional attribute information based on a predetermined condition.

19 . The inspection support device according to claim 13 ,

wherein the image data includes captured image identification information of a captured image obtained by imaging the target structure, and

the processor

acquires the captured image from the captured image identification information, and

acquires complementary information that complements the damage information from the captured image.

20 . The inspection support device according to claim 13 ,

wherein past damage information of the target structure in the past is included on the medium, and

the processor

draws a difference between the damage information and the past damage information as the damage graphic based on the damage information and the past damage information.

21 . An inspection support device comprising a processor that supports creation of a damage diagram of a structure,

wherein the processor

acquires image data including a structural drawing of a target structure on a medium and damage information related to damage added by a user on the medium,

recognizes the damage information by image recognition from the acquired image data,

acquires drawing data corresponding to the structural drawing,

aligns the structural drawing of the image data with the drawing data, draws the damage information as a damage graphic at a corresponding position of the drawing data to create the damage diagram,

wherein the image data includes captured image identification information of a captured image obtained by imaging the target structure, and

acquires the captured image from the captured image identification information, and

acquires complementary information that complements the damage information from the captured image.

22 . The inspection support device according to claim 21 ,

wherein the processor associates the damage graphic with a character string.

23 . The inspection support device according to claim 21 ,

wherein the processor receives editing of the created damage diagram and permits the editing of the damage diagram.

24 . The inspection support device according to claim 21 ,

wherein the processor vectorizes and draws the damage graphic.

25 . The inspection support device according to claim 21 ,

wherein the processor recognizes the damage information from the image data by the image recognition by at least one of a machine learning model or an image recognition algorithm.

26 . The inspection support device according to claim 21 ,

wherein the processor recognizes additional attribute information regarding the damage information from the image data by character recognition.

27 . The inspection support device according to claim 26 ,

wherein the processor associates the damage information with the additional attribute information based on a predetermined condition.

28 . The inspection support device according to claim 21 ,

wherein past damage information of the target structure in the past is included on the medium, and

the processor

draws a difference between the damage information and the past damage information as the damage graphic based on the damage information and the past damage information.

29 . An inspection support method of supporting creation of a damage diagram of a structure by a processor, the inspection support method comprising:

by the processor,

a step of acquiring image data of information including a structural drawing of a target structure on a medium and damage information added by a user on the medium;

a step of recognizing the damage information from the acquired image data;

a step of acquiring drawing data corresponding to the structural drawing;

a step of aligning the structural drawing of the image data with the drawing data;

a step of drawing the damage information as a damage graphic at a corresponding position of the drawing data to create the damage diagram;

a step of recognizing additional attribute information regarding the damage information from the image data by character recognition,

wherein the image data includes auxiliary information that specifies the additional attribute information; and

a step of specifying a position of the additional attribute information based on the auxiliary information.

30 . An inspection support method of supporting creation of a damage diagram of a structure by a processor, the inspection support method comprising:

by the processor,

a step of acquiring image data of information including a structural drawing of a target structure on a medium and damage information added by a user on the medium;

a step of recognizing the damage information from the acquired image data;

a step of acquiring drawing data corresponding to the structural drawing;

a step of aligning the structural drawing of the image data with the drawing data;

a step of drawing the damage information as a damage graphic at a corresponding position of the drawing data to create the damage diagram,

wherein the image data includes captured image identification information of a captured image obtained by imaging the target structure;

acquires the captured image from the captured image identification information; and

acquires complementary information that complements the damage information from the captured image.

31 . A non-transitory, computer-readable tangible recording medium which records thereon a program that causes, when read by a computer, a processor of the computer to execute an inspection support method of supporting creation of a damage diagram of a structure, the program causing the processor to execute:

a step of acquiring image data of information including a structural drawing of a target structure on a medium and damage information added by a user on the medium;

a step of recognizing the damage information from the acquired image data;

a step of acquiring drawing data corresponding to the structural drawing;

a step of aligning the structural drawing of the image data with the drawing data;

a step of drawing the damage information as a damage graphic at a corresponding position of the drawing data to create a damage diagram;

a step of recognizing additional attribute information regarding the damage information from the image data by character recognition,

wherein the image data includes auxiliary information that specifies the additional attribute information; and

a step of specifying a position of the additional attribute information based on the auxiliary information.

32 . A non-transitory, computer-readable tangible recording medium which records thereon a program that causes, when read by a computer, a processor of the computer to execute an inspection support method of supporting creation of a damage diagram of a structure, the program causing the processor to execute:

a step of acquiring image data of information including a structural drawing of a target structure on a medium and damage information added by a user on the medium;

a step of recognizing the damage information from the acquired image data;

a step of acquiring drawing data corresponding to the structural drawing;

a step of aligning the structural drawing of the image data with the drawing data;

a step of drawing the damage information as a damage graphic at a corresponding position of the drawing data to create a damage diagram,

wherein the image data includes captured image identification information of a captured image obtained by imaging the target structure;

a step of acquiring the captured image from the captured image identification information; and

a step of acquiring complementary information that complements the damage information from the captured image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2024
From: HORITA, SHUHEI
To: FUJIFILM CORPORATION
Reel/Frame 066792/0307 →
Priority Claims (1)
JP 2021-161060 · Sep 30, 2021 · national
Continuity (2)
Continuation PCTJP2022029312 · Jul 29, 2022
Related Publication 20240219312A1 · Jul 4, 2024
References Cited (9)
US 20180292329A1 · Karube · 2018 [cited by applicant]
US 20230162348A1 · Moteki · 2023 [cited by examiner]
JP 2007179340A · 2007 [cited by applicant]
JP 2019175015A · 2019 [cited by applicant]
JP 2020160056A · 2020 [cited by applicant]
JP 2021101190A · 2021 [cited by applicant]
International Search Report issued in PCT/JP2022/029312; mailed Oct. 11, 2022. [cited by applicant]
International Preliminary Report On Patentability (Chapter I) and Written Opinion of the International Searching Authority issued in PCT/JP2022/029312; issued Apr. 2, 2024. [cited by applicant]
“Notice of Reasons for Refusal” Office Action issued in JP 2023-550417; mailed by the Japanese Patent Office on Nov. 25, 2025. [cited by applicant]