IP Library › Granted Patent US 12,450,800
Granted Patent B2
US 12,450,800 · App. 18/303,685 · Granted Oct 21, 2025

Image processing apparatus and image processing method that determine transmittance of an image based on defect information

Inventor: Takenori Tsukikawa (Kanagawa, JP)
Assignee: CANON KABUSHIKI KAISHA
G06T11/60G06T7/0002G01N21/01G01N2021/0112G01N2021/0143G01N21/8851G01N2021/888G01N2021/8887G06T2200/24G06T2210/62
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,450,800
App. No.
18/303,685
Granted
Oct 21, 2025
Kind
B2
Abstract

An image processing apparatus including a processor and a memory, having instructions stored thereon, which, when executed by the processor, cause the image processing apparatus to acquire a captured image of an inspection target, to detect defect information based on the image, to determine a transmittance of the image based on a trend in the defect information, to determine whether a first setting for displaying the defect information in a highlighted state is enabled, to generate a first layer including the image, if the first setting is enabled, a second layer to which a predetermined transmittance is set, and, if the first setting is disabled, a third layer including the defect information without generating the second layer, and to display the first, second, and third layers so as to be superimposed on one another, or to display the first and third layers so as to be superimposed on one another.

Claims (93)

1. An image processing apparatus comprising:

a processor; and

a memory, including instructions stored thereon, which, when executed by the processor cause the image processing apparatus:

to acquire a captured image of an inspection target;

to detect one or more pieces of defect information based on the image;

to determine a predetermined transmittance of the image based on a trend in the pieces of the defect information;

to determine whether or not a first setting for displaying the pieces of defect information in a highlighted state is enabled;

to generate a first layer including the image if the first setting is enabled, to generate a second layer to which a predetermined transmittance is set and, if the first setting is disabled, to generate a third layer including the pieces of defect information without generating the second layer; and

to display the first, second, and third layers so as to be superimposed on one another or to display the first and third layers so as to be superimposed on one another, respectively.

2. The image processing apparatus according to claim 1 , wherein the instructions, when executed by the processor, further cause the apparatus:

to enable or to disable the first setting;

to set the transmittance of the image; and

to set the predetermined transmittance of the second layer to the set transmittance.

3. An image processing apparatus comprising:

a processor; and

a memory, including instructions stored thereon, which, when executed by the processor cause the image processing apparatus:

to acquire a captured image of an inspection target;

to detect one or more pieces of defect information based on the image;

to determine a predetermined transmittance of the image, based on a trend in the pieces of the defect information, which is a ratio of the area of the pieces of defect information to the area of the image;

to set the predetermined transmittance to an upper limit if the ratio is greater than or equal to a first threshold;

to set the predetermined transmittance between the upper limit and a lower limit if the ratio is greater than or equal to a second threshold or a third threshold, the second and third thresholds being less than the first threshold;

to set the predetermined transmittance to the lower limit if the ratio is less than the third threshold; and

to display the pieces of detected defect information so as to be superimposed on the image displayed with the predetermined transmittance.

4. The image processing apparatus according to claim 3 , wherein the instructions, when executed by the processor, further cause the apparatus:

to set the upper and lower limits of the predetermined transmittance, and the first, second, and third thresholds.

5. An image processing apparatus comprising:

a processor; and

a memory, including instructions stored thereon, which, when executed by the processor cause the image processing apparatus:

to acquire a captured image of an inspection target;

to detect one or more pieces of defect information based on the image;

to determine a predetermined transmittance of the image, based on a trend in the pieces of the defect information;

to group the pieces of detected defect information into one or more groups in accordance with characteristics of the pieces of defect information, and to determine a transmittance of each group of the pieces of defect information;

to determine whether or not a first setting for displaying the pieces of defect information in a highlighted state is enabled;

to generate a first layer including the image if the first setting is enabled, and, if a second setting for displaying a layer for each group of the pieces of defect information is enabled, a second layer to which a transmittance is set for each group of the pieces of defect information, and, if the first setting is enabled and the second setting is disabled, or if the first setting is disabled, a third layer that includes all pieces of defect information and to which a predetermined transmittance is set; and

to display the first and second layers so as to be superimposed on one another or to display the first and third layers so as to be superimposed on one another, respectively.

6. The image processing apparatus according to claim 5 , wherein the instructions, when executed by the processor, further cause the apparatus:

to enable or to disable the first setting; and

to enable or to disable the second setting.

7. The image processing apparatus according to claim 5 , wherein the instructions, when executed by the processor, further cause the apparatus to set the transmittance of the second layer for each group of the pieces of defect information, based on a trend in the group of the pieces of defect information.

8. The image processing apparatus according to claim 7 , wherein the trend in the group of the pieces of defect information is a ratio of the area of the group of the pieces of defect information to the area of the image, and

the instructions, when executed by the processor, further cause the apparatus:

to set the transmittance of the second layer to an upper limit, if the ratio is greater than or equal to a first threshold;

to set the transmittance of the second layer between the upper limit and a lower limit, if the ratio is greater than or equal to a second threshold that is less than the first threshold; and

to set the transmittance of the second layer to the lower limit, if the ratio is less than the second threshold.

9. The image processing apparatus according to claim 8 , wherein the instructions, when executed by the processor, further cause the apparatus to set the upper and lower limits of the transmittance of the second layer, and the first and second thresholds.

10. The image processing apparatus according to claim 5 , wherein the predetermined transmittance of the third layer is determined based on a ratio of the area of all pieces of defect information to the area of the image.

11. The image processing apparatus according to claim 5 , wherein the instructions, when executed by the processor, further cause the apparatus to determine a priority of a layer of each group of the pieces of defect information, based on characteristics of the pieces of defect information, and to perform control such that a layer having a higher priority is arranged in a higher position.

12. An image processing method comprising:

acquiring a captured image of an inspection target;

detecting one or more pieces of defect information based on the image;

determining a predetermined transmittance of the image based on a trend in the pieces of the defect information;

determining whether or not a first setting for displaying the pieces of defect information in a highlighted state is enabled;

generating a first layer including the image if the first setting is enabled, generating a second layer to which a predetermined transmittance is set, and, if the first setting is disabled, generating a third layer including the pieces of defect information without generating the second layer; and

displaying the first, second, and third layers so as to be superimposed on one another or displaying the first and third layers so as to be superimposed on one another, respectively.

13. A non-transitory computer-readable storage medium storing a program that causes a computer to execute an image processing method, the image process method comprising:

acquiring a captured image of an inspection target;

detecting one or more pieces of defect information based on the image;

determining a predetermined transmittance of the image based on a trend in the pieces of the defect information;

determining whether or not a first setting for displaying the pieces of defect information in a highlighted state is enabled;

generating a first layer including the image if the first setting is enabled, generating a second layer to which a predetermined transmittance is set, and, if the first setting is disabled, generating a third layer including the pieces of defect information without generating the second layer; and

displaying the first, second, and third layers so as to be superimposed on one another or displaying the first and third layers so as to be superimposed on one another, respectively.

14. An image processing method comprising:

acquiring a captured image of an inspection target;

detecting one or more pieces of defect information based on the image;

determining a predetermined transmittance of the image, based on a trend in the pieces of the defect information, which is a ratio of the area of the pieces of defect information to the area of the image;

setting the predetermined transmittance to an upper limit if the ratio is greater than or equal to a first threshold;

setting the predetermined transmittance between the upper limit and a lower limit if the ratio is greater than or equal to a second threshold or a third threshold, the second and third thresholds being less than the first threshold;

setting the predetermined transmittance to the lower limit if the ratio is less than the third threshold; and

displaying the pieces of detected defect information so as to be superimposed on the image displayed with the predetermined transmittance.

15. A non-transitory computer-readable storage medium storing a program that causes a computer to execute an image processing method, the image process method comprising:

acquiring a captured image of an inspection target;

detecting one or more pieces of defect information based on the image;

determining a predetermined transmittance of the image, based on a trend in the pieces of the defect information, which is a ratio of the area of the pieces of defect information to the area of the image;

setting the predetermined transmittance to an upper limit if the ratio is greater than or equal to a first threshold;

setting the predetermined transmittance between the upper limit and a lower limit if the ratio is greater than or equal to a second threshold or a third threshold, the second and third thresholds being less than the first threshold;

setting the predetermined transmittance to the lower limit if the ratio is less than the third threshold; and

displaying the pieces of detected defect information so as to be superimposed on the image displayed with the predetermined transmittance.

16. An image processing method comprising:

acquiring a captured image of an inspection target;

detecting one or more pieces of defect information based on the image;

determining a predetermined transmittance of the image, based on a trend in the pieces of the defect information;

grouping the pieces of detected defect information into one or more groups in accordance with characteristics of the pieces of defect information, and determining a transmittance of each group of the pieces of defect information;

determining whether or not a first setting for displaying the pieces of defect information in a highlighted state is enabled;

generating a first layer including the image if the first setting is enabled, and, if a second setting for displaying a layer for each group of the pieces of defect information is enabled, a second layer to which a transmittance is set for each group of the pieces of defect information, and, if the first setting is enabled and the second setting is disabled, or if the first setting is disabled, a third layer that includes all pieces of defect information and to which a predetermined transmittance is set; and

displaying the first and second layers so as to be superimposed on one another or to display the first and third layers so as to be superimposed on one another, respectively.

17. A non-transitory computer-readable storage medium storing a program that causes a computer to execute an image processing method, the image process method comprising:

acquiring a captured image of an inspection target;

detecting one or more pieces of defect information based on the image;

determining a predetermined transmittance of the image, based on a trend in the pieces of the defect information;

grouping the pieces of detected defect information into one or more groups in accordance with characteristics of the pieces of defect information, and determining a transmittance of each group of the pieces of defect information;

determining whether or not a first setting for displaying the pieces of defect information in a highlighted state is enabled;

generating a first layer including the image if the first setting is enabled, and, if a second setting for displaying a layer for each group of the pieces of defect information is enabled, a second layer to which a transmittance is set for each group of the pieces of defect information, and, if the first setting is enabled and the second setting is disabled, or if the first setting is disabled, a third layer that includes all pieces of defect information and to which a predetermined transmittance is set; and

displaying the first and second layers so as to be superimposed on one another or to display the first and third layers so as to be superimposed on one another, respectively.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2023
From: TSUKIKAWA, TAKENORI
To: CANON KABUSHIKI KAISHA
Reel/Frame 063559/0478 →
Priority Claims (1)
JP 2022-080353 · May 16, 2022 · national
Continuity (1)
Related Publication 20230368449A1 · Nov 16, 2023
References Cited (18)
US 8654333B2 · Shigeta · 2014 [cited by examiner]
US 9625386B2 · Hatanaka · 2017 [cited by examiner]
US 20090304259A1 · Yamamoto · 2009 [cited by examiner]
US 20120141011A1 · Sakai · 2012 [cited by examiner]
US 20130207965A1 · Hori · 2013 [cited by examiner]
US 20140307946A1 · Nakahira · 2014 [cited by examiner]
US 20190137409A1 · Nogami · 2019 [cited by examiner]
US 20190170659A1 · Kaneko · 2019 [cited by examiner]
US 20190237296A1 · Otani et al. · 2019 [cited by applicant]
US 20210072165A1 · Kaneko · 2021 [cited by examiner]
US 20230135343A1 · Sugawara et al. · 2023 [cited by applicant]
CN 109584224A · 2019 [cited by applicant]
JP 6569002B · 2019 [cited by applicant]
WO 2017168737A1 · 2017 [cited by applicant]
Huthwohl, P. et al., “Multi-classifier for reinforced concrete bridge defects” May 9, 2019, Automation in Construction, vol. 105, pp. 1 to 15 (15 pages). [cited by applicant]
Hao, R. et al., “A steel surface defect inspection approach towards smart industrial monitoring” Sep. 20, 2020, Journal of Intelligent Manufacturing, vol. 32, No. 7, pp. 1833 to 1843 (11 pages). [cited by applicant]
Kim, B. et al., “Automated Multiple Concrete Damage Detection Using Instance Segmentation Deep Learning Model” Nov. 12, 2020, Applied Science, vol. 10, No. 22, pp. 1 to 17 (17 pages). [cited by applicant]
Extended European Search Report issued on Oct. 16, 2023, in corresponding European Patent Application No. 23165884.0 (20 pages). [cited by applicant]