Image processing apparatus, image processing method, and non-transitory computer-readable medium
An image processing apparatus is provided. The apparatus acquires a plurality of captured images acquired by shooting an inspection target object under a plurality of illumination conditions. The apparatus performs a first inspection for inspecting a surface profile of the inspection target object based on a normal image indicating a normal direction of each position of the inspection target object. The normal image is generated from the plurality of captured images. The apparatus performs a second inspection for inspecting a surface profile of the inspection target object based on the plurality of captured images, the second inspection being different from the first inspection.
1 . An image processing apparatus comprising:
one or more memories storing instructions and one or more processors that execute the instructions to:
(1) acquire a plurality of captured images acquired by shooting an inspection target object under a plurality of illumination conditions;
(2) determine a region to be inspected by a first inspection and a region to be inspected by a second inspection, respectively, wherein a region that does not have predetermined characteristics on the surface of the inspection target object is a region to be inspected by the first inspection, wherein a region having the predetermined characteristics is a region to be inspected by the second inspection, and wherein the region having the predetermined characteristics is at least one of a shadow region and a surface reflection region;
(3) perform the first inspection for inspecting a surface profile of the inspection target object based on a normal vector direction image indicating a normal vector direction of each position of the inspection target object, the normal vector direction representing a direction perpendicular to a surface of the target object, and the normal vector direction image being generated from the plurality of captured images; and
(4) perform the second inspection for inspecting a surface profile of the inspection target object based on the plurality of captured images, the second inspection being different from the first inspection.
2 . The image processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to perform the first inspection to detect a defect with regard to a surface profile of the inspection target object by performing a filtering process on the normal vector direction image.
3 . The image processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to perform the second inspection to inspect the surface profile of the inspection target object based on each of the plurality of captured images, or a composite image of the plurality of captured images, without using the normal vector direction image.
4 . The image processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to perform the second inspection to detect a defect with regard to a surface profile of the inspection target object by performing a filtering process on each of the plurality of captured images or a composite image of the plurality of captured images.
5 . The image processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to determine a region having the predetermined characteristics on the surface of the inspection target object.
6 . The image processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to determine a region within the captured image, the region having pixel values included in a predetermined range.
7 . The image processing apparatus according to claim 6 , wherein the pixel values of pixels in the region in at least one of the plurality of captured images are included in the predetermined range.
8 . The image processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to determine which of the first or the second inspections is to be performed.
9 . The image processing apparatus according to claim 1 , wherein the one or more processors execute the instructions to (1) determine to perform the first inspection when no region having predetermined characteristics has been detected on the surface of the inspection target object, and (2) determine to perform the second inspection when a region having the predetermined characteristics has been detected on the surface of the inspection target object.
10 . The image processing apparatus according to claim 8 , wherein the one or more processors execute the instructions to determine which of the first and the second inspections is to be performed in accordance with information related to the inspection target object which has been set by a user.
11 . The image processing apparatus according to claim 10 , wherein the information related to the inspection target object indicates at least one of (1) shape characteristics of the inspection target object and (2) surface properties of the inspection target object.
12 . The image processing apparatus according to claim 10 , wherein the one or more processors execute the instructions to (1) determine to perform the second inspection when the information related to the inspection target object satisfies a condition including at least one of: (a) the inspection target object has a concave portion; and (b) the inspection target object is glossy, and (2) determine to perform the first inspection when the information related to the inspection target object does not satisfy the condition.
13 . The image processing apparatus according to claim 10 , wherein the information related to the inspection target object indicates at least one of: (1) whether or not the inspection target object is moving; and (2) a moving speed of the inspection target object.
14 . The image processing apparatus according to claim 10 , wherein the one or more processors execute the instructions to (1) determine to perform the second inspection when the information related to the inspection target object satisfies a condition including at least one of: (a) the inspection target object is moving; and (b) the moving speed of the inspection target object has exceeded a threshold value, and (2) determine to perform the first inspection when the information related to the inspection target object does not satisfy the condition.
15 . The image processing apparatus according to claim 10 , wherein the one or more processors execute the instructions to cause a display device to display a user interface to be used by a user to input the information related to the inspection target object.
16 . An image processing method comprising:
acquiring a plurality of captured images acquired by shooting an inspection target object under a plurality of illumination conditions;
determining a region to be inspected by a first inspection and a region to be inspected by a second inspection, respectively, wherein a region that does not have predetermined characteristics on the surface of the inspection target object is a region to be inspected by the first inspection, wherein a region having the predetermined characteristics is a region to be inspected by the second inspection, and wherein the region having the predetermined characteristics is at least one of a shadow region and a surface reflection region;
performing the first inspection for inspecting a surface profile of the inspection target object based on a normal vector direction image indicating a normal vector direction of each position of the inspection target object, the normal vector direction representing a direction perpendicular to a surface of the target object, and the normal vector direction image being generated from the plurality of captured images; and
performing the second inspection for inspecting a surface profile of the inspection target object based on the plurality of captured images, the second inspection being different from the first inspection.
17 . A non-transitory computer-readable medium storing a program executable by a computer to cause the computer to:
acquire a plurality of captured images acquired by shooting an inspection target object under a plurality of illumination conditions;
determine a region to be inspected by a first inspection and a region to be inspected by a second inspection, respectively, wherein a region that does not have predetermined characteristics on the surface of the inspection target object is a region to be inspected by the first inspection, wherein a region having the predetermined characteristics is a region to be inspected by the second inspection, and wherein the region having the predetermined characteristics is at least one of a shadow region and a surface reflection region;
perform the first inspection for inspecting a surface profile of the inspection target object based on a normal vector direction image indicating a normal vector direction of each position of the inspection target object, the normal vector direction representing a direction perpendicular to a surface of the target object, and the normal vector direction image being generated from the plurality of captured images; and
perform the second inspection for inspecting a surface profile of the inspection target object based on the plurality of captured images, the second inspection being different from the first inspection.