Granted Patent B2

US 12,506,947 · App. 18/429,510 · Granted Dec 23, 2025

Inventors: Wushu Li (Fujian, CN); Guijia Qiu (Fujian, CN)

Assignee: CONTEMPORARY AMPEREX TECHNOLOGY (HONG KONG) LIMITED

H04N23/56G06T5/50G06T7/001G06T7/11H04N23/51H04N23/695G06T2207/20221G06T2207/30108H01M50/209H01M50/289

Abstract

Claims (91)

1 . A visual inspection apparatus, comprising:

an image acquisition structure;

a driver, wherein the driver is drivingly connected to the image acquisition structure for driving the image acquisition structure to reciprocate in a length direction of a gluing region of a lower box body and acquire an inspection image of the entire gluing region;

a controller, wherein the controller is electrically connected to the image acquisition structure and the driver to control acquisition of the image acquisition structure and operation of the driver; and

a light source, the light source is disposed on one side of the image acquisition structure and electrically connected to the controller, and the light source is configured to emit light toward the gluing region,

wherein the light source is movably disposed relative to the image acquisition structure to adjust an emission angle of the light source relative to a horizontal plane; and/or

an included angle between the emission angle of the light source and an axis of the image acquisition structure is in a range of greater than or equal to 30° to less than or equal to 60°.

2 . The visual inspection apparatus according to claim 1 , wherein the image acquisition apparatus comprises a line scan camera; and/or

the light source comprises a linear light source.

3 . The visual inspection apparatus according to claim 1 , wherein the light source comprises a first light source and a second light source, the first light source is disposed on one side of the image acquisition structure in a moving direction, the second light source is disposed on the other side of the image acquisition structure in the moving direction, and the first light source and the second light source have different emission angles.

4 . The visual inspection apparatus according to claim 3 , wherein the controller is further configured to: turn on the first light source and control the image acquisition structure to move from one side in the length direction of the gluing region to the other side opposite thereto; and turn on the second light source and control the image acquisition structure to move from the other side in the length direction of the gluing region to the side opposite thereto.

5 . An inspection method of a visual inspection apparatus, the visual inspection apparatus comprising a driver, an image acquisition structure, and a controller, wherein the inspection method comprises the steps of:

sending a driving instruction to the driver so that the driver drives the image acquisition structure to reciprocate in a length direction of a gluing region of a lower box body, and sending an image acquisition instruction to the image acquisition structure so that the image acquisition structure acquires an inspection image of the gluing region; and

obtaining the inspection image and sending it to a server,

wherein the visual inspection apparatus comprises a light source which includes a first light source and a second light source, the first light source is disposed on one side of the image acquisition structure in a moving direction, the second light source is disposed on the other side of the image acquisition structure in the moving direction, and the first light source and the second light source have different emission angles; and wherein the inspection method of the visual inspection apparatus comprises:

sending an instruction to turn on the first light source;

sending a driving instruction to the driver to move the image acquisition structure from one side of the gluing region close to the first light source to the other side opposite thereto, and sending an acquisition instruction to the image acquisition structure to acquire a first image;

obtaining the first image and sending it to a server;

sending an instruction to turn on the second light source and turn off the first light source;

sending a driving instruction to the driver to move the image acquisition structure from one side of the gluing region close to the second light source to the other side opposite thereto, and sending an acquisition instruction to the image acquisition structure for acquiring a second image; and

obtaining the second image and sending it to the server, and

wherein the light source is movably disposed relative to the image acquisition structure to adjust an emission angle of the light source relative to a horizontal plane; and/or

an included angle between the emission angle of the light source and an axis of the image acquisition structure is in a range of greater than or equal to 30° to less than or equal to 60°.

6 . An inspection system, comprising:

a visual inspection apparatus, being the visual inspection apparatus according to claim 1 ; and

a server, electrically connected to the controller and configured to receive and determine whether a gluing region is up to standard based on the inspection image.

7 . The inspection system according to claim 6 , wherein the inspection system further comprises a chassis, the chassis comprises two frames disposed oppositely and a cross beam slidably connected to the two frames, and a lower box body is accommodated between the two frames; and

a driver of the visual inspection apparatus is mounted on the frame and drivingly connected to the cross beam, and the image acquisition structure is disposed on the cross beam and positioned above a gluing region of the lower box body to reciprocate in a length direction of the gluing region under the drive of the driver.

8 . The inspection system according to claim 7 , wherein the inspection system further comprises a first drive structure and a light source, the light source is disposed on one side of the image acquisition structure, and the first drive structure is disposed on the cross beam and drivingly connected to the image acquisition structure and the light source for driving the image acquisition structure and the light source to reciprocate in a width direction of the gluing region.

9 . The inspection system according to claim 8 , wherein the inspection system further comprises a second drive structure, the cross beam is fitted with a slider, the first drive structure is drivingly connected to the slider, the second drive structure is mounted on the slider and drivingly connected to the image acquisition structure and the light source for driving the image acquisition structure and the light source to reciprocate in a thickness direction of the gluing region.

10 . The inspection system according to claim 7 , wherein the inspection system further comprises a lifting structure, and the lifting structure is disposed between the two frames and drivingly connected to the lower box body for driving the lower box body to reciprocate in a vertical direction.

11 . The inspection system according to claim 10 , wherein the lifting structure comprises a base, a lifting assembly disposed in the base, and two clamping structures disposed oppositely, the two clamping structures are capable of moving towards or away from each other to clamp or release the lower box body, and the lifting assembly is drivingly connected to the clamping structures for driving the clamping structures up or down.

12 . The inspection system according to claim 7 , wherein the inspection system further comprises two grating gates, an inspection channel is formed between the two frames, an extension direction of the inspection channel is consistent with the length direction of the gluing region, and the inspection channel has an entrance and an exit disposed oppositely, wherein one of the grating gates is disposed at the entrance of the inspection channel, and the other one of the grating gates is disposed at the exit of the inspection channel.

13 . The inspection system according to claim 7 , wherein the inspection system comprises home sensors and limit sensors, the home sensors are disposed at initial positions of the image acquisition structure and the light source, and the limit sensors are disposed at moving paths of the image acquisition structure and the light source.

14 . The inspection system according to claim 6 , wherein the server is configured to send an inspection instruction to the controller to instruct the image acquisition structure to acquire at least two inspection images; and

the server is further configured to: obtain at least two inspection images, perform image fusion on the at least two inspection images to eliminate image reflection, and determine whether the gluing region is up to standard.

15 . An inspection method of an inspection system, wherein the inspection system comprises a visual inspection apparatus, a server, and a light source, and the inspection method of the inspection system comprises the steps of:

receiving, by the server, a request for inspecting a lower box body, and sending an inspection instruction to a controller;

receiving, by the controller, the inspection instruction, and sending a driving instruction to a driver and an acquisition instruction to an image acquisition structure;

driving, by the driver, the image acquisition structure and the light source to reciprocate in the length direction of a gluing region of the lower box body, and acquiring, by the image acquisition structure, an inspection image and sending it to the controller; and

receiving, by the server, the inspection image sent by the controller for processing and analysis to determine whether the gluing region of the lower box body is up to standard,

wherein the step of receiving, by the controller, the inspection instruction and sending a driving instruction to a driver and an acquisition instruction to an image acquisition structure comprises:

receiving, by the controller, the inspection instruction, and sending a reset instruction to the driver;

driving, by the driver, the image acquisition structure and the light source to move back to their initial inspection positions; and

sending, by the controller, a driving instruction to the driver and an acquisition instruction to the image acquisition structure, and

wherein the inspection system further comprises a lifting structure, and after the step of driving, by the driver, the image acquisition structure and the light source to move back to their initial inspection positions, the inspection method comprises the steps of:

sending, by the controller, a lifting instruction to the lifting structure; and

raising, by the lifting structure, the lower box body to a preset height so that a tray carrying the lower box body is parallel to a horizontal plane.

16 . The inspection method of the inspection system according to claim 15 , wherein the light source comprises a first light source and a second light source, the first light source is disposed on one side of the image acquisition structure in a moving direction, the second light source is disposed on the other side of the image acquisition structure in the moving direction, the first light source and the second light source have different emission angles, and the inspection instruction comprises acquiring at least a first image and a second image; and the inspection method comprises:

issuing, by the controller, an instruction to turn on the first light source and turn off the second light source, and sending a first driving instruction;

receiving, by the driver, the first driving instruction and driving the image acquisition structure and the light source to move from one side in the length direction of the gluing region of the lower box body to the opposite side, and acquiring, by the image acquisition structure, the first image and sending it to the controller;

issuing, by the controller, an instruction to turn on the second light source and turn off the first light source, and sending a second driving instruction;

receiving, by the driver, the second driving instruction and driving the image acquisition structure and the light source to move from the other side in the length direction of the gluing region of the lower box body to the opposite side, and acquiring, by the image acquisition structure, the second image and sending it to the controller;

receiving, by the server, the first image and the second image sent by the controller, and performing image fusion processing to eliminate image reflection and obtain a target inspection image of the gluing region; and

determining, by the server based on the target inspection image, whether the gluing region is up to standard.

17 . The inspection method of the inspection system according to claim 16 , wherein the step of receiving, by the server, the first image and the second image sent by the controller, and performing image fusion processing to eliminate image reflection and obtain a target inspection image of the gluing region comprises:

performing, by the server, grayscale processing on the first image and the second image to obtain a first grayscale image and a second grayscale image, respectively;

performing, by the server, binarization processing on the first grayscale image and the second grayscale image to obtain a first binarized grayscale image and a second binarized grayscale image, respectively;

obtaining, by the server, an intersection region of the first binarized grayscale image and first binarized grayscale image to obtain a non-reflective region;

obtaining, by the server, a highlighted region and a shadow region of the first image and a highlighted region and a shadow region of the second image through calculation based on the first binarized grayscale image, first binarized grayscale image, and the non-reflective region; and

setting, by the server based on respective highlighted regions and shadow regions of the first image and the second image, a preset weight, and superimposing the first image and the second image to obtain the target inspection image.

18 . The inspection method of the inspection system according to claim 17 , wherein the step of setting, by the server based on respective highlighted regions and shadow regions of the first image and the second image, a preset weight, and superimposing the first image and the second image to obtain the target inspection image comprises:

setting, by the server, a proportion of a shadow region of one of the first image and the second image at a position at which the first image and the second image overlap to x, and a proportion of the shadow region of the other of the first image and the second image at the position at which the first image and the second image overlap to 1-x;

setting, by the server, a proportion of a highlighted region of one of the first image and the second image to 0 and a proportion of a shadow region of the other of the first image and the second image at a corresponding position to 1; and

superimposing, by the server, the first image and the second image to obtain the target inspection image.

19 . The inspection method of the inspection system according to claim 16 , wherein the step of determining, based on the target inspection image, whether the gluing region is up to standard comprises:

obtaining, by the server, a standard inspection image and performing a comparison calculation with the target inspection image; and

determining by the sever that the gluing region is up to standard under the condition that comparison values are consistent.

20 . The method of detecting an inspection system according to claim 15 , wherein after the step of raising, by the lifting structure, the lower box body to a preset height so that a tray carrying the lower box body is parallel to a horizontal plane, the inspection method further comprises:

issuing, by the controller, an inspection instruction to inspect whether the gluing region of the lower box body is at the horizontal plane;

if not, issuing, by the controller, a leveling driving instruction to the driver; and

driving, by the driver, the image acquisition structure to move in the vertical direction while moving in the length direction of the gluing region of the lower box body so that a moving path of the image acquisition structure is parallel to the surface of the gluing region and to acquire an inspection image.

21 . An inspection method of an inspection system, wherein the inspection system comprises a visual inspection apparatus, a server, and a light source, and the inspection method of the inspection system comprises the steps of:

receiving a request for inspecting a lower box body, and sending an inspection instruction to a controller so that the controller controls a driver to drive the image acquisition structure and a light source to reciprocate in a length direction of a gluing region of the lower box body and instruct the image acquisition structure to acquire an inspection image; and

receiving the inspection image for processing and analysis to determine whether the gluing region of the lower box body is up to standard,

wherein the inspection instruction comprises acquiring at least a first image and a second image, and the step of receiving the inspection image for processing and analysis to determine whether the gluing region of the lower box body is up to standard comprises:

receiving the first image and the second image sent by the controller, and performing image fusion processing to eliminate image reflection and obtain a target inspection image of the gluing region; and

determining whether the gluing region is up to standard based on the target inspection image.

22 . The inspection method of the inspection system according to claim 21 , wherein the step of receiving the first image and the second image sent by the controller, and performing image fusion processing to eliminate image reflection and obtain a target inspection image of the gluing region comprises:

performing grayscale processing on the first image and the second image to obtain a first grayscale image and a second grayscale image, respectively;

performing binarization processing on the first grayscale image and the second grayscale image to obtain a first binarized grayscale image and a second binarized grayscale image, respectively;

obtaining an intersection region of the first binarized grayscale image and first binarized grayscale image to obtain a non-reflective region;

obtaining a highlighted region and a shadow region of the first image and a highlighted region and a shadow region of the second image through calculation based on the first binarized grayscale image, first binarized grayscale image, and the non-reflective region; and

setting, based on respective highlighted regions and shadow regions of the first image and the second image, a preset weight, and superimposing the first image and the second image to obtain the target inspection image.

23 . The inspection method of the inspection system according to claim 22 , wherein the step of setting, by the server based on respective highlighted regions and shadow regions of the first image and the second image, a preset weight, and superimposing the first image and the second image to obtain the target inspection image comprises:

setting a proportion of a shadow region of one of the first image and the second image at a position at which the first image and the second image overlap to x, and a proportion of the shadow region of the other of the first image and the second image at the position at which the first image and the second image overlap to 1-x;

setting a proportion of a highlighted region of one of the first image and the second image to 0 and a proportion of a shadow region of the other of the first image and the second image at a corresponding position to 1; and

superimposing the first image and the second image to obtain the target inspection image.

24 . The inspection method of the inspection system according to claim 21 , wherein the step of determining, based on the target inspection image, whether the gluing region is up to standard comprises:

obtaining a standard inspection image and performing a comparison calculation with the target inspection image; and

determining that the gluing region is up to standard under the condition that comparison values are consistent.

Assignments (2)

Continuity (2)

References Cited (16)