IP Library › Granted Patent US 12,322,085
Granted Patent B2
US 12,322,085 · App. 18/133,739 · Granted Jun 3, 2025

Method and system for inspecting a surface with artificial intelligence assist

Inventors: Ahmed Elhossini (Waterloo, CA); David Paul Smith (Kitchener, CA); Mehrdad Bakhtiari (Kitchener, CA)
Assignee: VIRTEK VISION INTERNATIONAL INC.
G06T7/001G06T7/73G06T2207/20081G06T2207/20084G06T2207/20212G06T2207/30161G06T2207/30164
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,085
App. No.
18/133,739
Granted
Jun 3, 2025
Kind
B2
Abstract

A system for identifying accurate assembly of a component to a workpiece is disclosed. The system includes a light source for projecting light indicia onto the component assembled to the workpiece. A controller includes an artificial intelligence (AI) element defining a machine learning model that establishes a convoluted neural network trained by stored images of light indicia projected onto the component assembled to the workpiece. An imager includes an image sensor system for imaging the workpiece and signaling a current image of the workpiece to the controller. The machine learning model directs inspection of the workpiece to the light indicia imaged by said imager. The AI element determines disposition of the component disposed upon the workpiece through the neural network identifying distortions of the light indicia in the current image.

Claims (20)

1. A system for identifying accurate assembly of a component to a workpiece, comprising:

a light source for projecting light indicia onto the component assembled to the workpiece;

a controller including an artificial intelligence (AI) element including a machine learning model that establishes a convoluted neural network trained by stored images of light indicia projected onto the component assembled to the workpiece;

an imager including an image sensor system for imaging the workpiece and signaling a current image of the workpiece to said controller;

said machine learning model directing inspection of the workpiece to the light indicia imaged by said imager; and

said AI element determining disposition of the component disposed upon the workpiece through said neural network identifying distortions of the light indicia in the current image.

2. The system set forth in claim 1 , wherein said AI element includes deep-learning algorithms (DL) in combination with said CNN.

3. The system set forth in claim 1 , further including a processor for generating a database populated with said stored images.

4. The system set forth in claim 1 , wherein said machine learning model is trained by stored images of the light indicia projected onto the component thereby enabling said AI element to improve accuracy of the inspection.

5. The system set forth in claim 1 , wherein said imager includes a plurality of cameras each including a sensor that is part of said image sensor system.

6. The system set forth in claim 5 , wherein said plurality of cameras generate a composite image of the workpiece and components attached thereto.

7. The system set forth in claim 1 , wherein said imaging system generates pixels of said light indicia from said current image and said controller executes said CNN on the pixels thereby identifying disposition of the component disposed upon the workpiece.

8. The system set forth in claim 1 , wherein said light source is defined as a laser source and said light indicia is defined as a laser line generated by said laser source.

9. The system set forth in claim 1 , wherein the component is a nail and the workpiece is a wood structure.

10. The system set forth in claim 1 , wherein said light indicia projected over a component being properly affixed to the workpiece presents no indicia distortion and said light indicia projected over an improperly installed component presents indicia distortion.

11. The system set forth in claim 1 , wherein said stored images in said AI element include images of a properly installed component and images of an improperly installed component including said light indicia defining disposition of each of said images.

12. The system set forth in claim 1 , further including a laser projector being signaled by said controller disposition of the components and said laser projector scanning a laser icon onto the workpiece adjacent the component being indicative of the disposition of the component.

13. The system set forth in claim 1 , further comprising a reference target being registered to the workpiece by the imager and location of the reference target being correlated to features defined by the workpiece.

14. The system set forth in claim 13 , wherein the controller locates the workpiece within a common coordinate system with said light source, said imager and a laser projector from said reference target.

15. The system set forth in claim 14 , wherein location of the workpiece within the common coordinate system monitored by images generated by said imaging system of features defined by the workpiece.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2023
From: BAKHTIARI, MEHRDAD
To: VIRTEK VISION INTERNATIONAL INC.
Reel/Frame 064356/0788 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2023
From: ELHOSSINI, AHMED; SMITH, DAVID PAUL
To: VIRTEK VISION INTERNATIONAL INC.
Reel/Frame 063313/0568 →
Continuity (3)
Continuation In Part 18087250 · Dec 22, 2022
Provisional Application 63331064 · Apr 14, 2022
Related Publication 20230334653A1 · Oct 19, 2023
References Cited (7)
US 8150105B2 · Mian · 2012 [cited by examiner]
US 9200899B2 · Rueb · 2015 [cited by applicant]
US 10799998B2 · Rueb · 2020 [cited by applicant]
US 20090140887A1 · Breed · 2009 [cited by examiner]
US 20200020112A1 · Buibas · 2020 [cited by examiner]
US 20200202177A1 · Buibas · 2020 [cited by examiner]
US 20220122157A1 · Ross · 2022 [cited by examiner]