IP Library Granted Patent US 12,254,617
Granted Patent B2
US 12,254,617 · App. 17/335,755 · Granted Mar 18, 2025

Automated in-line object inspection

Inventors: Bruce A. Link (Rochester, NY); Robert W. Johnson (Rochester, NY); Alexander C. Loui (Rochester, NY); Jose Zvietcovich Zegarra (Rochester, NY); Erik Garcell (Rochester, NY)
Assignee: KODAK ALARIS LLC
G06T7/001G01N21/8851G06T3/02G06T7/344G06T7/75G01N2021/8887G06T2207/10028G06T2207/20021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,617
App. No.
17/335,755
Granted
Mar 18, 2025
Kind
B2
Abstract

A system and method for performing real-time quality inspection of objects is disclosed. The system and method include a transport to move objects being inspected, allowing the inspection to be performed in-line. At least one optical acquisition unit is provided that captured optical images of the objects being inspected. The captured optical images are matched to CAD models of objects, and the matched CAD model is extracted. A laser with an illumination light beam has a wavelength in the violet or ultraviolet range then conducts scans of the objects, which are formed into three-dimensional point clouds. The point clouds are compared to the extracted CAD models for each object, where CTF are compared to user input or CAD model information and the object is determined to be acceptable or defective based on the extent of deviation between the point cloud and the CAD model.

Claims (21)

1. A system for automated, in-line inspection of objects comprising:

a transport belt configured to move an object being inspected along a transport path;

an optical acquisition unit configured to capture an image of the object being inspected and to transmit object image data;

at least one laser module comprising a laser driver and at least one laser sensor configured to capture laser scans of the object being inspected by the at least one laser sensor and to generate point cloud data representing the object being inspected;

a system memory including a computer-assisted design (CAD) model database containing CAD models; and

a system processing unit configured to:

analyze the object image data and select a CAD model from the CAD model database corresponding to the object being inspected;

align the CAD model with the point cloud data; and

compare the point cloud data to the CAD model by determining whether respective deviations between one or more point cloud dimensions of the point cloud data and one or more CAD dimensions of the CAD model exceed one or more thresholds.

2. The system of claim 1 , wherein the system processing unit is further configured to determine whether the object being inspected is defective based on the comparison.

3. The system of claim 1 , wherein the at least one laser module is a laser profilometer having a wavelength in a violet or ultraviolet range.

4. The system of claim 1 , further comprising laser module guides restricting movement of the at least one laser module to predetermined directions with respect to the transport path.

5. The system of claim 1 , wherein the at least one laser module includes a first laser module and a second laser module, the first laser module and the second laser module each including a respective laser driver, at least one respective laser sensor, and a microprocessor.

6. The system of claim 1 , wherein the system processing unit is further configured to determine an angular relationship between a field of view of the at least one laser module and the transport path, and to perform a calibration based on determined differences in height between end points of the field of view due to the angular relationship.

7. A method for performing in-line inspection of objects comprising:

positioning an object to be inspected on a transport belt;

moving the object along a transport path using the transport belt;

capturing an optical image of the object with an optical acquisition unit;

capturing point cloud data representing the object with a laser module comprising a laser driver and at least one laser sensor;

selecting a computer-assisted design (CAD) model matching the object being inspected based on the captured optical image in comparison to a database containing CAD models; and

comparing the CAD model to the captured point cloud data by determining whether respective deviations between one or more point cloud dimensions of the captured point cloud data and one or more CAD dimensions of the CAD model exceed one or more thresholds.

Assignments (7)
SHORT-FORM PATENTS SECURITY AGREEMENT Recorded Sep 5, 2025
From: KODAK ALARIS LLC
To: ENCINA PRIVATE CREDIT SPV 2, LLC, AS COLLATERAL AGENT
Reel/Frame 072818/0674 →
RELEASE OF SECURITY INTEREST Recorded Aug 29, 2025
From: FGI WORLDWIDE LLC
To: KODAK ALARIS LLC
Reel/Frame 072740/0681 →
CHANGE OF NAME Recorded Oct 31, 2024
From: KODAK ALARIS INC.
To: KODAK ALARIS LLC
Reel/Frame 069282/0866 →
RELEASE OF SECURITY INTEREST Recorded Aug 7, 2024
From: THE BOARD OF THE PENSION PROTECTION FUND
To: KODAK ALARIS INC.
Reel/Frame 068481/0300 →
SECURITY AGREEMENT Recorded Aug 2, 2024
From: KODAK ALARIS INC.
To: FGI WORLDWIDE LLC
Reel/Frame 068325/0938 →
IP SECURITY AGREEMENT SUPPLEMENT (FISCAL YEAR 2022) Recorded Sep 22, 2022
From: KODAK ALARIS INC.
To: THE BOARD OF THE PENSION PROTECTION FUND
Reel/Frame 061504/0900 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2021
From: LINK, BRUCE; JOHNSON, ROBERT W.; LOUI, ALEXANDER C.; ZEGARRA, JOSE ZVIECOVICH; GARCELL, ERIK
To: KODAK ALARIS INC.
Reel/Frame 056426/0644 →
Continuity (3)
Continuation 16033858 · Jul 12, 2018
Provisional Application 62587806 · Nov 17, 2017
Related Publication 20210295492A1 · Sep 23, 2021
References Cited (62)
US 4328467A · van den Brink · 1982 [cited by examiner]
US 9043069B1 · Ferguson · 2015 [cited by applicant]
US 10284794B1 · Francois · 2019 [cited by applicant]
US 20020018216A1 · Kawasaki · 2002 [cited by applicant]
US 20040066908A1 · Hanke · 2004 [cited by applicant]
US 20040254758A1 · Chang · 2004 [cited by examiner]
US 20050148859A1 · Miga · 2005 [cited by applicant]
US 20090088999A1 · Bryll · 2009 [cited by examiner]
US 20090245616A1 · De La Ballina · 2009 [cited by examiner]
US 20100091300A1 · Thomaschewski · 2010 [cited by applicant]
US 20100316280A1 · Lancaster · 2010 [cited by applicant]
US 20120220851A1 · Razansky · 2012 [cited by applicant]
US 20130121564A1 · Kitamura · 2013 [cited by applicant]
US 20150002598A1 · Furuta · 2015 [cited by examiner]
US 20150054946A1 · Zhang · 2015 [cited by examiner]
US 20150221130A1 · Georgescu · 2015 [cited by applicant]
US 20160300003A1 · Knoll · 2016 [cited by applicant]
US 20160339652A1 · Safai · 2016 [cited by examiner]
US 20170084085A1 · Solorio · 2017 [cited by applicant]
US 20170193278A1 · Mazula · 2017 [cited by applicant]
US 20170280114A1 · Samuelson · 2017 [cited by examiner]
US 20170307736A1 · Donovan · 2017 [cited by examiner]
US 20180021885A1 · O'Connor · 2018 [cited by applicant]
US 20180112426A1 · Cooper · 2018 [cited by applicant]
US 20180149471A1 · Lu · 2018 [cited by applicant]
US 20180150701A1 · Kang · 2018 [cited by applicant]
US 20180374239A1 · Wallack · 2018 [cited by applicant]
US 20190188872A1 · Aflalo · 2019 [cited by applicant]
CN 101927391 · 2010 [cited by applicant]
CN 101927391A · 2010 [cited by examiner]
CN 105844057 · 2016 [cited by applicant]
CN 108303037 · 2018 [cited by applicant]
CN 108458659 · 2018 [cited by applicant]
CN 109682320 · 2019 [cited by applicant]
JP 2014145735 · 2014 [cited by applicant]
WO 2012061945 · 2012 [cited by applicant]
WO 2016146703 · 2016 [cited by applicant]
Non-Final Rejection issued in U.S. Appl. No. 16/033,858, dated May 18, 2020. [cited by applicant]
Notice of Allowance issued in U.S. Appl. No. 16/033,858, dated Oct. 21, 2020. [cited by applicant]
Notice of Allowance issued in U.S. Appl. No. 16/033,858, dated Feb. 12, 2021. [cited by applicant]
Non-Final Rejection issued in U.S. Appl. No. 16/401,890, dated May 14, 2020. [cited by applicant]
Notice of Allowance issued in U.S. Appl. No. 16/401,890, dated Feb. 9, 2021. [cited by applicant]
Non-Final Rejection issued in U.S. Appl. No. 16/923,629, dated Aug. 6, 2020. [cited by applicant]
Final Rejection issued in U.S. Appl. No. 16/923,629, dated Nov. 27, 2020. [cited by applicant]
Notice of Allowance issued in U.S. Appl. No. 16/923,629, dated Apr. 2, 2021. [cited by applicant]
Requirement for Restriction/Election issued in U.S. Appl. No. 17/335,882, dated Mar. 14, 2023. [cited by applicant]
Non-Final Rejection issued in U.S. Appl. No. 17/335,882, dated Aug. 7, 2023. [cited by applicant]
Notice of Allowance issued in U.S. Appl. No. 17/335,882, dated Dec. 13, 2023. [cited by applicant]
International Preliminary Report on Patentability mailed Nov. 2, 2021 in PCT/US2020/030940. [cited by applicant]
International Preliminary Report on Patentability mailed May 19, 2020 in International Application No. PCT/US2018/057732. [cited by applicant]
Bosche, “Automated recognition of 3D CAD model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in construction,” Advanced Engineering Informatics, 24 (2010), pp. 107-118. [cited by applicant]
Kim et al., “Estimating Head Pose with an RGBD Sensor: A Comparison of Appearance-Based and Pose-Based Local Subspace Methods,” 2013 IEEE International Conference on Image Processing, Sep. 15, 2013 pp. 3637-3641. [cited by applicant]
Changmin Kim et al: “Fully Automated Registration of 3D CAD Model with Point Cloud from Construction Site”, Proceedings of the 20th International Symposium on Automation and Robotics in Construction ISARC 2003—The Futur… [cited by applicant]
Rehder Joern et al: “Spatio-temporal laser to visual/inertial calibration with applications to hand-held, large scale scanning”, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, Sep. 14, 2… [cited by applicant]
Li Xiaojie et al: “Auto Calibration of a Laser 3D Color Digitization System”, 2009, 12th European Conference on Computer Vision, ECCV 2012; [Lecture Notes in Computer Science], pp. 691-699, XP047541824, ISSN: 0302-9743 … [cited by applicant]
Delacalle F J et al: “Generation of differential topographic images for surface inspection of long products”, Journal of Real-Time Image Processing, Springer, DE, vol. 17, No. 4, Jan. 11, 2019 (Jan. 11, 2019), pp. 967-9… [cited by applicant]
He Wantao et al: “A robust and accurate automated registration method for turbine blade precision metrology”, The International Journal of Advanced Manufacturing Technology, Springer, London, vol. 97, No. 9, May 29, 201… [cited by applicant]
Communication pursuant to Article 94(3) EPC issued in EP Patent Application No. 18 801 177.9, dated Sep. 20, 2021. [cited by applicant]
Notification of the First Office Action issued in CN Patent Application No. 201880074234.7, dated Dec. 10, 2023. [cited by applicant]
Communication pursuant to Article 94(3) EPC issued in EP Patent Application No. 20 727 498.6, dated Aug. 1, 2023. [cited by applicant]
Communication pursuant to Article 94(3) EPC issued in EP Patent Application No. 18 801 177.9, dated Jan. 31, 2024. [cited by applicant]
Notification of the First Office Action issued in CN Patent Application No. 202080048597.0, dated Aug. 28, 2024. [cited by applicant]