IP Library Granted Patent US 10,907,955
Granted Patent B2
US 10,907,955 · App. 16/518,135 · Granted Feb 2, 2021

Three-dimensional imager

Inventors: Matthew Armstrong (Glenmoore, PA); Christopher S. Garcia (Malvern, PA); Theodore J. Hordeski, Jr. (Dresher, PA); Michael Veksland (Mount Laurel, NJ); Yevgeniy Vinshtok (Downingtown, PA)
Assignee: FARO TECHNOLOGIES, INC.
G01B11/14G01B11/245G01B11/25G01B21/042G01C3/08G01C3/10G01C11/00G01S17/48G06T7/60H04N13/254G06T2207/30204G06T2207/30244H04N13/246H04N2013/0081H05K7/20136
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,907,955
App. No.
16/518,135
Filed
Jul 22, 2019
Granted
Feb 2, 2021
Kind
B2
Art Unit
2425
USPC
382/106
Abstract

A three-dimensional (3D) measuring system and a method of determining a distance is provided. A three-dimensional (3D) measuring system includes a master part having a first base part and a first part-under-test including a second base. A photogrammetry camera images the master part to generate two-dimensional (2D) images. A first 3D imager determines 3D coordinates in a first imager frame of reference. A second 3D imager determines 3D coordinates in a second imager frame of reference. The system determines in a system frame of reference a first pose of the first imager and a second pose of the second imager. The system is further configured to determine 3D coordinates of the first part-under-test in the system frame of reference.

Claims (70)

1. A three-dimensional (3D) measuring system comprising:

a master part including a first base part selected from a plurality of base parts, there being at least three fiducial markers affixed to the first base part;

a first part-under-test including a second base part selected from the plurality of base parts;

a photogrammetry camera configured to image the master part, including the at least three fiducial markers, from a plurality of photogrammetry camera positions to obtain a corresponding plurality of photogrammetry two-dimensional (2D) images;

a first 3D imager having a first projector and a first camera, the first 3D imager configured to determine 3D coordinates in a first imager frame of reference;

a second 3D imager having a second projector and a second camera, the second 3D imager configured to determine 3D coordinates in a second imager frame of reference,

wherein the system is configured to determine in a system frame of reference a first pose of the first 3D imager and a second pose of the second 3D imager based at least in part on the plurality of photogrammetry 2D images, determined 3D coordinates of at least three fiducial markers from among the at least three fiducial markers in the first imager frame of reference, and determined 3D coordinates of at least three fiducial markers from among the at least three fiducial markers in the second imager frame of reference, and

wherein the system is further configured to determine 3D coordinates of the first part-under-test in the system frame of reference based at least in part on the determined first pose, the determined second pose, determined 3D coordinates of the first part-under-test by the first 3D imager in the first imager frame of reference, and determined 3D coordinates of the first part-under-test by the second 3D imager in the second imager frame of reference.

2. The system of claim 1 , further comprising:

a scale bar having a first target and a second target, a distance between the first target and the second target being a calibrated reference distance, the scale bar being configured to be fixedly positioned relative to the master part, the first target and the second target being visible in the plurality of photogrammetry 2D images,

wherein the system if further configured to determine the first pose and the second pose based on the calibrated reference distance.

3. The system of claim 1 , wherein the three fiducial markers include retroreflective targets and the photogrammetry camera further includes a flash unit configured to illuminate the retroreflector targets.

4. The system of claim 1 , wherein the at least two of the plurality of photogrammetry 2D images are obtained with the photogrammetry camera rotated to different orientations.

5. The system of claim 1 , wherein:

the first 3D imager further includes a processor configured to determine the 3D coordinates in the first imager frame of reference, and is further configured to cooperate with an external computer to determine the 3D coordinates in the first imager frame of reference; and

the second 3D imager further includes a processor configured to determine the 3D coordinates in the second imager frame of reference, and is further configured to cooperate with the external computer to determine the 3D coordinates in the second imager frame of reference,

wherein the system is further configured to cooperate with an external computer to determine in the system frame of reference the first pose of the first 3D imager and the second pose of the second 3D imager.

6. The system of claim 1 , wherein the system further comprises:

a second part-under-test including a third base part selected from the plurality of base parts,

wherein the system is further configured to determine 3D coordinates of the second part-under-test in the system frame of reference based at least in part on the determined first pose, the determined second pose, determined 3D coordinates of the second part-under-test by the first 3D imager in the first imager frame of reference, and determined 3D coordinates of the second part-under-test by the second 3D imager in the second imager frame of reference.

7. The system of claim 1 , wherein:

the at least three fiducial markers from among the at least three fiducial markers in the first imager frame of reference includes at least one fiducial marker not included in the at least three fiducial markers from among the at least three fiducial markers in the second imager frame of reference, and

the at least three fiducial markers includes a first marker, a second marker, a third marker, a fourth marker, a fifth marker, and a sixth marker, the at least three fiducial markers from among the at least three fiducial markers in the first imager frame of reference including the first marker, the second marker, and the third marker but not the fourth marker, the fifth marker or the sixth marker, the at least three fiducial markers from among the at least three fiducial markers in the second imager frame of reference including the fourth marker, the fifth marker, and the sixth marker but not the first marker, the second marker, or the third marker.

8. A method comprising:

providing a master part, a first part-under-test, a photogrammetry camera, a first three-dimensional (3D) imager, and a second 3D imager, the master part including a first base part selected from a plurality of base parts, there being at least three fiducial markers affixed to the first base part, the first part-under-test including a second base part selected from the plurality of base parts, the first 3D imager having a first projector, a first camera, and a first frame of reference, the second 3D imager having a second projector, a second camera, and a second frame of reference;

imaging the master part, including the at least three fiducial markers, with the photogrammetry camera from a plurality of photogrammetry camera positions to obtain a corresponding plurality of photogrammetry two-dimensional (2D) images;

determining with the first 3D imager 3D coordinates of the at least three fiducial markers in the first frame of reference;

determining with the second 3D imager 3D coordinates of the at least three fiducial markers in the second frame of reference;

determining in a system frame of reference a first pose of the first 3D imager and a second pose of the second 3D imager based at least in part on the plurality of photogrammetry 2D images, the determined 3D coordinates of at least three fiducial markers from among the at least three fiducial markers in the first frame of reference, and the determined 3D coordinates of at least three fiducial markers from among the at least three fiducial markers in the second frame of reference;

determining with the first 3D imager first 3D coordinates of the first part-under-test in the first frame of reference;

determining with the second 3D imager second 3D coordinates of the first part-under-test in the second frame of reference;

determining 3D coordinates of the first part-under-test in the system frame of reference based at least in part on the determined first pose, the determined second pose, the determined first 3D coordinates of the first part-under-test in the first imager frame of reference, and the determined second 3D coordinates of the first part-under-test in the second frame of reference; and

storing the 3D coordinates of the first part-under-test in the system frame of reference.

9. The method of claim 8 , further comprising:

providing a scale bar having a first target and a second target, a distance between the first target and the second target being a calibrated reference distance, the scale bar being configured to be fixedly positioned relative to the master part, the first target and the second target being visible in the plurality of photogrammetry 2D images,

wherein in determining in a system frame of reference a first pose of the first 3D imager and a second pose of the second 3D imager, the first pose and the second pose are further based on the calibrated reference distance.

10. The method of claim 8 , wherein:

the at least three fiducial markers include retroreflective targets,

the photogrammetry camera further includes a flash unit configured to illuminate the retroreflector targets, and

the at least two of the plurality of photogrammetry 2D images are obtained with the photogrammetry camera rotated to different orientations.

11. The method of claim 8 , further comprising:

providing a second part-under-test, including a third base part selected from the plurality of base parts; and

determining 3D coordinates of the second part-under-test in the system frame of reference based at least in part on the determined first pose, the determined second pose, determined 3D coordinates of the second part-under-test by the first 3D imager in the first imager frame of reference, and determined 3D coordinates of the second part-under-test by the second 3D imager in the second imager frame of reference.

12. The method of claim 8 , wherein:

in providing the master part, the part-under-test, the photogrammetry camera, the first 3D imager, and the second 3D imager, the first 3D imager further includes a first processor and the second 3D imager further includes a second processor,

in determining with the first 3D imager first 3D coordinates of the part-under-test in the first frame of reference, the first processor determines the first 3D coordinates; and

in determining with the second 3D imager second 3D coordinates of the part-under-test in the second frame of reference, the second processor determines the second 3D coordinates.

13. The method of claim 8 , wherein:

in determining with the first 3D imager first 3D coordinates of the part-under-test in the first frame of reference, the first 3D imager cooperates with an external computer to determine the 3D coordinates of the part-under-test in the first frame of reference; and

in determining with the second 3D imager second 3D coordinates of the part-under-test in the second frame of reference, the second 3D imager cooperates with the external computer to determine the 3D coordinates of the part-under-test in the second frame of reference; and

in determining in a system frame of reference a first pose of the first 3D imager and a second pose of the second 3D imager, an external computer assists in determining in the system frame of reference the first pose of the first 3D imager and the second pose of the second 3D imager.

14. A three-dimensional (3D) measuring system comprising:

a master part including a first base part, there being at least three fiducial markers affixed to the first base part;

a first part-under-test including a second base part;

a photogrammetry camera configured to image the master part, including the at least three fiducial markers, and to obtain a plurality of photogrammetry 2D images;

a first 3D imager having a first projector and a first camera, the first 3D imager configured to determine 3D coordinates in a first imager frame of reference;

a second 3D imager having a second projector and a second camera, the second 3D imager configured to determine 3D coordinates in a second imager frame of reference; and

one or more processors responsive to executable computer instructions, to perform a method comprising:

determine first 3D coordinates of at least three fiducial markers from among the at least three fiducial markers in the first imager frame of reference;

determine second 3D coordinates of at least three fiducial markers from among the at least three fiducial markers in the second imager frame of reference;

determine in a system frame of reference a first pose of the first 3D imager and a second pose of the second 3D imager based at least in part on the plurality of photogrammetry 2D images, the first 3D coordinates and the second 3D coordinates;

determine in a system frame of reference a first pose of the first 3D imager and a second pose of the second 3D imager based at least in part on the plurality of photogrammetry 2D images, the first 3D coordinates, and the second;

determine a third 3D coordinates of the first part-under-test by the first 3D imager in the first imager frame of reference;

determine a fourth 3D coordinates of the first part-under-test by the second 3D imager in the second imager frame of reference; and

determine a third 3D coordinates of the first part-under-test in the system frame of reference based at least in part on the determined first pose, the determined second pose, the third 3D coordinates and the fourth 3D coordinates.

15. The system of claim 14 , further comprising:

a scale bar having a first target and a second target, a distance between the first target and the second target being a calibrated reference distance, the scale bar being configured to be fixedly positioned relative to the master part, the first target and the second target being visible in the plurality of photogrammetry 2D images,

wherein the method further comprises determining the first pose and the second pose based on the calibrated reference distance.

16. The system of claim 14 , wherein the three fiducial markers include retroreflective targets and the photogrammetry camera further includes a flash unit configured to illuminate the retroreflector targets.

17. The system of claim 14 , wherein the at least two of the plurality of photogrammetry 2D images are obtained with the photogrammetry camera rotated to different orientations.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2019
From: ARMSTRONG, MATTHEW; GARCIA, CHRISTOPHER S.; HORDESKI, THEODORE J., JR.; VEKSLAND, MICHAEL; VINSHTOK, YEVGENIY
To: FARO TECHNOLOGIES, INC.
Reel/Frame 049819/0778 →
Continuity (12)
Continuation 15457045 · Mar 13, 2017
Continuation In Part 15233415 · Aug 10, 2016
Provisional Application 62309024 · Mar 16, 2016
Provisional Application 62276325 · Jan 8, 2016
Provisional Application 62276329 · Jan 8, 2016
Provisional Application 62276319 · Jan 8, 2016
Provisional Application 62272451 · Dec 29, 2015
Provisional Application 62272461 · Dec 29, 2015
Provisional Application 62272469 · Dec 29, 2015
Provisional Application 62272442 · Dec 29, 2015
Provisional Application 62207047 · Aug 19, 2015
Related Publication 20190346257A1 · Nov 14, 2019
Cited By (1)
US 12,254,642