IP Library › Granted Patent US 10,281,259
Granted Patent B2
US 10,281,259 · App. 15/876,476 · Granted May 7, 2019

Articulated arm coordinate measurement machine that uses a 2D camera to determine 3D coordinates of smoothly continuous edge features

Inventors: Robert E. Bridges (Kennett Square, PA); Joydeep Yadav (Exton, PA)
Assignee: FARO TECHNOLOGIES, INC.
G01B11/005G01B5/008G01B5/012G01B11/2509G01B11/2513G01B21/047G05B15/02G05B19/401G06T7/13H04N5/2251H04N5/2252H04N13/204G01B2210/58G05B2219/37193G05B2219/40233G05B2219/45061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,281,259
App. No.
15/876,476
Granted
May 7, 2019
Kind
B2
Abstract

A measurement device having a camera captures images of an object at three or more different poses. A processor determines 3D coordinates of an edge point of the object based at least in part on the captured 2D images and pose data provided by the measurement device.

Claims (58)

1. A method of determining three-dimensional (3D) coordinates of an edge point of an object, comprising:

a measurement device having at least one positioning device, a first camera, and an electronic circuit, the electronic circuit receiving a position signal from the positioning device providing data corresponding to a pose of the first camera, the electronic circuit having a processor and memory;

in a first instance:

capturing with the first camera in a first pose a first image of the object;

obtaining from the electronic circuit first data corresponding to the first pose;

in a second instance:

capturing with the first camera in a second pose a second image of the object;

obtaining from the electronic circuit second data corresponding to the second pose;

in a third instance:

capturing with the first camera in a third pose a third image of the object;

obtaining from the electronic circuit third data corresponding to the third pose;

determining with the processor the 3D coordinates of a first edge point, the 3D coordinates of the first edge point determined based at least in part on the first data, the second data, the third data, the first image, the second image, and the third image; and

storing in memory the determine 3D coordinates of the first edge point.

2. The method of claim 1 , wherein the first edge point is within an interval of edge points.

3. The method of claim 1 , wherein the first edge point is identified by the processor as an edge point based at least in part on pixel light levels in the first image.

4. The method of claim 3 , wherein the first edge point is determined by an identification method selected from the group consisting of: subpixel-edge-location-based-on-partial-area-effect technique, moment-based technique, least-squared-error-based technique, and interpolation technique.

5. The method of claim 3 , wherein the 3D coordinates of the first edge point are further determined based on a smoothing of a first edge portion that contains the first edge point, the smoothing filter selected from the group that filters the first edge portion to more closely match a shape selected from the group consisting of: a straight line, a circular curve, and a polynomial curve.

6. The method of claim 3 , further including determining a position of the first edge point in each of the first image, the second image, and the third image based at least in part on epipolar geometry relating the first pose, the second pose, and the third pose of the first camera assembly.

7. The method of claim 6 , further including checking whether the first edge point in the first image, the first edge point in the second image, and the first edge point in the third image, as determined based at least in part on epipolar geometry, are self-consistently determined to be edge points when evaluated based on pixel light levels in the first image, the second image, and the third image, respectively.

8. The method of claim 3 , further including adjusting with the processor the pose of a first object in 3D space to match edges in the first image, the second image, and the third image, wherein at least one of the matched edges includes the first edge point.

9. A method of determining three-dimensional (3D) coordinates of an edge point of an object with a measurement device having a first camera, a second camera, a position device and a processor, the method comprising:

in a first instance:

capturing with the first camera in a first pose a first image of the object, the position device providing data corresponding to a pose of the first camera and the second camera;

determining the first pose with the processor based at least in part on a first data from the position device;

capturing with the second camera in a second pose a second image of the object;

determining the second pose with the processor based at least in part on a second data from the position device;

in a second instance:

capturing with the first camera in a third pose a third image of the object;

determining the third pose with the processor based at least in part on a third data from the position device;

determining with the processor the 3D coordinates of a first edge point, the first edge point being within an interval of edge points, the 3D coordinates of the first edge point determined based at least in part on the first pose, the second pose, the third pose, the first image, the second image, and the third image; and

storing in a memory the 3D coordinates of the first edge point, the memory being operably coupled to the processor.

10. The method of claim 9 , wherein the first edge point is identified by the processor as an edge point based at least in part on pixel light levels in the first image.

11. The method of claim 10 , wherein the first edge point is determined by an identification method selected from the group consisting of: subpixel-edge-location-based-on-partial-area-effect technique, moment-based technique, least-squared-error-based technique, and interpolation technique.

12. The method of claim 10 , further including determining a position of the first edge point in each of the first image, the second image, and the third image based at least in part on epipolar geometry relating the first pose, the second pose, and the third pose of the first camera assembly.

13. The method of claim 12 , further including determining a position of the first edge point in each of the first image, the second image, and the third image based at least in part on epipolar geometry relating the first pose, the second pose, and the third pose of the first camera assembly.

14. The method of claim 13 , further including checking whether the first edge point in the first image, the first edge point in the second image, and the first edge point in the third image, as determined based at least in part on epipolar geometry, are self-consistently determined to be edge points when evaluated based on pixel light levels in the first image, the second image, and the third image, respectively.

15. The method of claim 14 , wherein, in response to a determined lack of self-consistency in the 3D coordinates of the first edge point, an action is selected from the group consisting of: eliminating the first edge point from a list of determined edge points, filtering or smoothing the first edge to obtain consistency in the first edge point, and performing an optimization of the pose of the object in 3D space to obtain self-consistency in the first edge point.

16. The method of claim 10 further including adjusting with the processor the pose of a first object in 3D space to match edges in the first image, the second image, and the third image, wherein at least one of the matched edges includes the first edge point.

17. A measurement device for determining three-dimensional (3D) coordinates of an edge point of an object, the measurement device comprising:

at least one positioning device;

a first camera operably coupled to the at least one positioning device;

an electronic circuit having a processor and memory, the electronic circuit being operably coupled to receive data from the positioning device corresponding to a pose of the first camera;

wherein the processor is responsive to nontransitory executable computer instructions to:

in a first instance:

cause the first camera to capture in a first pose a first image of the object;

determine the first pose in response to a first data from the at least one positioning device;

in a second instance:

cause the first camera to capture in a second pose a second image of the object;

determine the second pose in response to a second data from the at least one positioning device;

in a third instance:

causing the first camera to capture in a third pose a third image of the object;

determine the third pose in response to a third data from the at least one positioning device; and

determining the 3D coordinates of a first edge point, the 3D coordinates of the first edge point determined based at least in part on the first pose, the second pose, the third pose, the first image, the second image, and the third image.

18. The system of claim 17 , further comprising:

a base;

a manually positionable arm portion having an opposed first end and second end, the arm portion being rotationally coupled to the base, the arm portion including a plurality of connected arm segments; and

wherein the at least one positioning device includes at least one position transducer coupled to each arm segment for producing a position signal.

19. The system of claim 18 , further comprising an electronic circuit that receives the position signal from each of the at least one position transducer and provides data corresponding to a pose of the first camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2018
From: BRIDGES, ROBERT E.; YADAV, JOYDEEP
To: FARO TECHNOLOGIES, INC.
Reel/Frame 044687/0570 →
Continuity (9)
Continuation 15481673 · Apr 7, 2017
Continuation In Part 14679580 · Apr 6, 2015
Continuation In Part 14485876 · Sep 15, 2014
Continuation In Part 13491176 · Jun 7, 2012
Continuation In Part 13006507 · Jan 14, 2011
Provisional Application 61355279 · Jun 16, 2010
Provisional Application 61351347 · Jun 4, 2010
Provisional Application 61296555 · Jan 20, 2010
Related Publication 20180172428A1 · Jun 21, 2018
Cited By (1)
US 12,246,442