IP Library › Granted Patent US 10,502,557
Granted Patent B2
US 10,502,557 · App. 16/224,693 · Granted Dec 10, 2019

Method for the three dimensional measurement of a moving objects during a known movement

Inventor: Bastian Harendt (Jena, DE)
Assignee: Cognex Corporation
G01B11/25G06T7/285G06T7/40G06T7/97G06T2207/10021G06T2207/30241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,502,557
App. No.
16/224,693
Granted
Dec 10, 2019
Kind
B2
Abstract

A 3D measurement method including; projecting a pattern sequence onto a moving object; capturing a first image sequence with a first camera and a second image sequence synchronously to the first image sequence with a second camera; determining corresponding image points in the two sequences; computing a trajectory of a potential object point from imaging parameters and from known movement data for each pair of image points that is to be checked for correspondence, The potential object point is imaged by both image points in case they correspond. Imaging object positions derived therefrom at each of the capture points in time into image planes respectively of the two cameras. Corresponding image points positions are determined as trajectories in the two cameras and the image points are compared with each other along predetermined image point trajectories and examined for correspondence; lastly performing 3D measurement of the moved object by triangulation.

Claims (51)

1. A method for three-dimensional measurement of a moving object during a known relative movement between the moving object and a measuring sensor, the method comprising the steps:

projecting a pattern sequence of N patterns onto the moving object;

capturing a first image sequence of N images by a first camera and capturing a second image sequence of N images that is synchronous to the first image sequence by a second camera;

determining corresponding image points in the first image sequence and in the second image sequence;

computing a trajectory of a potential object point from imaging parameters of both cameras and from known movement data for each pair of image points of both cameras that is to be checked for correspondence, wherein the potential object point is imaged by both image points in case both image points actually correspond to each other;

imaging object positions derived therefrom at each of N capture points in time into image planes respectively of the first camera and of the second camera,

wherein positions of the corresponding image points are determined as a first image point trajectory in the first camera and a second image point trajectory in the second camera and

the image points are compared with each other along predetermined image point trajectories and examined for correspondence in the captured first and second image sequences;

performing three-dimensional measurement of the moving object in a final step from the corresponding image points by triangulation.

2. The method according to claim 1 , further comprising the step:

comparing the image points along the predetermined first and second image point trajectories by determining a first gray scale sequence from the captured first image sequence of the first camera and a second gray scale sequence from the captured second image sequence of the second camera and determining a similarity of the first gray scale sequence and the second gray scale sequence.

3. The method according to claim 2 , wherein determining the similarity of the first gray scale sequence and the second gray scale sequence includes using a standardized cross correlation, a sum of absolute differences, a phase processing or a comparable known measure of similarity for determining a correlation of gray scale sequences.

4. The method according to claim 1 , wherein a sequence of static patterns is used as the projected sequence of N patterns.

5. The method according to claim 1 , wherein a sequence of phase shifted sine shaped stripe patterns is used as the projected sequence of N patterns.

6. The method according to claim 1 ,

wherein a static pattern is used as the projected sequence of N patterns, and

wherein a projection of the static pattern onto the moving object is adjusted at will with respect to position or shape.

7. An apparatus for three-dimensional measurement of a moving object during a known relative movement between the moving object and a measuring sensor, the apparatus comprising a processor in communication with memory, the processor being configured to execute instructions stored in the memory that cause the processor to perform a method comprising the steps:

causing a projector to project a pattern sequence of N patterns onto the moving object;

causing a first camera to capture a first image sequence of N images and a second camera to capture a second image sequence of N images that is synchronous to the first image sequence;

determining corresponding image points in the first image sequence and in the second image sequence;

computing a trajectory of a potential object point from imaging parameters of both cameras and from known movement data for each pair of image points of both cameras that is to be checked for correspondence, wherein the potential object point is imaged by both image points in case both image points actually correspond to each other;

imaging object positions derived therefrom at each of N capture points in time into image planes respectively of the first camera and of the second camera,

wherein positions of the corresponding image points are determined as a first image point trajectory in the first camera and a second image point trajectory in the second camera and

the image points are compared with each other along predetermined image point trajectories and examined for correspondence in the captured first and second image sequences;

performing three-dimensional measurement of the moving object in a final step from the corresponding image points by triangulation.

8. The apparatus according to claim 7 , further comprising the step:

comparing the image points along the predetermined first and second image point trajectories by determining a first gray scale sequence from the captured first image sequence of the first camera and a second gray scale sequence from the captured second image sequence of the second camera and determining a similarity of the first gray scale sequence and the second gray scale sequence.

9. The apparatus according to claim 8 , wherein determining the similarity of the first gray scale sequence and the second gray scale sequence includes using a standardized cross correlation, a sum of absolute differences, a phase processing or a comparable known measure of similarity for determining a correlation of gray scale sequences.

10. The apparatus according to claim 7 , wherein a sequence of static patterns is used as the projected sequence of N patterns.

11. The apparatus according to claim 7 , wherein a sequence of phase shifted sine shaped stripe patterns is used as the projected sequence of N patterns.

12. The apparatus according to claim 7 ,

wherein a static pattern is used as the projected sequence of N patterns, and

wherein a projection of the static pattern onto the moving object is adjusted at will with respect to position or shape.

13. A non-transitory computer-readable storage medium storing instructions for three-dimensional measurement of a moving object during a known relative movement between the moving object and a measuring sensor that, when executed by a processor, cause the processor to perform a method comprising the steps:

projecting a pattern sequence of N patterns onto the moving object;

capturing a first image sequence of N images by a first camera and capturing a second image sequence of N images that is synchronous to the first image sequence by a second camera;

determining corresponding image points in the first image sequence and in the second image sequence;

computing a trajectory of a potential object point from imaging parameters of both cameras and from known movement data for each pair of image points of both cameras that is to be checked for correspondence, wherein the potential object point is imaged by both image points in case both image points actually correspond to each other;

imaging object positions derived therefrom at each of N capture points in time into image planes respectively of the first camera and of the second camera,

wherein positions of the corresponding image points are determined as a first image point trajectory in the first camera and a second image point trajectory in the second camera and

the image points are compared with each other along predetermined image point trajectories and examined for correspondence in the captured first and second image sequences;

performing three-dimensional measurement of the moving object in a final step from the corresponding image points by triangulation.

14. The non-transitory computer-readable storage medium according to claim 13 , further comprising the step:

comparing the image points along the predetermined first and second image point trajectories by determining a first gray scale sequence from the captured first image sequence of the first camera and a second gray scale sequence from the captured second image sequence of the second camera and determining a similarity of the first gray scale sequence and the second gray scale sequence.

15. The non-transitory computer-readable storage medium according to claim 14 , wherein determining the similarity of the first gray scale sequence and the second gray scale sequence includes using a standardized cross correlation, a sum of absolute differences, a phase processing or a comparable known measure of similarity for determining a correlation of gray scale sequences.

16. The non-transitory computer-readable storage medium according to claim 13 , wherein a sequence of static patterns is used as the projected sequence of N patterns.

17. The non-transitory computer-readable storage medium according to claim 13 , wherein a sequence of phase shifted sine shaped stripe patterns is used as the projected sequence of N patterns.

18. The non-transitory computer-readable storage medium according to claim 13 ,

wherein a static pattern is used as the projected sequence of N patterns, and

wherein a projection of the static pattern onto the moving object is adjusted at will with respect to position or shape.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEES NAMES AND COGNEX CORPORATION ZIP CODE PREVIOUSLY RECORDED ON REEL 048058 FRAME 0197. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGMMENT. Recorded Oct 25, 2019
From: HARENDT, BASTIAN
To: COGNEX CORPORATION; COGNEX ENSHAPE GMBH
Reel/Frame 050827/0201 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2019
From: COGNEX ENSHAPE GMBH
To: COGNEX CORPORATION
Reel/Frame 050760/0970 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2019
From: HARENDT, BASTIAN
To: ENSHAPE GMBH; COGNEX CORPORATION
Reel/Frame 048058/0197 →
Priority Claims (2)
DE 10 2016 111 229 · Jun 20, 2016 · national
DE 10 2017 113 473 · Jun 20, 2017 · national
Continuity (2)
Continuation PCTEP2017065118 · Jun 20, 2017
Related Publication 20190128665A1 · May 2, 2019