IP Library Granted Patent US 10,421,189
Granted Patent B2
US 10,421,189 · App. 14/921,731 · Granted Sep 24, 2019

System and method for robust calibration between a machine vision system and a robot

Inventors: Aaron S. Wallack (Natick, MA); Lifeng Liu (Arlington, MA); Xiangyun Ye (Framingham, MA)
Assignee: Cognex Corporation
B25J9/1692B25J9/1607B25J9/1697G06T7/80G05B2219/39008G05B2219/39022G05B2219/39045G05B2219/39057Y10S901/09
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,421,189
App. No.
14/921,731
Granted
Sep 24, 2019
Kind
B2
Abstract

A system and method for robustly calibrating a vision system and a robot is provided. The system and method enables a plurality of cameras to be calibrated into a robot base coordinate system to enable a machine vision/robot control system to accurately identify the location of objects of interest within robot base coordinates.

Claims (17)

1. A method for determining calibration between a machine vision system and a robot, the method comprising:

obtaining, using a camera fixed to an effector of the robot, an initial image of a calibration object fixed in space as the robot occupies an initial pose within a workplace for the robot, and a subsequent image of the calibration object as the robot occupies a subsequent post within the workplace for the robot, the initial pose and the subsequent pose are different, the calibration object comprising a first object feature and a second object feature, the first object feature and the second object feature located at a fixed, known distance relative to one another, the robot having a robot coordinate system, the camera having a camera coordinate system, the effector having an effector coordinate system, the calibration object having an object coordinate system;

identifying an object-robot transform between the object coordinate system and the robot coordinate system;

identifying a camera-effector transform between the object coordinate system and the effector coordinate system;

locating a first initial image feature and a second initial image feature in the initial image and a first subsequent image feature and a second subsequent image feature in the subsequent image, the first initial image feature and the first subsequent image feature corresponding to the first object feature and the second initial image feature and the second subsequent image feature corresponding to the second object feature;

calculating, using the fixed, known distance, the initial pose, the subsequent pose, the object-robot transform, and the camera-effector transform, a predicted first initial image feature and a predicted second initial image feature for the initial image and a predicted first subsequent image feature and a predicted second subsequent image feature for the subsequent image, the predicted first initial image feature and the predicted first subsequent image feature corresponding to the first object feature and the predicted second initial image feature and the predicted second subsequent image feature corresponding to the second object feature;

minimizing, by varying the object-robot transform or the camera-effector transform, a discrepancy between at least one of the first initial image feature and the predicted first initial image feature, the second initial image feature and the predicted second initial image feature, the first subsequent image feature and the predicted first subsequent image feature, and the second subsequent image feature and the predicted second subsequent image feature, thereby producing optimized transforms;

calibrating the machine vision system and the robot using the optimized transforms.

2. The method of claim 1 wherein the calibration object comprises a calibration plate.

3. The method of claim 1 wherein a difference between the initial pose and the subsequent pose comprises rotations around at least two non-parallel axes.

4. The method of claim 3 wherein the rotations comprise rotation of at least five degrees.

5. The method of claim 1 further comprising pre-processing a set of obtained images to remove outliers, where the pre-processing further comprises:

determining a set of outliers;

eliminating, in response to determining a set of outliers, one or more images from the set of obtained images having the outliers to produce a reduced set of obtained images; and

re-ordering the reduced set of obtained images to obtain suitable motions.

6. The method of claim 5 wherein the suitable motions comprises changes between a particular pair of the reduced set of obtained images.

7. The method of claim 1 wherein the transforms permit six degrees of freedom.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2016
From: WALLACK, AARON S.; LIU, LIFENG; YE, XIANGYUN
To: COGNEX CORPORATION
Reel/Frame 037591/0934 →
Continuity (2)
Division 12780119 · May 14, 2010
Related Publication 20160039096A1 · Feb 11, 2016