IP Library Granted Patent US 9,292,932
Granted Patent B2
US 9,292,932 · App. 14/355,685 · Granted Mar 22, 2016

Three dimension measurement method, three dimension measurement program and robot device

Inventor: Hiroshi Kitajima (Tokyo, JP)
Assignee: Canon Kabushiki Kaisha
G06T7/0085G06T7/0044G06T7/0097G06T2207/10012G06T2207/30108Y10S901/47
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,292,932
App. No.
14/355,685
Granted
Mar 22, 2016
Kind
B2
Abstract

A three-dimensional measurement method three-dimensionally restores an edge having a cross angle close to parallel to an epipolar line. Edges e 2L , e 3L and e 4L on the same plane of a work are selected, and among these edges, at least two edges e 2L and e 4L residing in a predetermined angle range with reference to the cross angle of 90° crossing the epipolar line are three-dimensionally restored by a stereo method. Then, a three-dimensional plane P 1 including these three-dimensionally restored e 2L and e 4L is found, and the edge e 3L residing beyond a predetermined angle range with reference to the cross angle of 90° crossing the epipolar line is projected to this three-dimensional plane P 1 , thus three-dimensionally restoring the edge e 3L .

Claims (18)

1. Three-dimensional measurement method, comprising the steps of:

acquiring, by an arithmetic unit, a stereo image of a work taken by first and second cameras;

extracting, by the arithmetic unit, edges from the acquired stereo image;

selecting, by the arithmetic unit, edges existing on a same plane of the work from the edges extracted on the stereo image;

three-dimensionally restoring, by the arithmetic unit, at least two first edges among the edges existing on the same plane by a stereo method, the first edges residing in a predetermined angle range with reference to a cross angle of 90° made by crossing with an epipolar line;

calculating, by the arithmetic unit, a three-dimensional plane including the three-dimensionally restored first edges using the three-dimensionally restored at least two first edges; and

three-dimensionally restoring, by the arithmetic unit, a second edge among the edges existing on the same plane as the first edges by projecting the second edge on the three-dimensional plane, the second edge residing beyond a predetermined angle range with reference to a cross angle of 90° made by crossing with an epipolar line.

2. The three-dimensional measurement method according to claim 1 , wherein the arithmetic unit selects the edges existing on the same plane by performing pattern matching using a template image with respect to the stereo image.

3. The three-dimensional measurement method according to claim 1 , wherein the first edge is an edge among the extracted edges having a cross angle of the edge with the epipolar line of 45° or more and 135° or less.

4. The three-dimensional measurement method according to claim 1 , wherein the first edge is an edge among the extracted edges having a cross angle of the edge with the epipolar line of 20° or more and 160° or less.

5. The three-dimensional measurement method according to claim 1 , the work is further taken by a third camera, and two images are selected from a plurality of images taken by the first, the second and the third cameras to acquire a stereo image.

6. A non-transitory computer-readable medium storing a three-dimensional measurement program that makes a computer execute the steps according to claim 1 .

7. A robot device, comprising:

first and second cameras that take an image of a work;

a robot arm that performs an operation to the work; and

an arithmetic unit that recognizes a three-dimensional position of the work based on the stereo image of the work taken by the first and the second cameras and gives a driving instruction to the robot arm,

wherein

the arithmetic unit extracts edges from the acquired stereo image, selects edges existing on a same plane of the work from the extracted edges, three-dimensionally restores at least two first edges among the edges existing on the same plane by a stereo method, the first edges residing in a predetermined angle range with reference to a cross angle of 90° made by crossing with an epipolar line, three-dimensionally restores a second edge by projecting the second edge on a three-dimensional plane including the three-dimensionally restored first edges, the second edge residing beyond a predetermined angle range with reference to a cross angle of 90° made by crossing with an epipolar line, and recognizes a three-dimensional position of the work using the three-dimensionally restored first and second edges.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2014
From: KITAJIMA, HIROSHI
To: CANON KABUSHIKI KAISHA
Reel/Frame 032960/0765 →
Priority Claims (1)
JP 2011-281150 · Dec 22, 2011 · national
Continuity (1)
Related Publication 20140294286A1 · Oct 2, 2014