IP Library Granted Patent US 11,267,142
Granted Patent B2
US 11,267,142 · App. 16/195,860 · Granted Mar 8, 2022

Imaging device including vision sensor capturing image of workpiece

Inventor: Yuta Namiki (Yamanashi, JP)
Assignee: FANUC CORPORATION
B25J19/023H04N5/2253H04N5/2257H04N5/23229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,267,142
App. No.
16/195,860
Granted
Mar 8, 2022
Kind
B2
Abstract

An imaging device includes a camera, a robot that moves the camera, and a controller that processes an image. A detection surface defined on a workpiece and a set position serving as an imaginary position of the robot for detecting the workpiece are determined in advance. The camera captures a plurality of first images at a plurality of positions. The controller includes an image conversion unit converting the plurality of the first images into a plurality of second images when captured at the set position. The controller includes a composition unit generating a composite image into which the plurality of the second images are composited, and a composite image processing unit performing at least one of detection and inspection of the workpiece on the detection surface on the basis of the composite image.

Claims (43)

1. An imaging device, comprising:

a vision sensor configured to capture a plurality of first images of a workpiece such that relative positions of the vision sensor with respect to the workpiece mutually differ;

a movement device configured to move one of the workpiece or the vision sensor so as to change a relative position of the one of the workpiece or the vision sensor with respect to the other of the workpiece or the vision sensor; and

an image processing device configured to process the plurality of first images, the image processing device including

a storage unit configured to store

each of the plurality of first images and a position of the movement device at a time of capturing said each of the plurality of first images as a set, and

a detection surface defined on the workpiece and a set position serving as a position of the movement device, wherein the detection surface and the set position are determined in advance,

an image conversion unit configured to convert said each of the plurality of first images into each of a plurality of second images,

wherein said each of the plurality of second images is an image captured at the set position on the basis of the position of the movement device at the time of capturing said each of the plurality of first images,

a composition unit configured to generate a composite image into which the plurality of second images is composited, and

a composite image processing unit configured to perform at least one of detection or inspection of the workpiece on the detection surface on the basis of the composite image.

2. The imaging device of claim 1 , wherein the movement device is a robot configured to move either one of the workpiece or the vision sensor.

3. The imaging device of claim 1 , wherein the movement device is a conveyor configured to convey the workpiece.

4. The imaging device of claim 1 , wherein

the image conversion unit is configured to

calculate a corresponding position in a first image of the plurality of first images, the corresponding position corresponding to a pixel in a second image of the plurality of second images, and

calculate a value of the pixel in the second image of the plurality of second images on the basis of a value of a pixel including the corresponding position and a value of a pixel adjacent to the pixel including the corresponding position.

5. The imaging device of claim 4 , wherein

the image conversion unit is configured to calculate the value of the pixel in the second image of the plurality of second images, on the basis of the value of the pixel including the corresponding position in the first image of the plurality of first images and a value of each of a plurality of pixels in a vicinity of the corresponding position.

6. The imaging device of claim 1 , wherein the composition unit is configured to set a statistic of values of pixels in the plurality of the second images, for a value of a pixel in the composite image.

7. An imaging device, comprising:

a plurality of vision sensors configured to capture a plurality of first images of a workpiece from positions different from each other;

a first fixation part configured to fix the workpiece;

a second fixation part configured to fix each of the plurality of vision sensors;

an image processing device configured to process the plurality of first images, the image processing device including

a storage unit configured to store

each of the plurality of first images captured by the plurality of vision sensors and each position of the plurality of vision sensors that captured the plurality of the first images as a set, and

a detection surface defined on the workpiece and a detection position serving as a position of a vision sensor of the plurality of vision sensors, wherein the detection surface and the detection position are determined in advance,

an image conversion unit configured to convert each of the plurality of first images captured by the plurality of vision sensors into each of a plurality of second images,

wherein said each of the plurality of second images is an image captured at the detection position on the basis of a position of said each of the plurality of vision sensors,

a composition unit configured to generate a composite image into which the plurality of second images is composited, and

a composite image processing unit configured to perform at least one of detection or inspection of the workpiece on the detection surface on the basis of the composite image.

8. An imaging device, comprising:

a vision sensor configured to capture a plurality of first images of a workpiece such that relative positions of the vision sensor with respect to the workpiece mutually differ;

a movement device including a robot or a conveyor, the movement device configured to move one of the workpiece or the vision sensor so as to change a relative position of the one of the workpiece or the vision sensor with respect to the other of the workpiece or the vision sensor; and

an image processing device configured to process the plurality of first images, the image processing device including

a storage unit configured to store

each of the plurality of first images and a position of the movement device at a time of capturing said each of the plurality of first images as a set, and

a detection surface defined on the workpiece and a set position serving as a position of the movement device, wherein the detection surface and the set position are determined in advance, and

a processor configured to

convert said each of the plurality of first images into each of a plurality of second images, wherein said each of the plurality of second images is an image captured at the set position based on the position of the movement device at the time of capturing said each of the plurality of first images,

generate a composite image into which the plurality of second images is composited, and

perform at least one of detection or inspection of the workpiece on the detection surface based on the composite image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2018
From: NAMIKI, YUTA
To: FANUC CORPORATION
Reel/Frame 047549/0665 →
Priority Claims (1)
JP JP2017-244517 · Dec 20, 2017 · national
Continuity (1)
Related Publication 20190184582A1 · Jun 20, 2019