IP Library Granted Patent US 10,873,739
Granted Patent B2
US 10,873,739 · App. 16/224,817 · Granted Dec 22, 2020

Calibrating method and calibration apparatus

Inventors: Hiroshi Kumagai (Kitakyushu, JP); Takashi Motoyoshi (Kitakyushu, JP); Seiichiro Fukushima (Kitakyushu, JP)
Assignee: KABUSHIKI KAISHA YASKAWA DENKI
H04N13/246B23K26/032B23K26/082B23K26/0884B23K26/21B23K26/707G01B11/2518G02B26/127G06T7/33G06T7/521G06T7/80G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,873,739
App. No.
16/224,817
Granted
Dec 22, 2020
Kind
B2
Abstract

A calibrating method includes controlling a laser radiator to radiate calibration laser light to an object such that a pattern is projected in a laser coordinate system with respect to the laser radiator; controlling a camera to obtain a first image of first light points of the calibration laser light projected on a surface of the object when the object is in a first position; and controlling the camera to obtain a second image of second light points of the calibration laser light projected on the surface of the object when the object is in the second position. A positional relationship between the laser coordinate system and the camera coordinate system is calculated based on the three-dimensional positions of the first light points and the three-dimensional positions of the second light points.

Claims (41)

1. A calibrating method comprising:

controlling a laser radiator to radiate calibration laser light to an object such that a pattern is projected in a laser coordinate system with respect to the laser radiator;

controlling a camera to obtain a first image of first light points of the calibration laser light projected on a surface of the object when the object is in a first position;

calculating, based on the first image, three-dimensional positions of the first light points in a camera coordinate system with respect to the camera;

changing a position of the object from the first position to a second position;

controlling the camera to obtain a second image of second light points of the calibration laser light projected on the surface of the object when the object is in the second position;

calculating, based on the second image, three-dimensional positions of the second light points in the camera coordinate system; and

calculating a positional relationship between the laser coordinate system and the camera coordinate system based on the three-dimensional positions of the first light points and the three-dimensional positions of the second light points,

wherein the step of calculating the positional relationship comprises

calculating regression lines based on the three-dimensional positions of the first light points and the second light points, and

calculating a control origin of the calibration laser light based on an intersection of the regression lines.

2. The calibrating method according to claim 1 , wherein the step of calculating the positional relationship comprises calculating, based on the regression lines, a base vector of the laser coordinate system with the control origin serving as an origin of the laser coordinate system.

3. The calibrating method according to claim 1 , wherein the pattern comprises a rectangular pattern on a surface perpendicular to a Z axis of the laser coordinate system.

4. The calibrating method according to claim 1 , further comprising, after calculating the positional relationship between the laser coordinate system and the camera coordinate system, specifying a radiation position in the camera coordinate system and radiating the calibration laser light to the radiation position to determine, based on the three-dimensional positions of the first light points and the second light points, whether the laser coordinate system and the camera coordinate system have been calibrated relative to each other normally.

5. The calibrating method according to claim 4 , further comprising, when a determination has been made that the laser coordinate system and the camera coordinate system have been calibrated relative to each other normally, calibrating the calibrated camera coordinate system of the camera and a camera coordinate system of another camera relative to each other, the camera and the another camera having overlapping fields of vision.

6. The calibrating method according to claim 1 ,

wherein the camera comprises a monocular camera, and

wherein the object comprises a plate having a surface which has markers arranged in a pattern and on which the calibration laser light is radiated.

7. The calibrating method according to claim 1 , wherein the laser radiator is configured to switchably radiate the calibration laser light and machining laser light coaxial to the calibration laser light.

8. The calibrating method according to claim 1 , wherein the predetermined pattern comprises a rectangular pattern on a surface perpendicular to a Z axis of the laser coordinate system.

9. The calibrating method according to claim 1 , wherein the pattern has a substantially constant pattern in the laser coordinate system when the object is in the first position and the second position.

10. The calibrating method according to claim 1 , further comprising, after calculating the positional relationship between the laser coordinate system and the camera coordinate system, specifying a predetermined radiation position in the camera coordinate system and radiating the calibration laser light to the predetermined radiation position to determine, based on the three-dimensional positions of the light points, whether the laser coordinate system and the camera coordinate system have been calibrated relative to each other normally.

11. A calibration apparatus comprising:

circuitry configured to:

control a laser radiator to radiate calibration laser light to an object such that a pattern is projected in a laser coordinate system with respect to the laser radiator;

control a camera to obtain a first image of first light points of the calibration laser light projected on a surface of the object when the object is in a first position;

calculate, based on the first image, three-dimensional positions of the first light points in a camera coordinate system with respect to the camera;

change a position of the object from the first position to a second position;

control the camera to obtain a second image of second light points of the calibration laser light projected on the surface of the object when the object is in the second position;

calculate, based on the second image, three-dimensional positions of the second light points in the camera coordinate system; and

calculate a positional relationship between the laser coordinate system and the camera coordinate system based on the three-dimensional positions of the first light points and the three-dimensional positions of the second light points,

wherein the circuitry is configured to calculate regression lines based on the three-dimensional positions of the first light points and the second light points, and configured to calculate a control origin of the calibration laser light based on an intersection of the regression lines.

12. The calibration apparatus according to claim 11 , wherein the circuitry is configured to calculate, based on the regression lines, a base vector of the laser coordinate system with the control origin serving as an origin of the laser coordinate system.

13. The calibration apparatus according to claim 11 , wherein the pattern comprises a rectangular pattern on a surface perpendicular to a Z axis of the laser coordinate system.

14. The calibration apparatus according to claim 11 , wherein the circuitry is configured to, after calculating the positional relationship between the laser coordinate system and the camera coordinate system, specifying a radiation position in the camera coordinate system and radiating the calibration laser light to the radiation position to determine, based on the three-dimensional positions of the first light points and the second light points, whether the laser coordinate system and the camera coordinate system have been calibrated relative to each other normally.

15. The calibration apparatus according to claim 14 , wherein the circuitry is configured to, when the circuitry has determined that the laser coordinate system and the camera coordinate system have been calibrated relative to each other normally, calibrate the calibrated camera coordinate system of the camera and a camera coordinate system of another camera relative to each other, the camera and the another camera having overlapping fields of vision.

16. The calibration apparatus according to claim 11 ,

wherein the camera comprises a monocular camera, and

wherein the object comprises a plate having a surface which has markers arranged in a pattern and on which the calibration laser light is radiated.

17. The calibration apparatus according to claim 11 , wherein the circuitry is configured to control the laser radiator to switch the calibration laser light to machining laser light coaxial to the calibration laser light and configured to radiate the machining laser light.

18. The calibration apparatus according to claim 11 , wherein the pattern has a substantially constant pattern in the laser coordinate system when the object is in the first position and the second position.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2018
From: KUMAGAI, HIROSHI; MOTOYOSHI, TAKASHI; FUKUSHIMA, SEIICHIRO
To: KABUSHIKI KAISHA YASKAWA DENKI
Reel/Frame 047812/0231 →
Priority Claims (1)
JP 2017-244937 · Dec 21, 2017 · national
Continuity (1)
Related Publication 20190200000A1 · Jun 27, 2019
Cited By (3)
US 12,240,129 US 12,365,102 US 12,403,606