IP Library Granted Patent US 10,930,013
Granted Patent B2
US 10,930,013 · App. 16/484,655 · Granted Feb 23, 2021

Method and system for calibrating imaging system

Inventors: Adrian Boyle (Kildare, IE); Michael Flynn (Kildare, IE)
Assignee: CATHX OCEAN LIMITED
G06T7/80G01C11/02G06T7/344G06T7/521G06T7/75H04N5/2256H04N5/247G06T2207/10028G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,930,013
App. No.
16/484,655
Granted
Feb 23, 2021
Kind
B2
Abstract

Provided are a method and system for calibrating parameters of an imaging system comprising at least one imaging device and broad and structured light sources, the method comprising: the at least one imaging device sequentially capturing broad light source image data and structured light source image data of one or more scenes using the broad and structured light sources, respectively; generating a photogrammetric model of the broad light source image data and a photogrammetric model of the structured light source image data using respective coordinates of the broad and structured light source image data; determining corresponding features in the respective photogrammetric models; iteratively solving parameters of the imaging system to correct variations between corresponding features in the respective photogrammetric models, converge the models and obtain calibration parameters; and applying the calibration parameters to the imaging system to compensate for errors in the relative positions of the imaging device and structured light source.

Claims (48)

1. A method for calibrating parameters of an imaging system including at least one imaging device and broad and structured light sources, the method comprising:

sequentially capturing, via the or each imaging device, broad light source image data and structured light source image data of one or more scenes using the broad and structured light sources, respectively;

generating a photogrammetric model from the broad light source image data and a photogrammetric model from the structured light source image data using respective coordinates of points determined from the broad and structured light source image data including triangulating an image vector of the imaging device and a plane of the structured light source to determine the coordinates of the points within the structured light source image data, said triangulating based on determining the relative positions of the imaging device and structured light source when the broad and structured light source image data is captured, the relative positions including relative angles and an offset (‘D’, ‘θ, ‘β’) of the structured light source to the imaging device, wherein:

‘D’ is a distance from the optical axis of the imaging device to the structured light source plane;

‘θ’ is an angle of the structured light source plane to the imaging device flat port plane; and

‘β’ is a twist in the structured light source plane;

determining corresponding features in the respective photogrammetric models;

iteratively solving parameters of the imaging system to correct variations between corresponding features in the respective photogrammetric models, converge the models and obtain calibration parameters; and

applying the calibration parameters to the imaging system to compensate for errors in the relative positions of the imaging device and structured light source.

2. The method of claim 1 , wherein the broad light source comprises a white light source.

3. The method of claim 1 , wherein the structured light source comprises a laser source.

4. A method for calibrating parameters of an imaging system including at least one imaging device and broad and structured light sources, the method comprising:

sequentially capturing via the or each imaging device, broad light source image data and structured light source image data of one or more scenes using the broad and structured light sources, respectively;

generating a photogrammetric model from the broad light source image data and a photogrammetric model from the structured light source image data using respective coordinates of points determined from the broad and structured light source image data including:

determining a camera pose from the broad light source image data; and

applying a scale to the camera pose using the structured light source image data to obtain a position of the imaging device relative to the one or more scenes;

determining corresponding features in the respective photogrammetric models;

iteratively solving parameters of the imaging system to correct variations between corresponding features in the respective photogrammetric models, converge the models and obtain calibration parameters; and

applying the calibration parameters to the imaging system to compensate for errors in the relative positions of the imaging device and structured light source.

5. The method of claim 4 , comprising using the camera pose obtained from the broad light source image data to determine the coordinates of the points within the structured light source image data.

6. The method of claim 1 , wherein the generating a photogrammetric model from the broad light source image data comprises 2D machine processing of the broad light source image data.

7. The method of claim 1 , wherein the generating a photogrammetric model from the broad light source image data comprises 3D machine processing of the broad light source image data.

8. The method of claim 1 , comprising determining the location of features in the structured light source image data using 3D machine vision.

9. The method of claim 1 , comprising extracting 3D point cloud data comprising a set of points from the structured light source image data to provide a full 3D model.

10. The method of claim 6 , wherein the machine processing comprises performing at least one of event detection, object recognition, object measurement and object classification on the image data.

11. A method for calibrating parameters of an imaging system including a plurality of imaging devices and broad and structured light sources, the method comprising:

sequentially capturing via each imaging device, broad light source image data and structured light source image data of one or more scenes using the broad and structured light sources, respectively;

generating a photogrammetric model from the broad light source image data and a photogrammetric model from the structured light source image data using respective coordinates of points determined from the broad and structured light source image data;

determining corresponding features in the respective photogrammetric models;

iteratively solving parameters of the imaging system to correct variations between corresponding features in the respective photogrammetric models, converge the models and obtain calibration parameters; and

applying the calibration parameters to the imaging system to compensate for errors in the relative positions of each imaging device and structured light source;

synchronising the acquisition of images by the plurality of imaging devices;

determining a pose of each individual imaging device; and

scaling the pose with the structured light source image data to obtain real-world relative positions of all the imaging devices in the system.

12. The method of claim 11 , comprising scaling the pose based on fixed known separation between the imaging devices which is measured in air.

13. A system for calibrating parameters of an imaging system, comprising:

a broad light source;

a structured light source;

each of at least one imaging device configured to sequentially capture broad light source image data and structured light source image data of one or more scenes using the broad and structured light sources, respectively; and

at least one processor configured to:

generate a photogrammetric model from the broad light source image data and a photogrammetric model from the structured light source image data using respective coordinates of points determined from the broad and structured light source image data including triangulating an image vector of the imaging device and a plane of the structured light source to determine the coordinates of the points within the structured light source image data, said triangulating based on determining the relative positions of the imaging device and structured light source when the broad and structured light source image data is captured, the relative positions including relative angles and an offset (‘D’, ‘θ’, ‘β’) of the structured light source to the imaging device, wherein:

‘D’ is a distance from the optical axis of the imaging device to the structured light source plane;

‘θ’ is an angle of the structured light source plane to the imaging device flat port plane; and

‘β’ is a twist in the structured light source plane;

determine corresponding features in the respective photogrammetric models;

iteratively solve parameters of the imaging system to correct variations between corresponding features in the respective photogrammetric models, converge the models and obtain calibration parameters; and

apply the calibration parameters to the imaging system to compensate for errors in the relative positions of the imaging device and structured light source.

14. The system of claim 13 , comprising a plurality of imaging devices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: BOYLE, ADRIAN; FLYNN, MICHAEL
To: CATHX OCEAN LIMITED
Reel/Frame 053410/0685 →
Priority Claims (1)
GB 1702118.9 · Feb 9, 2017 · national
Continuity (1)
Related Publication 20200105019A1 · Apr 2, 2020
Cited By (4)
US 12,375,791 US 12,439,024 US 12,475,581 US 12,632,986