IP Library Granted Patent US 9,297,899
Granted Patent B2
US 9,297,899 · App. 14/348,482 · Granted Mar 29, 2016

Determining extrinsic calibration parameters for a sensor

Inventors: Paul Michael Newman (Oxfordshire, GB); William Paul Maddern (Bisbane, AU); Alastair Robin Harrison (Oxfordshire, GB); Mark Christopher Sheehan (Oxfordshire, GB)
Assignee: The Chancellor Masters and Scholars of the University of Oxford
G01S17/02G01S7/4808G01S7/4972G01S17/87G01S17/89
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,297,899
App. No.
14/348,482
Granted
Mar 29, 2016
Kind
B2
Abstract

A method of determining extrinsic calibration parameters for at least one sensor ( 102, 104, 106 ) mounted on transportable apparatus ( 100 ). The method includes receiving ( 202 ) data representing pose history of the transportable apparatus and receiving ( 202 ) sensor data from at least one sensor mounted on transportable apparatus. The method generates ( 204 ) at least one point cloud data using the sensor data received from the at least one sensor, each point in a said point cloud having a point covariance derived from the pose history data. The method then maximizes ( 206 ) a value of a quality function for the at least one point cloud, and uses ( 208 ) the maximized quality function to determine extrinsic calibration parameters for the at least one sensor.

Claims (43)

1. A method of determining extrinsic calibration parameters for at least one sensor mounted on a transportable apparatus, the method including:

receiving, by a computer processor, data representing pose history of the transportable apparatus with respect to a global frame;

receiving, by the computer processor, sensor data from at least one sensor mounted on the transportable apparatus;

generating, by the computer processor, at least one point cloud datum using the sensor data received from the at least one sensor, each point in a said point cloud having a corresponding point covariance derived from the pose history data;

maximizing, by the computer processor, a value of a quality function for the at least one point cloud; and

determining, by the computer processor, extrinsic calibration parameters for the at least one sensor using the maximized quality function.

2. A method according to claim 1 , wherein the value of the quality function depends on pairwise distances between said points in a said point cloud (X^) and associated said point covariance (Σ) of each said point derived from the pose history data.

3. A method according to claim 1 , wherein the quality function (E) is expressed as E(Θ|Z, Y), where Z represents the data received from one said sensor, the sensor data representing a set of measurements over a period of time, and where Y represents a set of poses of the transportable apparatus from the pose history over the period of time, and where Θ provides a most likely estimate for the extrinsic calibration parameters for the sensor.

4. A method according to claim 1 , wherein the quality function comprises an entropy-based point cloud quality metric.

5. A method according to claim 4 , wherein the quality function is based on Renyi Quadratic Entropy.

6. A method according to claim 1 , wherein the maximizing of the value of the quality function is performed using Newton's method.

7. A method according to claim 1 , wherein the method is used to:

generate a first point cloud based on sensor data received from a 3D LIDAR device;

generate a second point cloud based on sensor data received from a 2D LIDAR device, and

use a Kernelized Renyi Distance function on the first and the second point clouds to determine the extrinsic calibration parameters for the 2D LIDAR device.

8. A method according to claim 1 , where, in the step of maximizing the value of a quality function for the point cloud, the method evaluates bi-direction data only once to reduce computation time.

9. A method according to claim 1 , where, in the step of maximizing the value of a quality function for the point cloud, the method evaluates an entropy contribution between a first said point of the point cloud and neighbouring said points in the point cloud to reduce computation time.

10. A method according to claim 1 , wherein the point cloud data is stored in a tree data structure for processing.

11. A method according to claim 10 , wherein the tree data structure comprises a k-d tree.

12. Transportable apparatus including at least one sensor and a processor configured to execute a method according to claim 1 .

13. A vehicle including transportable apparatus according to claim 12 .

14. A method of calibrating at least one sensor mounted on a transportable apparatus, the method including:

receiving, by a computer processor, data representing pose history of the transportable apparatus, the pose history data representing at least two different locations of the transportable apparatus within a global frame;

receiving, by the computer processor, sensor data from at least one sensor mounted on the transportable apparatus, the sensor data representing coordinates of an object in a sensor frame that is different than the global frame, the sensor data being obtained while the transportable apparatus is located at each of the at least two different locations of the transportable apparatus in the pose history data;

estimating, by the computer processor, coordinates of the object in the global frame based on the sensor data received from the at least one sensor;

generating, by the computer processor, point cloud data by combining the estimated coordinates of the object in the global frame with corresponding point covariences derived from the pose history data;

maximizing, by the computer processor, a value of a quality function for the point cloud;

determining, by the computer processor, extrinsic calibration parameters for the at least one sensor using the maximized quality function, and

calibrating the at least one sensor using the determined extrinsic calibration parameters.

15. A non-transient computer program product comprising computer code that when executed by one or more processors causes a process for determining extrinsic calibration parameters for at least one sensor mounted on a transportable apparatus, the process comprising:

receiving data representing pose history of the transportable apparatus with respect to a global frame;

receiving sensor data from at least one sensor mounted on the transportable apparatus;

generating at least one point cloud datum using the sensor data received from the at least one sensor, each point in a said point cloud having a corresponding point covariance derived from the pose history data;

maximizing a value of a quality function for the at least one point cloud; and

using the maximized quality function to determine extrinsic calibration parameters for the at least one sensor.

16. A computer program product according to claim 15 , wherein the value of the quality function depends on pairwise distances between said points in a said point cloud (X^) and associated said point covariance (Σ) of each said point derived from the pose history data.

17. A computer program product according to claim 15 , wherein the quality function (E) is expressed as E(Θ|Z, Y), where Z represents the data received from one said sensor, the sensor data representing a set of measurements over a period of time, and where Y represents a set of poses of the transportable apparatus from the pose history over the period of time, and where Θ provides a most likely estimate for the extrinsic calibration parameters for the sensor.

18. A computer program product according to claim 15 , wherein the quality function comprises an entropy-based point cloud quality metric and the maximizing of the value of the quality function is performed using Newton's method.

19. A computer program product according to claim 15 , wherein the process is used to:

generate a first point cloud based on sensor data received from a 3D LIDAR device;

generate a second point cloud based on sensor data received from a 2D LIDAR device, and

use a Kernelized Renyi Distance function on the first and the second point clouds to determine the extrinsic calibration parameters for the 2D LIDAR device.

20. A computer program product according to claim 15 , wherein the point cloud data is stored in a tree data structure for processing, and the tree data structure comprises a k-d tree.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2025
From: THE CHANCELLOR, MASTERS AND SCHOLARS OF THE UNIVERSITY OF OXFORD
To: OXFORD UNIVERSITY INNOVATION LIMITED
Reel/Frame 071946/0721 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2025
From: OXFORD UNIVERSITY INNOVATION LIMITED INCORPORATED
To: OXA AUTONOMY LTD
Reel/Frame 071946/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2017
From: THE CHANCELLOR MASTERS AND SCHOLARS OF THE UNIVERSITY OF OXFORD
To: OXFORD UNIVERSITY INNOVATION LIMITED
Reel/Frame 044035/0821 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2014
From: MADDERN, WILLIAM PAUL; NEWMAN, PAUL MICHAEL; HARRISON, ALASTAIR ROBIN; SHEEHAN, MARK CHRISTOPHER
To: THE CHANCELLOR MASTERS AND SCHOLARS OF THE UNIVERSITY OF OXFORD
Reel/Frame 033034/0390 →
Priority Claims (1)
GB 1116961.2 · Sep 30, 2011 · national
Continuity (1)
Related Publication 20140240690A1 · Aug 28, 2014