IP Library Granted Patent US 9,303,525
Granted Patent B2
US 9,303,525 · App. 13/582,164 · Granted Apr 5, 2016

Method and arrangement for multi-camera calibration

Inventors: Maarten Aerts (Beveren-Waas, BE); Donny Tytgat (Ghent, BE); Jean-Francois Macq (Ganshoren, BE); Sammy Lievens (Brasschaat, BE)
Assignee: Alcatel Lucent
F01D21/003F01D25/00G01N21/15G01N21/85G02B23/2492G06T7/002F05D2260/80G01N21/954G01N2021/151G01N2201/08G06T2207/10012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,303,525
App. No.
13/582,164
Granted
Apr 5, 2016
Kind
B2
Abstract

A method for determining calibration data for at least two cameras (camera 1 , camera 2 ) in a multi view position, includes a step of determining respective parameters ((h 1 00 , . . . , h 1 22 ), (h 2 00 , . . . , h 2 22 )) for identifying at least one respective homographic transformation on respective images (image 1 ,image 2 ) taken by said cameras of a same scene, by performing respective geometry analyses on said respective images (image 1 , image 2 ), a step of performing at least one respective combined homographic transformation/feature detection step on said respective images thereby obtaining respective sets (feature set 1 , feature set 2 ) of features on respective transformed images, such that said calibration data are obtained from matches (m l , . . . , m k ) determined between said respective sets of features.

Claims (26)

1. A method for determining calibration data for at least two cameras (camera 1 , camera 2 ) in a multi view position, said method including the steps of:

determining respective parameters ((h 1 00 . . . h 1 22 )), (h 2 00 , . . . h 2 22 )) for identifying at least one respective homographic transformation on respective images (image 1 ,image 2 ) taken by said cameras of a same scene, by performing respective geometry analyses on said respective images (image 1 , image 2 ); and

performing at least one respective homographic transformation on said respective images and a respective feature detection step on respective transformed images thereby obtaining respective sets (feature set 1 , feature set 2 ) of features on said respective transformed images, such that said calibration data are obtained from matches (ml,..,mk) determined between said respective sets of features.

2. A method according to claim 1 wherein said calibration data comprise information with respect to the relative position between said cameras.

3. A method according to claim 1 wherein said calibration data comprise information with respect to the relative viewing direction differences between said cameras.

4. A method according to claim 1 wherein said at least one respective homographic transformation further comprises an iterative process of pixel coordinates transformation of said respective image, followed by feature detection of the partially transformed image until all pixel coordinates of said respective image (imagel) are transformed.

5. A method according to claim 1 wherein said respective geometry analysis steps comprise determining line segments on said respective images.

6. A method according to claim 1 wherein said respective geometry analysis steps comprise determining curved segments on said respective image.

7. A method according to claim 1 wherein said respective geometry analysis steps comprise performing object recognition on said respective images.

8. A method according to claim 5 wherein said respective line segments are further used for determining a viewpoint angle difference between said at least two cameras.

9. A method according to claim 1 wherein said calibration data are further determined from said respective sets of features.

10. A method according to claim 1 wherein said calibration data are further determined from said parameters for identifying said respective homographic transformations.

11. A method according to claim 1 , wherein said calibration data further comprise internal camera parameters which values can be further optimized based on said matches.

12. A device for determining calibration data for at least two cameras (camera 1 , camera 2 ) in a multi view position, said device adapted to perform the steps of:

determining respective parameters ((h 1 00 . . . h 1 22 ), (h 2 00 , . . . h 2 22 )) for identifying at least one respective homographic transformation on respective images (image 1 ,image 2 ) taken by said cameras of a same scene, by performing respective geometry analyses on said respective images (image 1 , image 2 ) ; and

performing at least one respective homographic transformation on said respective images and a respective feature detection step on respective transformed images thereby obtaining respective sets (feature set 1 , feature set 2 ) of features on said respective transformed images, such that said calibration data are obtained from matches (ml,..,mk) determined between said respective sets of features.

13. A computer program product comprising a non-transitory computer usable medium having computer usable program code stored therein, said computer program product when executed performs the following process:

determining respective parameters ((h 1 00 . . . h 1 22 ) (h 2 00 , . . . h 2 22 )) for identifying at least one respective homographic transformation on respective images (image 1 ,image 2 ) taken by said cameras of a same scene, by performing respective geometry analyses on said respective images (image 1 , image 2 ) ; and

performing at least one respective homographic transformation on said respective images and a respective feature detection step on respective transformed images thereby obtaining respective sets (feature set 1 , feature set 2 ) of features on said respective transformed images, such that said calibration data are obtained from matches (ml, . . . ,mk) determined between said respective sets of features.

14. A device according to claim 12 wherein said calibration data comprise information with respect to the relative position between said cameras.

15. A device according to claim 12 wherein said calibration data comprise information with respect to the relative viewing direction differences between said cameras.

16. A device according to claim 12 wherein said at least one respective homographic transformation further comprises an iterative process of pixel coordinates transformation of said respective image, followed by feature detection of the partially transformed image until all pixel coordinates of said respective image (image 1 ) are transformed.

17. A device according to claim 12 wherein said respective geometry analysis steps comprise determining line segments on said respective images.

18. A device according to claim 12 wherein said respective geometry analysis steps comprise determining curved segments on said respective image.

19. A device according to claim 12 wherein said respective geometry analysis steps comprise performing object recognition on said respective images.

20. A device according to claim 12 wherein said calibration data are further determined from said parameters for identifying said respective homographic transformations.

Assignments (11)
PATENT SECURITY AGREEMENT Recorded Apr 22, 2023
From: RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 063429/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: PROVENANCE ASSET GROUP LLC
To: RPX CORPORATION
Reel/Frame 059352/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: NOKIA US HOLDINGS INC.
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058363/0723 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: CORTLAND CAPITAL MARKETS SERVICES LLC
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058983/0104 →
ASSIGNMENT AND ASSUMPTION AGREEMENT Recorded Feb 14, 2019
From: NOKIA USA INC.
To: NOKIA US HOLDINGS INC.
Reel/Frame 048370/0682 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2017
From: NOKIA TECHNOLOGIES OY; NOKIA SOLUTIONS AND NETWORKS BV; ALCATEL LUCENT SAS
To: PROVENANCE ASSET GROUP LLC
Reel/Frame 043877/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP LLC
To: NOKIA USA INC.
Reel/Frame 043879/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP, LLC
To: CORTLAND CAPITAL MARKET SERVICES, LLC
Reel/Frame 043967/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 30, 2014
From: CREDIT SUISSE AG
To: ALCATEL LUCENT
Reel/Frame 033868/0555 →
SECURITY AGREEMENT Recorded Jan 30, 2013
From: ALCATEL LUCENT
To: CREDIT SUISSE AG
Reel/Frame 029821/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 27, 2012
From: AERTS, MAARTEN; TYTGAT, DONNY; MACQ, JEAN-FRANCOIS; LIEVENS, SAMMY
To: ALCATEL LUCENT
Reel/Frame 029358/0253 →
Priority Claims (1)
EP 10305309 · Mar 26, 2010 · regional
Continuity (1)
Related Publication 20130070108A1 · Mar 21, 2013