IP Library Granted Patent US 8,212,874
Granted Patent B2
US 8,212,874 · App. 12/604,963 · Granted Jul 3, 2012

Automatic camera calibration using GPS and solar tracking

Assignee: GM Global Technology Operations LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,212,874
App. No.
12/604,963
Granted
Jul 3, 2012
Kind
B2
Abstract

A system and method for automatically calibrating the aiming direction of a camera onboard a vehicle. The method uses GPS and solar almanac data to estimate the location of the sun relative to the vehicle, and compares this to the solar position in an image from the camera. The comparison is performed with an ongoing recursive calculation which yields an improved estimate of the sun position relative to the vehicle, while simultaneously calibrating the aiming direction of the camera. The aiming calibration data is used to improve the accuracy of the camera's images as used for all of the camera's other functions.

Claims (29)

1. A method for calibrating an aiming direction of a camera, said method comprising:

mounting a global positioning system receiver to a mobile platform, said mobile platform having a true straight-ahead direction;

mounting the camera to the mobile platform; using data from the global positioning system receiver and a solar almanac database to create a first estimate of the position of the sun relative to the mobile platform;

analyzing an image from the camera to create a second estimate of the position of the sun relative to the mobile platform;

using the first and second estimates of the position of the sun relative to the mobile platform in an ongoing recursive calculation which yields a pitch angle and an azimuth angle of misalignment between the camera's aiming direction and the mobile platform's true straight-ahead direction, and

using an improved estimate of the position of the sun relative to the mobile platform from the recursive calculation to control the position of a sun blocker.

2. The method according to claim 1 wherein the ongoing recursive calculation uses a Kalman filtering algorithm.

3. The method according to claim 1 wherein the mobile platform is a vehicle.

4. The method according to claim 1 wherein the camera is a forward-looking camera.

5. The method according to claim 1 further comprising using angles of misalignment between the camera's aiming direction and the mobile platform's true straight-ahead direction as calibration input for other functions of the camera.

6. A system for calibrating an aiming direction of a camera relative to a mobile platform, said system comprising:

a Global Positioning System receiver mounted to the mobile platform, said mobile platform having a true straight-ahead direction;

a first solar position estimator module which uses data from the Global Positioning System receiver and a solar almanac database to create a first estimate of the position of the sun relative to the mobile platform;

a second solar position estimator module which analyzes an image from the camera to create a second estimate of the position of the sun relative to the mobile platform;

a fusion module which uses the first and second estimates of the position of the sun relative to the mobile platform in an ongoing recursive calculation which yields a pitch angle and an azimuth angle of misalignment between the camera's aiming direction and the mobile platform's true straight-ahead direction; and

a controller for positioning a sun blocker in response to an improved estimate of the position of the sun relative to the mobile platform from the fusion module.

7. The system according to claim 6 wherein the ongoing recursive calculation in the fusion module uses a Kalman filtering algorithm.

8. The system according to claim 6 wherein the mobile platform is a vehicle.

9. The system according to claim 6 wherein the camera is a forward-looking camera.

10. The system according to claim 6 further comprising a calibration data module for storing the angles of misalignment between the camera's aiming direction and the mobile platform's true straight-ahead direction and making the angles of misalignment available as a calibration input for other functions of the camera.

11. A self-calibrating system for a forward-looking camera on a vehicle, said system comprising:

a Global Positioning System receiver mounted to the vehicle, said vehicle having a true straight-ahead direction and said camera having an aiming direction;

a first solar position estimator module which uses data from the Global Positioning System receiver and a solar almanac database to create a first estimate of the position of the sun relative to the vehicle;

a second solar position estimator module which analyzes an image from the camera to create a second estimate of the position of the sun relative to the vehicle;

a fusion module which uses the first and second estimates of the position of the sun relative to the vehicle in an ongoing recursive calculation which yields a pitch angle and an azimuth angle of misalignment between the camera's aiming direction and the vehicle's true straight-ahead direction;

a calibration data module for storing the angles of misalignment between the camera's aiming direction and the vehicle's true straight-ahead direction and making the angles of misalignment available as a calibration input to other functions of the camera; and

a controller for positioning a sun blocker in response to an improved estimate of the position of the sun relative to the vehicle from the fusion module.

12. The self-calibrating system according to claim 11 wherein the fusion module uses a Kalman filtering algorithm for the ongoing recursive calculation.

13. The self-calibrating system according to claim 11 wherein the camera's other functions include lane departure warning and collision detection.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034287/0001 →
CHANGE OF NAME Recorded Feb 10, 2011
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 025781/0299 →
SECURITY AGREEMENT Recorded Nov 8, 2010
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: WILMINGTON TRUST COMPANY
Reel/Frame 025324/0555 →
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2010
From: UAW RETIREE MEDICAL BENEFITS TRUST
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025315/0136 →
RELEASE OF SECURITY INTEREST Recorded Nov 4, 2010
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025246/0234 →
SECURITY AGREEMENT Recorded Feb 25, 2010
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 023989/0155 →
SECURITY AGREEMENT Recorded Feb 25, 2010
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UAW RETIREE MEDICAL BENEFITS TRUST
Reel/Frame 023990/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2009
From: ZENG, SHUQING; NAIK, SANJEEV M.
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 023424/0575 →
Continuity (1)
Related Publication 20110096165A1 · Apr 28, 2011