IP Library Granted Patent US 7,421,151
Granted Patent B2
US 7,421,151 · App. 10/849,276 · Granted Sep 2, 2008

Estimation of coefficients for a rational polynomial camera model

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,421,151
App. No.
10/849,276
Granted
Sep 2, 2008
Kind
B2
Abstract

One aspect of the invention is embodied in a number of machine-readable media having stored thereon sequences of instructions which, when executed by a machine, cause the machine to perform a number of actions. The actions include, for each of a plurality of image space coordinates of a camera image, retrieving 1) a corresponding camera position, and 2) corresponding object space coordinates on an object surface that is represented by the camera image. Then, for each of a plurality of height surfaces (chosen with respect to the object surface), a grid coordinate defined by an intersection between the height surface, and a line extending between the camera position and the object space coordinates, is determined. The determined grid coordinates are then associated with their corresponding image space coordinates. Finally, coefficients for a rational polynomial camera model are estimated by fitting rational polynomials to at least the grid coordinates and image space coordinates.

Claims (43)

1. A computer readable medium having stored thereon sequences of instructions which, when executed by a computer, cause the computer to perform the actions of:

for each of a plurality of image space coordinates in a camera image,

retrieving i) a corresponding camera position, and ii) corresponding object space coordinates on an object surface represented by said camera image;

for each of 5-10 height surfaces, chosen with respect to said object surface, determining a grid coordinate defined by an intersection between i) the height surface, and ii) a line extending between said camera position and said object space coordinates; and

associating said grid coordinates with said image space coordinates; and

estimating coefficients for a rational polynomial camera model by fitting rational polynomials to at least said grid coordinates and image space coordinates.

2. The computer readable medium of claim 1 , wherein the image space coordinates of the camera image are line and sample coordinates in a satellite image.

3. The computer readable medium of claim 2 , wherein the line and sample coordinates of the satellite image correspond to a lattice of points, said number of lattice points being fewer than the number of pixels in said satellite image.

4. The computer readable medium of claim 2 , wherein the satellite image is an ASTER VNIR image band.

5. The computer readable medium of claim 2 , wherein said camera positions and object space coordinates are retrieved from a number of ASTER L1A data granules.

6. The computer readable medium of claim 1 , wherein the object surface is a reference ellipsoid.

7. The computer readable medium of claim 1 , wherein said retrieved camera positions are provided in Cartesian coordinates; wherein said object surface is a reference ellipsoid; and wherein said object space coordinates are provide as latitude and longitude pairs on said reference ellipsoid; the instructions further causing the computer to perform the actions of:

prior to determining said grid coordinates, converting said object space coordinates to Cartesian coordinates; and

after determining a grid coordinate, converting the grid coordinate to a latitude, longitude and height.

8. The computer readable medium of claim 1 , wherein said fitting is accomplished using a least squares algorithm.

9. A computer readable medium having stored thereon sequences of instructions which, when executed by a computer, cause the computer to perform the actions of:

for each of a plurality of image space coordinates in a camera image that are line and sample coordinates in a satellite image, which is an ASTER VNIR image band,

retrieving i) a corresponding camera position, and ii) corresponding object space coordinates on an object surface represented by said camera image;

for each of a plurality of height surfaces, chosen with respect to said object surface, determining a grid coordinate defined by an intersection between i) the height surface, and ii) a line extending between said camera position and said object space coordinates; and

associating said grid coordinates with said image space coordinates; and

estimating coefficients for a rational polynomial camera model by fitting rational polynomials to at least said grid coordinates and image space coordinates, wherein the instructions cause the actions to be repeated for each image band of the ASTER VNIR subsystem.

10. A computer readable medium having stored thereon sequences of instructions which, when executed by a computer, cause the computer to perform the actions of:

for each of a plurality of image space coordinates in a camera image,

retrieving i) a corresponding camera position, and ii) a line-of-sight vector from the camera position toward an object surface represented by said camera image;

for each of 5-10 height surfaces, chosen with respect to said object surface, determining a grid coordinate defined by an intersection between i) the height surface, and ii) said line-of-sight vector; and

associating said grid coordinates with said image space coordinates; and

estimating coefficients for a rational polynomial camera model by fitting rational polynomials to at least said grid coordinates and image space coordinates.

11. The computer readable medium of claim 10 , wherein the image space coordinates of the camera image are line and sample points in a satellite image.

12. The computer readable medium of claim 11 , wherein the line and sample points of the satellite image correspond to a lattice of points, said number of lattice points being fewer than the number of pixels in said satellite image.

13. The computer readable medium of claim 11 wherein the satellite image is an ASTER VNIR image band.

14. The computer readable medium of claim 11 , wherein said camera positions and line-of-sight vectors are retrieved from a number of ASTER L1A data granules.

15. The computer readable medium of claim 10 , wherein the object surface is a reference ellipsoid.

16. The computer readable medium of claim 10 , wherein said line of sight vectors are provided in orbital coordinates, the instructions further causing the computer to perform the action of:

converting said line of sight vectors to Cartesian coordinates.

17. The computer readable medium of claim 10 , wherein said retrieved camera positions are provided in Cartesian coordinates; wherein said object surface is a reference ellipsoid; the instructions further causing the computer to perform the action of:

after determining a grid coordinate, converting the grid coordinate to a latitude, longitude and height.

18. The computer readable medium of claim 10 , wherein said fitting is accomplished using a least squares algorithm.

19. A computer readable medium having stored thereon sequences of instructions which, when executed by a computer, cause the computer to perform the actions of:

for each of a plurality of image space coordinates in a camera image that are line and sample coordinates in a satellite image, which is an ASTER VNIR image band,

retrieving i) a corresponding camera position, and ii) a line-of-sight vector from the camera position toward an object surface represented by said camera image;

for each of a plurality of height surfaces, chosen with respect to said object surface, determining a grid coordinate defined by an intersection between i) the height surface, and ii) said line-of-sight vector; and

associating said grid coordinates with said image space coordinates; and

estimating coefficients for a rational polynomial camera model by fitting rational polynomials to at least said grid coordinates and image space coordinates, wherein the instructions cause the actions to be repeated for each image band of the ASTER VNIR subsystem.

Assignments (32)
RELEASE OF SECURITY INTEREST Recorded Mar 3, 2026
From: SIXTH STREET LENDING PARTNERS, ACTING IN ITS CAPACITY AS AGENT
To: AURORA INSIGHT INC.; VANTOR INC. (F/K/A MAXAR INTELLIGENCE INC.); VANTOR SERVICES INC. (F/K/A MAXAR MISSION SOLUTIONS INC.); LANTERIS SPACE LLC (F/K/A MAXAR SPACE LLC); SPATIAL ENERGY, LLC; LANTERIS SPACE ROBOTICS LLC (F/K/A MAXAR SPACE ROBOTICS LLC); VANTOR HOLDINGS INC. (F/K/A MAXAR TECHNOLOGIES HOLDINGS INC.)
Reel/Frame 075021/0624 →
CERTIFICATE OF AMENDMENT Recorded Jan 7, 2026
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 074270/0330 →
CHANGE OF NAME Recorded Nov 4, 2025
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 073458/0636 →
RELEASE (REEL 060389/FRAME 0720) Recorded May 12, 2023
From: ROYAL BANK OF CANADA
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063633/0431 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 5, 2023
From: MAXAR INTELLIGENCE INC. (F/K/A DIGITALGLOBE, INC.); AURORA INSIGHT INC.; MAXAR MISSION SOLUTIONS INC. ((F/K/A RADIANT MISSION SOLUTIONS INC. (F/K/A THE RADIANT GROUP, INC.)); MAXAR SPACE LLC (F/K/A SPACE SYSTEMS/LORAL, LLC); SPATIAL ENERGY, LLC; MAXAR SPACE ROBOTICS LLC ((F/K/A SSL ROBOTICS LLC) (F/K/A MDA US SYSTEMS LLC)); MAXAR TECHNOLOGIES HOLDINGS INC.
To: SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT
Reel/Frame 063660/0138 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 044167/0396 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063543/0001 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 053866/0412 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0011 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 060389/0782 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0074 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 051258/0465 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063542/0300 →
CHANGE OF NAME Recorded Feb 15, 2023
From: DIGITALGLOBE, INC.
To: MAXAR INTELLIGENCE INC.
Reel/Frame 062760/0832 →
RELEASE OF SECURITY INTEREST Recorded Jun 21, 2022
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: DIGITALGLOBE, INC.; SPACE SYSTEMS/LORAL, LLC; RADIANT GEOSPATIAL SOLUTIONS LLC
Reel/Frame 060390/0282 →
SECURITY AGREEMENT Recorded Jun 17, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 060389/0782 →
SECURITY AGREEMENT Recorded Jun 16, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: ROYAL BANK OF CANADA
Reel/Frame 060389/0720 →
PATENT SECURITY AGREEMENT Recorded Sep 23, 2020
From: DIGITALGLOBE, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 053866/0412 →
SECURITY AGREEMENT (NOTES) Recorded Dec 12, 2019
From: DIGITALGLOBE, INC.; RADIANT GEOSPATIAL SOLUTIONS LLC; SPACE SYSTEMS/LORAL, LLC (F/K/A SPACE SYSTEMS/LORAL INC.)
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, - AS NOTES COLLATERAL AGENT
Reel/Frame 051262/0824 →
AMENDED AND RESTATED U.S. PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Dec 11, 2019
From: DIGITALGLOBE, INC.
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 051258/0465 →
RELEASE OF SECURITY INTEREST IN PATENTS FILED AT R/F 041069/0910 Recorded Oct 5, 2017
From: BARCLAYS BANK PLC
To: DIGITALGLOBE, INC.
Reel/Frame 044363/0524 →
SECURITY INTEREST Recorded Oct 5, 2017
From: DIGITALGLOBE, INC.; MACDONALD, DETTWILER AND ASSOCIATES LTD.; MACDONALD, DETTWILER AND ASSOCIATES CORPORATION; MACDONALD, DETTWILER AND ASSOCIATES INC.; MDA GEOSPATIAL SERVICES INC.; SPACE SYSTEMS/LORAL, LLC; MDA INFORMATION SYSTEMS LLC
To: ROYAL BANK OF CANADA, AS THE COLLATERAL AGENT
Reel/Frame 044167/0396 →
SECURITY INTEREST Recorded Jan 23, 2017
From: DIGITALGLOBE, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 041069/0910 →
MERGER Recorded Jan 5, 2017
From: GEOEYE SOLUTIONS INC.
To: GEOEYE SOLUTIONS HOLDCO INC.
Reel/Frame 040866/0490 →
MERGER Recorded Jan 5, 2017
From: GEOEYE SOLUTIONS HOLDCO INC.
To: DIGITALGLOBE, INC.
Reel/Frame 040866/0571 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (029734/0427) Recorded Dec 22, 2016
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: DIGITALGLOBE INC.; GEOEYE ANALYTICS INC.; GEOEYE, LLC; GEOEYE SOLUTIONS INC.
Reel/Frame 041176/0066 →
PATENT SECURITY AGREEMENT Recorded Feb 1, 2013
From: DIGITALGLOBE, INC.; GEOEYE ANALYTICS INC.; GEOEYE, LLC; GEOEYE SOLUTIONS INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 029734/0427 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 31, 2013
From: WILMINGTON TRUST, NATIONAL ASSOCIATION (AS SUCCESSOR BY MERGER TO WILMINGTON TRUST FSB)
To: GEOEYE SOLUTIONS INC. (F/K/A ORBIMAGE SI OPCO INC.)
Reel/Frame 029733/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 31, 2013
From: THE BANK OF NEW YORK MELLON
To: GEOEYE SOLUTIONS INC. (F/K/A ORBIMAGE SI OPCO INC.)
Reel/Frame 029733/0035 →
SECURITY AGREEMENT Recorded Nov 16, 2010
From: GEOEYE SOLUTIONS INC.
To: WILMINGTON TRUST FSB
Reel/Frame 025366/0129 →
CHANGE OF NAME Recorded Oct 6, 2010
From: ORBIMAGE SI OPCO, INC.
To: GEOEYE SOLUTIONS INC.
Reel/Frame 025095/0683 →
SECURITY AGREEMENT Recorded Oct 12, 2009
From: ORBIMAGE SI OPCO INC.
To: THE BANK OF NEW YORK MELLON
Reel/Frame 023355/0356 →
RELEASE OF SECURITY INTEREST AT REEL/FRAME 017057/0941 Recorded Oct 9, 2009
From: THE BANK OF NEW YORK
To: ORBIMAGE SI OPCO INC.; ORBIMAGE SI HOLDCO INC.
Reel/Frame 023348/0658 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2008
From: SPACE IMAGING LLC
To: ORBIMAGE SI OPCO INC.
Reel/Frame 021160/0484 →
SECURITY AGREEMENT Recorded Jan 25, 2006
From: ORBIMAGE SI HOLDCO INC.; ORBIMAGE SI OPCO INC.
To: THE BANK OF NEW YORK AS COLLATERAL AGENT
Reel/Frame 017057/0941 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2004
From: LUTES, JAMES ANTHONY; GRODECKI, JACEK FRANCISZEK
To: SPACE IMAGING, LLC
Reel/Frame 015356/0068 →