IP Library Granted Patent US 11,024,044
Granted Patent B2
US 11,024,044 · App. 15/716,425 · Granted Jun 1, 2021

Techniques for image co-registration

Inventor: Grzegorz Miecznik (Erie, CO)
Assignee: DIGITALGLOBE, INC.
G06T7/32G06T7/207G06T7/35G06T2207/10036
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,024,044
App. No.
15/716,425
Granted
Jun 1, 2021
Kind
B2
Abstract

Techniques for improving image co-registration. One aspect relates to improving Mutual Information techniques by making the histogram bin widths used therein depend on the amount of signal noise. Another aspect relates to populating the bins by integrating the signal probability in each bin. A third aspect relates to converting top-of-the-atmosphere image data to surface reflectance data, and then using surface reflectance data in the Mutual Information technique for determining a correlation surface. The fourth aspect relates to registering higher-resolution images with lower-resolution images by down-sampling the higher-resolution image. The last aspect relates to a technique for determining the accuracy of the co-registration by synthesizing a perfectly-registered image in a second wavelength band from an image in a first wavelength band and then using Mutual Information between the two images to create a correlation surface.

Claims (26)

1. A computer-implemented method for co-registering images, the method comprising:

retrieving at least two images of an area of interest, each of the images being imaged from a different bank of sensors;

creating a signal intensity histogram of each image, with each histogram being divided into a plurality of bins, with each bin having a bin width;

cross correlating the two images by cross correlating the two histograms to create a correlation map that represents Mutual Information in the two images; and

using the peak on the correlation map to register the images with each other;

wherein the width of each bin of each of the two histograms to be cross-correlated, depends on an amount of noise in the signal intensity within that particular bin.

2. A method as defined in claim 1 , wherein the width of each bin increases with increasing signal.

3. A method as defined in claim 1 , wherein the width of each bin is related to the square root of the signal.

4. A method as defined in claim 1 , wherein the bins are populated by integrating a probability of the signal intensity in each bin.

5. A method as defined in claim 1 , further including converting each of the images from top-of-the-atmosphere image data to surface reflectance image data.

6. A method as defined in claim 1 , wherein each of the images includes image data at a different spatial resolution from the other image, so that there is a higher-resolution image and a lower-resolution image.

7. A method as defined in claim 1 , wherein the noise in the signal intensity is based on the shot noise for the corresponding bank of sensors.

8. A method as defined in claim 1 , wherein the width of each bin is based on a common multiplicative constant.

9. A method as defined in claim 1 , wherein the width of each bin is the product of a fixed constant and the signal intensity.

10. A method as defined in claim 1 , wherein the width of each bin is the product of a fixed constant and the square-root of the signal intensity.

11. A method as defined in claim 1 , further comprising using sensor noise to derive Gaussian probability and using the Gaussian probability for the cross correlating.

12. A method as defined in claim 1 , further comprising:

identifying an existence of a high amount of aerosols in the atmosphere; and

populating the bins by integrating a probability of the signal intensity in each bin, wherein the populating is executed in response to the identifying.

13. A method as defined in claim 1 , wherein the width of each bin increases with increasing noise.

14. A method as defined in claim 13 , wherein each of the images includes image data at a different spatial resolution from the other image, so that there is a higher-resolution image and a lower-resolution image.

15. A method as defined in claim 13 , further including converting each of the images from top-of-the-atmosphere image data to surface reflectance image data.

16. A method as defined in claim 13 , wherein the bins are populated by integrating a probability of the signal intensity in each bin.

17. A method as defined in claim 16 , wherein each of the images includes image data at a different spatial resolution from the other image, so that there is a higher-resolution image and a lower-resolution image.

18. A method as defined in claim 16 , further including converting each of the images from top-of-the-atmosphere image data to surface reflectance image data.

19. A method as defined in claim 18 , wherein each of the images includes image data at a different spatial resolution from the other image, so that there is a higher-resolution image and a lower-resolution image.

Assignments (16)
RELEASE OF SECURITY INTEREST Recorded Mar 3, 2026
From: SIXTH STREET LENDING PARTNERS, ACTING IN ITS CAPACITY AS AGENT
To: AURORA INSIGHT INC.; VANTOR INC. (F/K/A MAXAR INTELLIGENCE INC.); VANTOR SERVICES INC. (F/K/A MAXAR MISSION SOLUTIONS INC.); LANTERIS SPACE LLC (F/K/A MAXAR SPACE LLC); SPATIAL ENERGY, LLC; LANTERIS SPACE ROBOTICS LLC (F/K/A MAXAR SPACE ROBOTICS LLC); VANTOR HOLDINGS INC. (F/K/A MAXAR TECHNOLOGIES HOLDINGS INC.)
Reel/Frame 075021/0624 →
CERTIFICATE OF AMENDMENT Recorded Jan 7, 2026
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 074270/0330 →
CHANGE OF NAME Recorded Nov 4, 2025
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 073461/0767 →
RELEASE (REEL 060389/FRAME 0720) Recorded May 12, 2023
From: ROYAL BANK OF CANADA
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063633/0431 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 5, 2023
From: MAXAR INTELLIGENCE INC. (F/K/A DIGITALGLOBE, INC.); AURORA INSIGHT INC.; MAXAR MISSION SOLUTIONS INC. ((F/K/A RADIANT MISSION SOLUTIONS INC. (F/K/A THE RADIANT GROUP, INC.)); MAXAR SPACE LLC (F/K/A SPACE SYSTEMS/LORAL, LLC); SPATIAL ENERGY, LLC; MAXAR SPACE ROBOTICS LLC ((F/K/A SSL ROBOTICS LLC) (F/K/A MDA US SYSTEMS LLC)); MAXAR TECHNOLOGIES HOLDINGS INC.
To: SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT
Reel/Frame 063660/0138 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 053866/0412 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0011 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 060389/0782 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0074 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 051258/0465 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063542/0300 →
CHANGE OF NAME Recorded Feb 15, 2023
From: DIGITALGLOBE, INC.
To: MAXAR INTELLIGENCE INC.
Reel/Frame 062760/0832 →
RELEASE OF SECURITY INTEREST Recorded Jun 21, 2022
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: DIGITALGLOBE, INC.; SPACE SYSTEMS/LORAL, LLC; RADIANT GEOSPATIAL SOLUTIONS LLC
Reel/Frame 060390/0282 →
SECURITY AGREEMENT Recorded Jun 17, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 060389/0782 →
SECURITY AGREEMENT Recorded Jun 16, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: ROYAL BANK OF CANADA
Reel/Frame 060389/0720 →
PATENT SECURITY AGREEMENT Recorded Sep 23, 2020
From: DIGITALGLOBE, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 053866/0412 →
SECURITY AGREEMENT (NOTES) Recorded Dec 12, 2019
From: DIGITALGLOBE, INC.; RADIANT GEOSPATIAL SOLUTIONS LLC; SPACE SYSTEMS/LORAL, LLC (F/K/A SPACE SYSTEMS/LORAL INC.)
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, - AS NOTES COLLATERAL AGENT
Reel/Frame 051262/0824 →
AMENDED AND RESTATED U.S. PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Dec 11, 2019
From: DIGITALGLOBE, INC.
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 051258/0465 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2017
From: MIECZNIK, GRZEGORZ
To: DIGITALGLOBE, INC.
Reel/Frame 044207/0631 →