IP Library Granted Patent US 7,317,844
Granted Patent B1
US 7,317,844 · App. 11/753,272 · Granted Jan 8, 2008

Tonal balancing of multiple images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,317,844
App. No.
11/753,272
Granted
Jan 8, 2008
Kind
B1
Abstract

Method for tonally balancing a image mosaic includes supplying the image mosaic which has multiple overlap regions; identifying in the overlap regions a set of corresponding points that correspond to a single location and are indicative of a tonal variation; establishing a tonal variation threshold; eliminating from the overlap regions a subset of corresponding points, the subset having tonal variation deviating from the tonal variation threshold; repeating the eliminating until substantially all subsets have been eliminated, producing adjusted overlap regions that include a set of remaining corresponding points; obtaining gains and biases for each spectral band in the adjusted overlap regions; applying the gains and biases to transform intensities of the set of remaining corresponding points, producing transformed corresponding points; and producing a tonally balanced image mosaic using the transformed corresponding points.

Claims (39)

1. A method for tonally balancing an image mosaic, comprising:

supplying the image mosaic, the image mosaic having multiple overlap regions;

identifying in the overlap regions a set of corresponding points, the corresponding points corresponding to a single location and being indicative of a tonal variation;

establishing a tonal variation threshold;

eliminating from the overlap regions a subset of corresponding points, the subset having tonal variation deviating from the tonal variation threshold;

repeating the eliminating until substantially all subsets have been eliminated,

producing adjusted overlap regions comprising a set of remaining corresponding points;

obtaining gains and biases for each spectral band in the adjusted overlap regions;

applying the gains and biases to transform intensities of the set of remaining corresponding points producing transformed corresponding points; and

producing a tonally balanced image mosaic using the transformed corresponding points.

2. The method of claim 1 further comprising repeating the obtaining gains and biases after intensities of each set of remaining corresponding points have been transformed.

3. The method of claim 1 further comprising applying a backscattering correction to the image mosaic.

4. The method of claim 1 further comprising applying an atmospheric correction to the image mosaic.

5. The method of claim 4 further comprising:

determining whether the image mosaic has been clipped;

and,

if clipping has occurred, adjusting the biases of the image mosaic uniformly to match a worst case underclipping and a worst case overclipping of intensities of the image mosaic.

6. A computer-readable medium having stored thereon instructions that when executed by the computer cause the computer to tonally balance a set of overlapping images by:

using a subset of corresponding points in each of a plurality of image overlap regions to solve a set of minimization equations for gains and biases for each spectral band of each image, the corresponding points being points from different images having locations that correspond to each other, the subset of corresponding points consisting of corresponding points whose intensities differ less than a threshold;

applying the gains and biases to the images;

iterating the using and applying actions for a predetermined number of iterations, the iterating resulting in an iterated gain and an iterated bias for each spectral band of each image;

transforming intensities of points for each spectral band in each image using the iterated gain and the iterated bias for the corresponding spectral band to produce transformed intensities of points; and

producing a tonally balanced image mosaic by using the transformed intensities of points in the images.

7. The medium of claim 6 , wherein the set of minimization equations penalize gains that stray from a desired gain.

8. The medium of claim 6 , wherein the set of minimization equations encourage gains for a common spectral band to average to the desired gain.

9. The medium of claim 6 , wherein the set of minimization equations penalize biases that stray from a desired bias.

10. The medium of claim 6 , wherein the set of minimization equations weight corresponding points based on a size of the overlap in which they reside, to thereby give differing sizes of image overlaps equal importance in the minimization equations.

11. A computer-readable medium having stored thereon instructions that when executed by the computer cause the computer to tonally balance an image mosaic, by:

supplying the image mosaic, the image mosaic having multiple overlap regions;

identifying in the overlap regions a set of corresponding points, the corresponding points corresponding to a single location and being indicative of a tonal variation;

establishing a tonal variation threshold;

eliminating from the overlap regions a subset of corresponding points, the subset having tonal variation deviating from the tonal variation threshold;

repeating the eliminating until substantially all subsets have been eliminated, producing adjusted overlap regions comprising a set of remaining corresponding points;

obtaining gains and biases for each spectral band in the adjusted overlap regions;

applying the gains and biases to transform intensities of the set of remaining corresponding points producing transformed corresponding points; and

producing a tonally balanced image mosaic using the transformed corresponding points.

12. The medium of claim 11 , wherein the instructions cause tonal balancing of the image mosaic by repeating the obtaining gains and biases after intensities of each set of remaining corresponding points have been transformed.

13. The medium of claim 11 , wherein the instructions cause tonal balancing of the image mosaic by applying a backscattering correction to the image mosaic.

14. The medium of claim 11 , wherein the instructions cause tonal balancing of the image mosaic by applying an atmospheric correction to the image mosaic.

Assignments (28)
RELEASE OF SECURITY INTEREST Recorded Mar 3, 2026
From: SIXTH STREET LENDING PARTNERS, ACTING IN ITS CAPACITY AS AGENT
To: AURORA INSIGHT INC.; VANTOR INC. (F/K/A MAXAR INTELLIGENCE INC.); VANTOR SERVICES INC. (F/K/A MAXAR MISSION SOLUTIONS INC.); LANTERIS SPACE LLC (F/K/A MAXAR SPACE LLC); SPATIAL ENERGY, LLC; LANTERIS SPACE ROBOTICS LLC (F/K/A MAXAR SPACE ROBOTICS LLC); VANTOR HOLDINGS INC. (F/K/A MAXAR TECHNOLOGIES HOLDINGS INC.)
Reel/Frame 075021/0624 →
RELEASE (REEL 060389/FRAME 0720) Recorded May 12, 2023
From: ROYAL BANK OF CANADA
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063633/0431 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 5, 2023
From: MAXAR INTELLIGENCE INC. (F/K/A DIGITALGLOBE, INC.); AURORA INSIGHT INC.; MAXAR MISSION SOLUTIONS INC. ((F/K/A RADIANT MISSION SOLUTIONS INC. (F/K/A THE RADIANT GROUP, INC.)); MAXAR SPACE LLC (F/K/A SPACE SYSTEMS/LORAL, LLC); SPATIAL ENERGY, LLC; MAXAR SPACE ROBOTICS LLC ((F/K/A SSL ROBOTICS LLC) (F/K/A MDA US SYSTEMS LLC)); MAXAR TECHNOLOGIES HOLDINGS INC.
To: SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT
Reel/Frame 063660/0138 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 060389/0782 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0074 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 053866/0412 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0011 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 051258/0465 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063542/0300 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 044167/0396 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063543/0001 →
CHANGE OF NAME Recorded Feb 15, 2023
From: DIGITALGLOBE, INC.
To: MAXAR INTELLIGENCE INC.
Reel/Frame 062760/0832 →
RELEASE OF SECURITY INTEREST Recorded Jun 21, 2022
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: DIGITALGLOBE, INC.; SPACE SYSTEMS/LORAL, LLC; RADIANT GEOSPATIAL SOLUTIONS LLC
Reel/Frame 060390/0282 →
SECURITY AGREEMENT Recorded Jun 17, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 060389/0782 →
SECURITY AGREEMENT Recorded Jun 16, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: ROYAL BANK OF CANADA
Reel/Frame 060389/0720 →
PATENT SECURITY AGREEMENT Recorded Sep 23, 2020
From: DIGITALGLOBE, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 053866/0412 →
SECURITY AGREEMENT (NOTES) Recorded Dec 12, 2019
From: DIGITALGLOBE, INC.; RADIANT GEOSPATIAL SOLUTIONS LLC; SPACE SYSTEMS/LORAL, LLC (F/K/A SPACE SYSTEMS/LORAL INC.)
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, - AS NOTES COLLATERAL AGENT
Reel/Frame 051262/0824 →
AMENDED AND RESTATED U.S. PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Dec 11, 2019
From: DIGITALGLOBE, INC.
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 051258/0465 →
SECURITY INTEREST Recorded Oct 5, 2017
From: DIGITALGLOBE, INC.; MACDONALD, DETTWILER AND ASSOCIATES LTD.; MACDONALD, DETTWILER AND ASSOCIATES CORPORATION; MACDONALD, DETTWILER AND ASSOCIATES INC.; MDA GEOSPATIAL SERVICES INC.; SPACE SYSTEMS/LORAL, LLC; MDA INFORMATION SYSTEMS LLC
To: ROYAL BANK OF CANADA, AS THE COLLATERAL AGENT
Reel/Frame 044167/0396 →
RELEASE OF SECURITY INTEREST IN PATENTS FILED AT R/F 041069/0910 Recorded Oct 5, 2017
From: BARCLAYS BANK PLC
To: DIGITALGLOBE, INC.
Reel/Frame 044363/0524 →
SECURITY INTEREST Recorded Jan 23, 2017
From: DIGITALGLOBE, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 041069/0910 →
MERGER Recorded Jan 5, 2017
From: GEOEYE SOLUTIONS HOLDCO INC.
To: DIGITALGLOBE, INC.
Reel/Frame 040866/0571 →
MERGER Recorded Jan 5, 2017
From: GEOEYE SOLUTIONS INC.
To: GEOEYE SOLUTIONS HOLDCO INC.
Reel/Frame 040866/0490 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (029734/0427) Recorded Dec 22, 2016
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: DIGITALGLOBE INC.; GEOEYE ANALYTICS INC.; GEOEYE, LLC; GEOEYE SOLUTIONS INC.
Reel/Frame 041176/0066 →
PATENT SECURITY AGREEMENT Recorded Feb 1, 2013
From: DIGITALGLOBE, INC.; GEOEYE ANALYTICS INC.; GEOEYE, LLC; GEOEYE SOLUTIONS INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 029734/0427 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 31, 2013
From: WILMINGTON TRUST, NATIONAL ASSOCIATION (AS SUCCESSOR BY MERGER TO WILMINGTON TRUST FSB)
To: GEOEYE SOLUTIONS INC. (F/K/A ORBIMAGE SI OPCO INC.)
Reel/Frame 029733/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 31, 2013
From: THE BANK OF NEW YORK MELLON
To: GEOEYE SOLUTIONS INC. (F/K/A ORBIMAGE SI OPCO INC.)
Reel/Frame 029733/0035 →
SECURITY AGREEMENT Recorded Nov 16, 2010
From: GEOEYE SOLUTIONS INC.
To: WILMINGTON TRUST FSB
Reel/Frame 025366/0129 →
CHANGE OF NAME Recorded Oct 6, 2010
From: ORBIMAGE SI OPCO, INC.
To: GEOEYE SOLUTIONS INC.
Reel/Frame 025095/0683 →
SECURITY AGREEMENT Recorded Oct 12, 2009
From: ORBIMAGE SI OPCO INC.
To: THE BANK OF NEW YORK MELLON
Reel/Frame 023355/0356 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2007
From: HORNE, JAMES H.
To: SPACE IMAGING LLC
Reel/Frame 019340/0458 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2007
From: SPACE IMAGING LLC
To: ORBIMAGE SI OPCO INC. D/B/A GEOEYE
Reel/Frame 019340/0500 →