IP Library Granted Patent US 7,613,362
Granted Patent B1
US 7,613,362 · App. 11/835,169 · Granted Nov 3, 2009

Image warp

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,613,362
App. No.
11/835,169
Granted
Nov 3, 2009
Kind
B1
Abstract

Method for warping first and second overlapping images includes selecting a first set of points in a first image, the first set of points being located in an overlap region between first and second images; selecting a set of tie points in the second image, including individual tie points each of which correlates to a point in the first set of points; selecting from the first image a patch including at least one point from the first set of points and at least one neighboring point; performing shadow detection to determine a percentage of the patch exceeding a predetermined percentage, thereby indicating a shadow; if so, eliminating the at least one point so that it is not correlated with any of the individual tie points, thereby avoiding correlating the shadow in the first image to a shadow in the second image.

Claims (32)

1. A method for transforming image data representative of a set of overlapping images to produce an image mosaic, comprising:

selecting a first set of points in a first image, the first set of points being located in an overlap region between the first image and a second image;

selecting a set of tie points in the second image, the set of tie points comprising individual tie points, each individual tie point correlating to a point in the first set of points;

selecting a patch in the first image, the patch comprising patch points including at least one point from the first set of points and at least one neighboring point within a first distance from the at least one point;

performing shadow detection to determine a percentage of the patch comprising a shadow;

determining if the percentage of the patch comprising the shadow exceeds a predetermined percentage;

if the percentage exceeds the predetermined percentage, eliminating the at least one point from the first set of points so that the least one point is not correlated with any of the individual tie points, thereby avoiding correlating the shadow in the first image to a shadow in the second image; and

warping the first and second images together to produce the image mosaic, said warping not utilizing any points eliminated from the first set of points.

2. The method of claim 1 wherein performing shadow detection comprises:

establishing a shadow range;

creating a histogram from image data of the patch;

determining, from the histogram, whether a bimodal distribution exists for the patch;

if the bimodal distribution exists, determining from the image data a mean point intensity for the patch;

determining whether the mean point intensity value falls within the shadow range;

using the mean intensity value to determine the percentage.

3. The method of claim 2 wherein determining whether a bimodal distribution exists comprises calculating a bimodal coefficient.

4. The method of claim 1 , further comprising reducing the resolution of the patch by a resolution parameter.

5. The method of claim 4 , further comprising reducing the resolution of the second image by the resolution parameter.

6. The method of claim 1 , further comprising performing coarse mapping of the first image and the second image.

7. The method of claim 6 wherein performing coarse mapping comprises:

establishing a set of user correlations, the user correlations correlating the first set of points with the at least one set of tie points;

calculating a Delaunay triangulation of the at least one set of tie points; and

using the Delaunay triangulation to create an initial warp of the first image and the second image.

8. The method of claim 7 wherein using the Delaunay triangulation comprises computing a linear coarse warp, the linear coarse warp being used to create an initial warp of the first image and the second image.

9. A computer readable medium readable by a computer, the medium embodying a program of instructions executable by the computer to cause the computer to transform image data representative of a set of overlapping images to produce an image mosaic by performing the actions of:

selecting a first set of points in a first image, the first set of points being located in an overlap region between the first image and a second image;

determining a set of tie points in the second image, the set of tie points comprising individual tie points, each individual tie point correlating to a point in the first set of points;

selecting a patch in the first image, the patch comprising patch points including at least one point from the first set of points and at least one neighboring point within a first distance from the at least one point;

performing shadow detection to determine a percentage of the patch comprising a shadow;

determining if the percentage of the patch comprising the shadow exceeds a predetermined percentage;

if the percentage exceeds the predetermined percentage, eliminating the at least one point from the first set of points, the at least one point being an eliminated point, so that the eliminated point is not correlated with any of the individual tie points, thereby avoiding correlating the shadow in the first image to a shadow in the second image; and

warping the first and second images together to produce the image mosaic, said warping not utilizing any points eliminated from the first set of points.

Assignments (27)
RELEASE (REEL 060389/FRAME 0720) Recorded May 12, 2023
From: ROYAL BANK OF CANADA
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063633/0431 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 5, 2023
From: MAXAR INTELLIGENCE INC. (F/K/A DIGITALGLOBE, INC.); AURORA INSIGHT INC.; MAXAR MISSION SOLUTIONS INC. ((F/K/A RADIANT MISSION SOLUTIONS INC. (F/K/A THE RADIANT GROUP, INC.)); MAXAR SPACE LLC (F/K/A SPACE SYSTEMS/LORAL, LLC); SPATIAL ENERGY, LLC; MAXAR SPACE ROBOTICS LLC ((F/K/A SSL ROBOTICS LLC) (F/K/A MDA US SYSTEMS LLC)); MAXAR TECHNOLOGIES HOLDINGS INC.
To: SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT
Reel/Frame 063660/0138 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 051258/0465 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063542/0300 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 044167/0396 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063543/0001 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 053866/0412 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0011 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 060389/0782 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0074 →
CHANGE OF NAME Recorded Feb 15, 2023
From: DIGITALGLOBE, INC.
To: MAXAR INTELLIGENCE INC.
Reel/Frame 062760/0832 →
RELEASE OF SECURITY INTEREST Recorded Jun 21, 2022
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: DIGITALGLOBE, INC.; SPACE SYSTEMS/LORAL, LLC; RADIANT GEOSPATIAL SOLUTIONS LLC
Reel/Frame 060390/0282 →
SECURITY AGREEMENT Recorded Jun 17, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 060389/0782 →
SECURITY AGREEMENT Recorded Jun 16, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: ROYAL BANK OF CANADA
Reel/Frame 060389/0720 →
PATENT SECURITY AGREEMENT Recorded Sep 23, 2020
From: DIGITALGLOBE, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 053866/0412 →
SECURITY AGREEMENT (NOTES) Recorded Dec 12, 2019
From: DIGITALGLOBE, INC.; RADIANT GEOSPATIAL SOLUTIONS LLC; SPACE SYSTEMS/LORAL, LLC (F/K/A SPACE SYSTEMS/LORAL INC.)
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, - AS NOTES COLLATERAL AGENT
Reel/Frame 051262/0824 →
AMENDED AND RESTATED U.S. PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Dec 11, 2019
From: DIGITALGLOBE, INC.
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 051258/0465 →
RELEASE OF SECURITY INTEREST IN PATENTS FILED AT R/F 041069/0910 Recorded Oct 5, 2017
From: BARCLAYS BANK PLC
To: DIGITALGLOBE, INC.
Reel/Frame 044363/0524 →
SECURITY INTEREST Recorded Oct 5, 2017
From: DIGITALGLOBE, INC.; MACDONALD, DETTWILER AND ASSOCIATES LTD.; MACDONALD, DETTWILER AND ASSOCIATES CORPORATION; MACDONALD, DETTWILER AND ASSOCIATES INC.; MDA GEOSPATIAL SERVICES INC.; SPACE SYSTEMS/LORAL, LLC; MDA INFORMATION SYSTEMS LLC
To: ROYAL BANK OF CANADA, AS THE COLLATERAL AGENT
Reel/Frame 044167/0396 →
SECURITY INTEREST Recorded Jan 23, 2017
From: DIGITALGLOBE, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 041069/0910 →
MERGER Recorded Jan 5, 2017
From: GEOEYE SOLUTIONS INC.
To: GEOEYE SOLUTIONS HOLDCO INC.
Reel/Frame 040866/0490 →
MERGER Recorded Jan 5, 2017
From: GEOEYE SOLUTIONS HOLDCO INC.
To: DIGITALGLOBE, INC.
Reel/Frame 040866/0571 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (029734/0427) Recorded Dec 22, 2016
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: DIGITALGLOBE INC.; GEOEYE ANALYTICS INC.; GEOEYE, LLC; GEOEYE SOLUTIONS INC.
Reel/Frame 041176/0066 →
PATENT SECURITY AGREEMENT Recorded Feb 1, 2013
From: DIGITALGLOBE, INC.; GEOEYE ANALYTICS INC.; GEOEYE, LLC; GEOEYE SOLUTIONS INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 029734/0427 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 31, 2013
From: WILMINGTON TRUST, NATIONAL ASSOCIATION (AS SUCCESSOR BY MERGER TO WILMINGTON TRUST FSB)
To: GEOEYE SOLUTIONS INC. (F/K/A ORBIMAGE SI OPCO INC.)
Reel/Frame 029733/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 31, 2013
From: THE BANK OF NEW YORK MELLON
To: GEOEYE SOLUTIONS INC. (F/K/A ORBIMAGE SI OPCO INC.)
Reel/Frame 029733/0035 →
SECURITY AGREEMENT Recorded Nov 16, 2010
From: GEOEYE SOLUTIONS INC.
To: WILMINGTON TRUST FSB
Reel/Frame 025366/0129 →
CHANGE OF NAME Recorded Oct 6, 2010
From: ORBIMAGE SI OPCO, INC.
To: GEOEYE SOLUTIONS INC.
Reel/Frame 025095/0683 →
SECURITY AGREEMENT Recorded Oct 12, 2009
From: ORBIMAGE SI OPCO INC.
To: THE BANK OF NEW YORK MELLON
Reel/Frame 023355/0356 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2007
From: SCHROEDER, STEPHEN R.
To: SPACE IMAGING LLC
Reel/Frame 019680/0539 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2007
From: SPACE IMAGING LLC
To: ORBIMAGE SI OPCO, INC.
Reel/Frame 019680/0599 →