IP Library Granted Patent US 9,396,528
Granted Patent B2
US 9,396,528 · App. 13/840,743 · Granted Jul 19, 2016

Atmospheric compensation in satellite imagery

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,396,528
App. No.
13/840,743
Granted
Jul 19, 2016
Kind
B2
Abstract

Techniques for atmospheric compensation in satellite imagery that include converting an image including an array of radiance values to an array of surface reflectance values. The conversion is performed in an automated fashion by identifying one or more portions of the image for which the surface reflectance can be estimated and determining the Aerosol Optical Depth (AOD) by iteratively comparing the radiance value captured by the image sensor to a calculated radiance value (based on the known surface reflectance, historical values for other atmospheric parameters, and the AOD) and adjusting the AOD until the calculated radiance value is substantially the same as the captured radiance value.

Claims (74)

1. A method of compensating for atmospheric events in satellite images, comprising:

receiving image data representing an image of at least a portion of the Earth based on the radiance received by a sensor on the satellite, wherein the image data is pixelated and each pixel represents light directed along a path from a target region on the Earth to the sensor, with other portions on the Earth being non-target regions;

receiving Earth coordinate data related to the image data for the image;

receiving temporal data related to the image data for the image;

retrieving one or more atmospheric characteristics from a database, the retrieving being based on the earth coordinate data and the temporal data;

processing the image data for the image to determine Aerosol Optical Depth for the image, without using image data from another image; and

converting the image from radiance to surface reflectance by using the determined Aerosol Optical Depth, including correcting for light that has been scattered at least a first time by the atmosphere onto one of the non-target regions and then reflected by the one of the non-target regions and then scattered at least a second time by the atmosphere onto the path to the sensor (C 2 );

wherein the processing operation includes:

assuming an Aerosol Optical Depth for at least a portion of the image;

deriving a surface reflectance of the portion of the image from the Aerosol Optical Depth, the retrieved atmospheric characteristics, and the radiance received;

calculating an expected radiance for at least the portion of the image based on the derived surface reflectance, the assumed Aerosol Optical Depth, and the retrieved atmospheric characteristics;

comparing the expected radiance to the actual radiance received for at least the portion of the received image; and

adjusting the Aerosol Optical Depth in a direction to bring the expected radiance closer to the actual radiance received;

wherein the calculating, comparing, and adjusting operations are performed iteratively until the comparison shows the expected radiance to be within a predetermined threshold of the actual radiance received;

wherein the image is used to derive both a radiance received for a target region of the image and a radiance received for a background region of the image;

wherein the radiance received for the background region is derived by using a convolution filter for the region of the image proximate to the target region, in order to account for adjacency effects including light scattered by a plurality of different types of scattering pathways.

2. A method as defined in claim 1 , wherein the one or more atmospheric characteristics include water vapor, temperature, elevation, and aerosol type.

3. A method as defined in claim 1 , wherein the deriving the surface reflectance includes deriving the surface reflectance for each of a target portion of the portion and a background portion of the portion.

4. A method as defined in claim 1 , wherein the radiance received for the background region is derived by taking an average radiance for the region surrounding the target.

5. A method as defined in claim 1 , wherein the entire method is performed automatically, without human intervention.

6. A method as defined in claim 1 , wherein the image data used to determine the Aerosol Optical Depth is purely panchromatic image data.

7. A method as defined in claim 1 , wherein the image data used to determine the Aerosol Optical Depth includes multispectral image data.

8. A method as defined in claim 1 , wherein the at least a portion of the image includes a plurality of non-contiguous pixels.

9. A method as defined in claim 1 , wherein the convolution filter includes different types of scattering effects, including forward-scattered light that then impinges upon the target and is received as part of the image data and light that reflects from the target that is then forward scattered in a direction to be received as part of the image data.

10. A method as defined in claim 1 , wherein the image data is very high spatial resolution image data.

11. A method as defined in claim 1 , wherein the converting further includes correcting for light that has been scattered by the atmosphere onto the path to the sensor without ever having reached the Earth (A), light that is scattered by the atmosphere onto the target region and reflected onto the path to the sensor (B 2 ), and light that has been reflected by one of the non-target regions and then scattered by the atmosphere onto the path to the sensor (C 1 ).

12. A method of compensating for atmospheric events in satellite images, comprising:

receiving image data representing an image of at least a portion of the Earth based on the radiance received by a sensor on the satellite, wherein the image data is pixelated and each pixel represents light directed along a path from a target region on the Earth to the sensor, with other portions on the Earth being non-target regions;

receiving Earth coordinate data related to the image data for the image;

receiving temporal data related to the image data for the image;

retrieving one or more atmospheric characteristics from a database, the retrieving being based on the earth coordinate data and the temporal data;

processing the image data for the image to determine Aerosol Optical Depth for the image, without using image data from another image; and

converting the image from radiance to surface reflectance by using the determined Aerosol Optical Depth, including correcting for light that has been scattered at least a first time by the atmosphere onto one of the non-target regions and then reflected by the one of the non-target regions and then scattered at least a second time by the atmosphere onto the path to the sensor (C 2 );

wherein the processing operation includes:

assuming an Aerosol Optical Depth for at least a portion of the image;

deriving a surface reflectance of the portion of the image from the Aerosol Optical Depth, the retrieved atmospheric characteristics, and the radiance received;

calculating an expected radiance for at least the portion of the image based on the derived surface reflectance, the assumed Aerosol Optical Depth, and the retrieved atmospheric characteristics;

comparing the expected radiance to the actual radiance received for at least the portion of the received image; and

adjusting the Aerosol Optical Depth in a direction to bring the expected radiance closer to the actual radiance received;

wherein the calculating, comparing, and adjusting operations are performed iteratively until the comparison shows the expected radiance to be within a predetermined threshold of the actual radiance received;

wherein the image is used to derive both a radiance received for a target region of the image and a radiance received for a background region of the image;

wherein the radiance received for the background region is derived by using a gamma-based filter based on the retrieved atmospheric characteristics and the wavelength of the radiance received.

13. A method as defined in claim 12 , wherein the image data used to determine the Aerosol Optical Depth is purely panchromatic image data.

14. A method as defined in claim 12 , wherein the at least a portion of the image includes a plurality of non-contiguous pixels.

15. A method as defined in claim 12 , wherein the converting further includes correcting for light that has been scattered by the atmosphere onto the path to the sensor without ever having reached the Earth (A), light that is scattered by the atmosphere onto the target region and reflected onto the path to the sensor (B 2 ), and light that has been reflected by one of the non-target regions and then scattered by the atmosphere onto the path to the sensor (C 1 ).

16. A method for determining an Aerosol Optical Depth in the atmosphere relative to a satellite or aerial image of the Earth, comprising:

receiving a pixelated image having radiance values for each pixel in the image, the pixelated image having been captured by a sensor having a plurality of pixelated sensor elements in spaced apart relationship from each other;

retrieving values for certain atmospheric parameters, including an initial estimate of an Aerosol Optical Depth atmospheric parameter;

determining a portion of the image for which an estimate of the surface reflectance can be made, the portion of the image being a plurality of pixels in the image, at least some of which pixels are spatially non-contiguous with each other;

estimating the surface reflectance of the portion of the image;

based on the estimated surface reflectance of the portion of the image and the certain atmospheric parameters, calculating the expected radiance for the portion of the image;

comparing the radiance from the received image for the portion of the image to the expected radiance for the portion of the image; and

adjusting the Aerosol Optical Depth atmospheric parameter if the comparison reveals a difference greater than a threshold value;

wherein the calculating, comparing, and adjusting operations are repeated as necessary until the comparison reveals a difference within the threshold value.

17. A method as defined in claim 16 , wherein the portion of the image for which an estimate of surface reflectance can be made is a dark object.

18. A method as defined in claim 17 , wherein the estimate of surface reflectance for the dark object is based on the radiance value for the dark object, the radiance value for other portions of the image, and the certain atmospheric parameters.

19. A method as defined in claim 16 , wherein the portion of the image for which an estimate of surface reflectance can be made is an object that varies in a known fashion throughout the year.

20. A method as defined in claim 19 , wherein a determination is made as to which of a plurality of object classes the object belongs to.

21. A method as defined in claim 20 , wherein the plurality of object classes include forests, crops, and man-made surfaces.

22. A method as defined in claim 20 , wherein typical surface reflectance values throughout the year are known for each of the object classes.

23. A method as defined in claim 16 , wherein the Aerosol Optical Depth and the retrieved atmospheric parameters are used to convert the image from an array of radiance values to an array of surface reflectance values.

24. A method as defined in claim 16 , wherein the image data used for determining the Aerosol Optical Depth is purely panchromatic image data.

25. A method as defined in claim 16 , wherein the image data used for determining the Aerosol Optical Depth includes multispectral image data.

26. A method as defined in claim 16 , wherein the image includes a plurality of dark objects and the Aerosol Optical Depth is determined independently for each dark object, with kriging used for determining the Aerosol Optical Depth between the dark objects.

27. A method as defined in claim 16 , wherein the image data is very high spatial resolution image data.

28. A method for determining an Aerosol Optical Depth in the atmosphere relative to a satellite or aerial image of the Earth, comprising:

receiving a pixelated image having radiance values for each pixel in the image;

retrieving values for certain atmospheric parameters, including an initial estimate of an Aerosol Optical Depth atmospheric parameter;

determining a portion of the image for which a non-zero estimate of the surface reflectance can be made;

estimating the surface reflectance of the portion of the image, using the Aerosol Optical Depth initial estimate, using the radiance values, and using a transfer function that includes a plurality of different types of scattering effects;

based on the non-zero estimated surface reflectance of the portion of the image and the certain atmospheric parameters, calculating the expected radiance for the portion of the image;

comparing the radiance from the received image for the portion of the image to the expected radiance for the portion of the image; and

adjusting the Aerosol Optical Depth atmospheric parameter if the comparison reveals a difference greater than a threshold value;

wherein the calculating, comparing, and adjusting operations are repeated as necessary until the comparison reveals a difference within the threshold value.

Assignments (21)
RELEASE OF SECURITY INTEREST Recorded Mar 3, 2026
From: SIXTH STREET LENDING PARTNERS, ACTING IN ITS CAPACITY AS AGENT
To: AURORA INSIGHT INC.; VANTOR INC. (F/K/A MAXAR INTELLIGENCE INC.); VANTOR SERVICES INC. (F/K/A MAXAR MISSION SOLUTIONS INC.); LANTERIS SPACE LLC (F/K/A MAXAR SPACE LLC); SPATIAL ENERGY, LLC; LANTERIS SPACE ROBOTICS LLC (F/K/A MAXAR SPACE ROBOTICS LLC); VANTOR HOLDINGS INC. (F/K/A MAXAR TECHNOLOGIES HOLDINGS INC.)
Reel/Frame 075021/0624 →
CERTIFICATE OF AMENDMENT Recorded Jan 7, 2026
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 074270/0330 →
CHANGE OF NAME Recorded Nov 4, 2025
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 073458/0728 →
RELEASE (REEL 060389/FRAME 0720) Recorded May 12, 2023
From: ROYAL BANK OF CANADA
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063633/0431 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 5, 2023
From: MAXAR INTELLIGENCE INC. (F/K/A DIGITALGLOBE, INC.); AURORA INSIGHT INC.; MAXAR MISSION SOLUTIONS INC. ((F/K/A RADIANT MISSION SOLUTIONS INC. (F/K/A THE RADIANT GROUP, INC.)); MAXAR SPACE LLC (F/K/A SPACE SYSTEMS/LORAL, LLC); SPATIAL ENERGY, LLC; MAXAR SPACE ROBOTICS LLC ((F/K/A SSL ROBOTICS LLC) (F/K/A MDA US SYSTEMS LLC)); MAXAR TECHNOLOGIES HOLDINGS INC.
To: SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT
Reel/Frame 063660/0138 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 044167/0396 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063543/0001 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 053866/0412 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0011 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 060389/0782 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0074 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 051258/0465 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063542/0300 →
CHANGE OF NAME Recorded Feb 15, 2023
From: DIGITALGLOBE, INC.
To: MAXAR INTELLIGENCE INC.
Reel/Frame 062760/0832 →
RELEASE OF SECURITY INTEREST Recorded Jun 21, 2022
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: DIGITALGLOBE, INC.; SPACE SYSTEMS/LORAL, LLC; RADIANT GEOSPATIAL SOLUTIONS LLC
Reel/Frame 060390/0282 →
SECURITY AGREEMENT Recorded Jun 17, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 060389/0782 →
SECURITY AGREEMENT Recorded Jun 16, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: ROYAL BANK OF CANADA
Reel/Frame 060389/0720 →
PATENT SECURITY AGREEMENT Recorded Sep 23, 2020
From: DIGITALGLOBE, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 053866/0412 →
SECURITY AGREEMENT (NOTES) Recorded Dec 12, 2019
From: DIGITALGLOBE, INC.; RADIANT GEOSPATIAL SOLUTIONS LLC; SPACE SYSTEMS/LORAL, LLC (F/K/A SPACE SYSTEMS/LORAL INC.)
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, - AS NOTES COLLATERAL AGENT
Reel/Frame 051262/0824 →
AMENDED AND RESTATED U.S. PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Dec 11, 2019
From: DIGITALGLOBE, INC.
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 051258/0465 →
SECURITY INTEREST Recorded Oct 5, 2017
From: DIGITALGLOBE, INC.; MACDONALD, DETTWILER AND ASSOCIATES LTD.; MACDONALD, DETTWILER AND ASSOCIATES CORPORATION; MACDONALD, DETTWILER AND ASSOCIATES INC.; MDA GEOSPATIAL SERVICES INC.; SPACE SYSTEMS/LORAL, LLC; MDA INFORMATION SYSTEMS LLC
To: ROYAL BANK OF CANADA, AS THE COLLATERAL AGENT
Reel/Frame 044167/0396 →
RELEASE OF SECURITY INTEREST IN PATENTS FILED AT R/F 041069/0910 Recorded Oct 5, 2017
From: BARCLAYS BANK PLC
To: DIGITALGLOBE, INC.
Reel/Frame 044363/0524 →
SECURITY INTEREST Recorded Jan 23, 2017
From: DIGITALGLOBE, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 041069/0910 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 030933 FRAME: 0747. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 5, 2014
From: PACIFICI, FABIO
To: DIGITALGLOBE, INC.
Reel/Frame 033096/0548 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2013
From: PACIFICI, FABIO
To: DIGITAL GLOBE, INC.
Reel/Frame 030933/0747 →