IP Library › Granted Patent US 11,461,994
Granted Patent B2
US 11,461,994 · App. 15/621,490 · Granted Oct 4, 2022

Methods for in-scene shadow compensation using sunlit and skylit illumination factors

Inventors: Jean-Pierre Ardouin (Sainte-Catherine-de-la-Jacques-Cartier, CA); Vincent Ross (L'Ancienne-Lorette, CA)
Assignee: Her Majesty the Queen in Right of Canada, as represented by the Minister of National Defence
G06V10/40G06T5/007G06V20/13G06T2207/10036G06T2207/30188G06T2207/30192G06V10/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,461,994
App. No.
15/621,490
Granted
Oct 4, 2022
Kind
B2
Abstract

Methods are provided for automatically performing atmospheric compensation of a multi or hyper spectral image. One method comprises transforming at least two endmembers extracted from an image into at-ground reflectance. The transformation may be approximate and/or only in certain spectral bands in order to reduce processing time. A matching component is then located in a spectral library for each of the at least two extracted endmembers. Gain and offset values are then calculated using the at least two matched extracted endmember and spectral library component pairs. At least part of the image is then compensated using the calculated gain and offset values. Another method uses at least one endmember extracted from the image and a black level. Methods for atmospheric compensation using water vapor content of pixels are also provided. In addition, methods for shadow correction of hyper and multi spectral images are provided.

Claims (100)

1. A method for use in shadow compensation of a multi or hyper spectral image, the method comprising:

(a) identifying a brightest pixel in the image in term of its norm and assuming the pixel is fully lit by both the sun and the sky;

(b) determining a direct flux and a diffuse flux of the pixel;

(c) determining a sunlit only surface signature and a skylit only surface signature of the pixel using the direct and diffuse fluxes;

(d) for each pixel of the image, determining an abundance of the sunlit surface signature and an abundance of the skylit surface signature, and removing the sunlit surface and skylit surface signatures from pixels of the image;

(e) repeating (a) through (d) a predetermined number of times or until the norm of the pixel last identified in (a) is below a predetermined threshold value, where the pixel identified in (a) in the next iteration is the next brightest pixel in the image after the previous iteration sunlit and skylit only surface signatures have been removed; and

(f) compensating at least some selected pixels of the image, where a given pixel from the selected pixels is compensated using the direct and diffuse fluxes of the given pixel as well as a sun illumination factor and a sky illumination factor of the given pixel, the sun illumination factor being the sum of the abundances of the sunlit surface signatures and the sky illumination factor being a sum of the abundances of the skylit surface signatures of all pixels selected in the iterative process for the given pixel.

2. The method of claim 1 , wherein the compensating of a given pixel in (f) involves multiplying the given pixel by a value proportional to:

(

I

dif

+

I

diff

f

sun

⁢

I

dir

+

f

sky

⁢

I

diff

)

where I dir is the direct flux, I diff is the diffuse flux, f sun is the solar illumination factor and f sky is the sky illumination factor of the given pixel.

3. The method of claim 1 , wherein the determining of the skylit only surface signature involves multiplying a fully lit pixel signature, ρ, by a value proportional to:

(

I

diff

I

dir

+

I

diff

)

where I dir is the direct flux and I diff is the diffuse flux, and wherein the determining of the sunlit only surface signature involves multiplying the fully lit pixel signature, ρ, by a value proportional to:

(

1

-

I

diff

I

dir

+

I

diff

)

.

4. A non-transitory computer-readable storage medium comprising instructions for execution on one or more electronic devices, the instructions for a method for use in shadow compensation of a multi or hyper spectral image, the method comprising:

(a) identifying a brightest pixel in the image in term of its norm and assuming the pixel is fully lit by both the sun and the sky;

(b) determining a direct flux and a diffuse flux of the pixel;

(c) determining a sunlit only surface signature and a skylit only surface signature of the pixel using the direct and diffuse fluxes;

(d) for each pixel of the image, determining an abundance of the sunlit surface signature and an abundance of the skylit surface signature, and removing the sunlit surface and skylit surface signatures from pixels of the image;

(e) repeating (a) through (d) a predetermined number of times or until the norm of the pixel last identified in (a) is below a predetermined threshold value, where the pixel identified in (a) in the next iteration is the next brightest pixel in the image after the previous iteration sunlit and skylit only surface signatures have been removed; and

(f) compensating at least some selected pixels of the image, where a given pixel from the selected pixels is compensated using the direct and diffuse fluxes of the given pixel as well as a sun illumination factor and a sky illumination factor of the given pixel, the sun illumination factor being the sum of the abundances of the sunlit surface signatures and the sky illumination factor being a sum of the abundances of the skylit surface signatures of all pixels selected in the iterative process for the given pixel.

5. The non-transitory computer readable medium of claim 4 , wherein the compensating of a given pixel in (f) involves multiplying the given pixel by a value proportional to:

(

I

dir

+

I

diff

f

sun

⁢

I

dir

+

f

sky

⁢

I

diff

)

where I dir is the direct flux, I diff is the diffuse flux, f sun is the solar illumination factor and f sky is the sky illumination factor of the given pixel.

6. The non-transitory computer readable medium of claim 4 , wherein the determining of the skylit only surface signature involves multiplying a fully lit pixel signature, ρ, by a value proportional to:

(

I

diff

I

dir

+

I

diff

)

where I dir is the direct flux and I diff is the diffuse flux, and wherein the determining of the sunlit only surface signature involves multiplying the fully lit pixel signature, ρ, by a value proportional to:

(

1

-

I

diff

I

dir

+

I

diff

)

.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2017
From: ARDOUIN, JEAN-PIERRE
To: HER MAJESTY THE QUEEN IN RIGHT OF CANADA, AS REPRESENTED BY THE MINISTER OF NATIONAL DEFENCE
Reel/Frame 042694/0897 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2017
From: ROSS, VINCENT
To: AEREX AVIONIQUE INC.
Reel/Frame 042694/0925 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2017
From: AEREX AVIONIQUE, INC.
To: HER MAJESTY THE QUEEN IN RIGHT OF CANADA, AS REPRESENTED BY THE MINISTER OF NATIONAL DEFENCE
Reel/Frame 042694/0993 →
Continuity (3)
Division 15051223 · Feb 23, 2016
Division 14103235 · Dec 11, 2013
Related Publication 20170277969A1 · Sep 28, 2017