IP Library Granted Patent US 8,824,828
Granted Patent B1
US 8,824,828 · App. 13/432,439 · Granted Sep 2, 2014

Thermal V-curve for fusion image declutter

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,824,828
App. No.
13/432,439
Granted
Sep 2, 2014
Kind
B1
Abstract

A method of fusing two images includes adjusting contrast of (a) a visual image and (b) a thermal image. Also included is modifying the adjusted contrast of the thermal image to form output brightness levels, by using a transformation curve, and then displaying both (a) the brightness levels of the thermal image and (b) the adjusted contrast of the visual image. Modifying the adjusted contrast of the thermal image includes using a V-curve as the transformation curve, in which the V-curve includes similar maximum output brightness levels at the coldest and hottest relative temperatures, respectively. The V-curve also includes a minimum output brightness level at a midpoint between the coldest and hottest relative temperatures. Furthermore, the method assigns different hues to the intensity values of the thermal image, ranging from coldest to hottest relative temperatures.

Claims (69)

1. A method of fusing two images comprising:

receiving intensity values of (a) a visual image and (b) a thermal image;

adjusting contrast of the intensity values of (a) the visual image and (b) the thermal image;

modifying, using a transformation curve, the adjusted contrast of the thermal image to form output brightness levels; and

displaying both (a) the brightness levels of the thermal image and (b) the adjusted contrast of the visual image;

wherein

modifying the adjusted contrast of the thermal image includes using a transformation curve,

in which the transformation curve includes substantially similar maximum output brightness levels at coldest and hottest intensity values, respectively, and

the transformation curve includes a minimum output brightness level at a near midpoint between the coldest and hottest intensity values.

2. The method of claim 1 including the step of:

assigning different hues, based on a hue-color wheel, to the intensity values of the thermal image, ranging from coldest to hottest relative temperatures.

3. The method of claim 2 wherein

the coldest relative temperature is assigned a color of blue at 240 degrees of the hue-color wheel, and

the hottest relative temperature is assigned a color of red at 0 degrees of the hue-color wheel.

4. The method of claim 2 wherein

the coldest relative temperature is modified by the transformation curve to provide a maximum brightness level, and

the hottest relative temperature is modified by the transformation curve to provide a maximum brightness level.

5. The method of claim 2 wherein

ambient temperature is assigned a color of green at 120 degrees of the hue-color wheel.

6. The method of claim 1 wherein

the step of displaying includes digitally fusing both (a) the brightness levels of the thermal image and (b) the adjusted contrast of the visual image, and

subsequently displaying both.

7. The method of claim 1 wherein

modifying the adjusted contrast of the thermal image includes using a V-curve or the parabolic-curve as the transformation curve,

in which the V-curve or the parabolic-curve includes substantially similar maximum output brightness levels at coldest and hottest intensity values, respectively, and

the V-curve or the parabolic-curve includes a minimum output brightness level at a near midpoint between the coldest and hottest intensity values.

8. The method of claim 1 wherein

modifying the adjusted contrast of the thermal image includes using a log-curve as the transformation curve,

in which the log-curve includes substantially similar maximum output brightness levels at coldest and hottest intensity values, respectively, and

the log-curve includes a minimum output brightness level at a near midpoint between the coldest and hottest intensity values.

9. The method of claim 1 wherein

modifying the adjusted contrast of the thermal image includes using an S-curve as the transformation curve,

in which the S-curve includes substantially similar maximum output brightness levels at coldest and hottest intensity values, respectively, and

the S-curve includes a minimum output brightness level at a near midpoint between the coldest and hottest intensity values.

10. A system of fusing two images comprising:

a thermal imager for providing a thermal image,

a visual imager for providing a visual image,

a first contrast module for adjusting the thermal image to provide a contrast enhanced thermal image,

a second contrast module for adjusting the visual image to provide a contrast enhanced visual image,

a transformation module for adjusting the contrast enhanced thermal image to provide a transformed thermal image, and

a fusion module for combining the contrast enhanced visual image and the transformed thermal image,

wherein

the transformation module is configured to adjust the contrast enhanced thermal image using a transformation curve, the transformation curve defined by two upper points and a lower point,

in which the two upper points correspond to substantially similar maximum output brightness levels at coldest and hottest intensity input values, respectively, and

the lower point corresponds to a minimum output brightness level at a midpoint between the coldest and hottest intensity input values.

11. The system of claim 10 including

a display for viewing the combined contrast enhanced visual image and transformed thermal image.

12. The system of claim 10 wherein

the visual imager includes a night vision camera, and

the thermal imager includes an infrared (IR) camera.

13. The system of claim 10 wherein

the transformation curve includes one of a V-curve, an S-curve, a parabolic-curve, or a log-curve, each curve defined by two upper points and a lower point, in which the lower point is positioned between the two upper points.

14. The system of claim 10 including

a hue-color module for assigning different output hues, based on a hue-color wheel, to the thermal image, varying from coldest to hottest relative input temperatures.

15. The system of claim 14 wherein

the coldest relative input temperature is assigned an output color of blue at 240 degrees of the hue-color wheel, and

the hottest relative input temperature is assigned an output color of red at 0 degrees of the hue-color wheel, and

ambient input temperature is assigned an output color of green at 120 degrees of the hue-color wheel.

16. A processor for executing the following steps:

receiving intensity values of (a) a visual image and (b) a thermal image;

adjusting contrast of the intensity values of (a) the visual image and (b) the thermal image;

modifying, using a transformation curve, the adjusted contrast of the thermal image to form output brightness levels; and

providing for display both (a) the brightness levels of the thermal image and (b) the adjusted contrast of the visual image

wherein

modifying the adjusted contrast of the thermal image includes using a V-curve as the transformation curve,

in which the V-curve includes substantially similar maximum output brightness levels at coldest and hottest intensity values, respectively, and

the V-curve includes a minimum output brightness level at a near midpoint between the coldest and hottest intensity values.

17. The processor of claim 16 including the step of:

assigning different hues, based on a hue-color wheel, to the intensity values of the thermal image, ranging from coldest to hottest relative temperatures.

Assignments (6)
SECURITY INTEREST Recorded Feb 21, 2024
From: ELBIT SYSTEMS OF AMERICA, LLC; SPARTON CORPORATION; SPARTON DELEON SPRINGS, LLC; LOGOS TECHNOLOGIES LLC; ELBITAMERICA, INC.; KMC SYSTEMS, INC.
To: CAPITAL ONE, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 066642/0935 →
RELEASE OF SECURITY INTEREST Recorded Feb 21, 2024
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: ELBIT SYSTEMS OF AMERICA, LLC
Reel/Frame 066644/0612 →
CHANGE OF NAME Recorded Sep 17, 2019
From: HARRIS CORPORATION
To: L3HARRIS TECHNOLOGIES, INC.
Reel/Frame 050409/0288 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2019
From: L3HARRIS TECHNOLOGIES, INC.; EAGLE TECHNOLOGY, LLC
To: ELBIT SYSTEMS OF AMERICA, LLC
Reel/Frame 050375/0008 →
SECURITY INTEREST Recorded Sep 13, 2019
From: ELBIT SYSTEMS OF AMERICA, LLC
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 050375/0425 →
MERGER Recorded Jul 1, 2016
From: EXELIS INC.
To: HARRIS CORPORATION
Reel/Frame 039362/0534 →