IP Library Granted Patent US 12,136,246
Granted Patent B2
US 12,136,246 · App. 17/962,019 · Granted Nov 5, 2024

Multispectral imaging for thermal and electrical detection systems and methods

Inventors: Austin A. Richards (Santa Barbara, CA); Nicholas Hogasten (Santa Barbara, CA); Selah Argent (Santa Barbara, CA)
Assignee: Teledyne FLIR Commercial Systems, Inc.
G06V10/147G06T7/0002G06T7/73G08B17/125G06T2207/10036G06T2207/10048G06T2207/20081G06T2207/20084G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,136,246
App. No.
17/962,019
Granted
Nov 5, 2024
Kind
B2
Abstract

Multispectral imaging and related techniques are provided to detect thermal and non-thermal anomalies at reduced false detection rates. A multispectral imaging system includes an infrared light imaging sensor that captures infrared image data in a first spectral band, of a scene and an ultraviolet light imaging sensor that captures ultraviolet image data in a second spectral band, of the scene. The system also includes a processor that combines the ultraviolet image data and the infrared image data to generate composite image data, determines a ratio of a first radiant intensity in the first spectral band to a second radiant intensity in the second spectral band, from the composite image data, and determines whether the ratio corresponds to a predetermined radiant intensity ratio of a known thermal or electrical anomaly. The processor can detect the thermal or electrical anomaly when the determined ratio corresponds to the predetermined radiant intensity ratio.

Claims (73)

1. A system comprising:

a multispectral imaging system, wherein the multispectral imaging system comprises an infrared imaging module configured to provide infrared image data associated with a first spectral band and an ultraviolet imaging module configured to provide ultraviolet image data associated with a second spectral band, of at least a portion of a scene; and

a logic device configured to communicate with the multispectral imaging system, wherein the logic device is configured to:

determine a ratio of a first radiant intensity in the first spectral band to a second radiant intensity in the second spectral band, from the infrared image data and the ultraviolet image data;

determine whether the ratio corresponds to a predetermined radiant intensity ratio of a thermal or electrical anomaly; and

detect at least one of the thermal or electrical anomaly associated with the scene when the ratio corresponds to the predetermined radiant intensity ratio of the thermal or electrical anomaly.

2. The system of claim 1 , wherein the logic device is further configured to generate an alert notification in response to an occurrence of a first condition associated with the infrared imaging module and a second condition associated with the ultraviolet imaging module;

wherein the first condition comprises detection of a source associated with the first spectral band in a field of view of the infrared imaging module that has a temperature associated with an intensity value of a pixel of the infrared image data that exceeds a preset threshold value; and

wherein the second condition comprises detection of a source associated with the second spectral band in a field of view of the ultraviolet imaging module that has shortwave ultraviolet radiation associated with an intensity value of a pixel of the ultraviolet image data that exceeds a preset radiant intensity threshold value.

3. The system of claim 1 , wherein the logic device is further configured to:

detect a first object corresponding to a hot spot associated with the infrared image data;

detect a second object corresponding to a bright spot associated with the ultraviolet image data;

combine the ultraviolet image data and the infrared image data to generate composite image data;

determine whether the first object is spatially corresponding to the second object in the composite image data; and

compare the ratio to a plurality of predetermined radiant intensity ratios when the first object is spatially corresponding to the second object.

4. The system of claim 1 , wherein the ultraviolet imaging module comprises:

a solar-blind shortwave ultraviolet light imaging sensor; and

an ultraviolet light transmissive lens arranged laterally along an optical axis from the solar-blind shortwave ultraviolet light imaging sensor by a predetermined focal length distance.

5. The system of claim 4 , wherein the solar-blind shortwave ultraviolet light imaging sensor comprises:

a gas-filled tube;

an anode; and

a photocathode,

wherein the photocathode is arranged at near physical proximity from the anode within the gas-filled tube.

6. The system of claim 4 , further comprising:

an ultraviolet bandpass filter interposed between the ultraviolet light transmissive lens and the solar-blind shortwave ultraviolet light imaging sensor, wherein the ultraviolet bandpass filter is configured to block light having wavelengths longer than about 260 nanometers and to pass light having wavelengths shorter than about 260 nanometers.

7. The system of claim 4 , further comprising:

a pulsed shortwave ultraviolet light source configured to radiate a pulse of radiation onto the ultraviolet light transmissive lens, wherein at least a portion of the pulse of radiation is reflected from a surface of the ultraviolet light transmissive lens to the solar-blind shortwave ultraviolet light imaging sensor for detecting an oily film contamination on the surface of the ultraviolet light transmissive lens; and

a light shield interposed between the pulsed shortwave ultraviolet light source and the solar-blind shortwave ultraviolet light imaging sensor for isolating the solar-blind shortwave ultraviolet light imaging sensor from the pulse of radiation.

8. The system of claim 1 , wherein the ultraviolet imaging module has a boresight that substantially corresponds to an optical axis of the infrared imaging module and/or wherein the ultraviolet imaging module comprises one or more optical elements having a field-of-view (FOV) that corresponds to that of the infrared imaging module.

9. The system of claim 1 , wherein the ultraviolet imaging module further comprises:

an environmental housing with a shortwave ultraviolet transmissive window; and

a motorized steering mirror arranged within the environmental housing, wherein the motorized steering mirror is configured to rotate continuously at a predetermined rate for scanning the at least the portion of the scene through the shortwave ultraviolet transmissive window for shortwave ultraviolet sources or rotate in response to detection of a shortwave ultraviolet source within the at least the portion of the scene.

10. The system of claim 1 , further comprising:

a fiber-couple shortwave infrared spectrometer configured to sample a spectrum of a thermal anomaly in a plurality of equidistant spaced spectral channels,

wherein the logic device is further configured to:

perform a comparison of the spectrum of the thermal anomaly to a library of known thermal anomaly spectra using one or more trained neural networks,

identify a composition of the thermal anomaly from the comparison; and

cause deployment of a type of retardant agent through an action of a mobile platform based at least on the composition of the thermal anomaly, wherein the mobile platform is a ground-based robotic vehicle or an unmanned aerial vehicle.

11. The system of claim 1 , further comprising:

a memory configured to store the ultraviolet image data and the infrared image data,

wherein the logic device is in communication with the memory and are configured to receive the ultraviolet image data and the infrared image data from the memory, and wherein the logic device is further configured to:

extract identifying information of the at least the portion of the scene from at least one of the ultraviolet image data or the infrared image data, and

generate an overlay comprising the identifying information and visual enhancements that augment the at least one of the thermal or electrical anomaly within the at least the portion of the scene, and further comprising a display, wherein the display is in communication with the logic device and configured to display the overlay over at least one of the ultraviolet image data or the infrared image data or composite image data.

12. The system of claim 1 , further comprising an unmanned vehicle coupled to the ultraviolet imaging module, the infrared imaging module and the logic device and configured to transport the imaging modules and the logic device to various portions of the scene.

13. A monitoring system, comprising:

a mobile platform; and

a camera coupled to the mobile platform and comprising:

a first imaging module comprising an infrared light imaging sensor configured to capture infrared image data associated with a first spectral band, of at least a portion of a scene;

a second imaging module comprising an ultraviolet light imaging sensor configured to capture ultraviolet image data associated with a second spectral band, of at least a corresponding portion of the scene;

a memory configured to store the ultraviolet image data and the infrared image data; and

a logic device in communication with the memory and configured to:

receive the ultraviolet image data and the infrared image data from the memory;

combine the ultraviolet image data and the infrared image data to generate composite image data;

determine a ratio of a first radiant intensity in the first spectral band to a second radiant intensity in the second spectral band, from the composite image data;

determine whether the ratio corresponds to a predetermined radiant intensity ratio of a thermal or electrical anomaly; and

detect at least one of the thermal or electrical anomaly associated with the scene when the ratio corresponds to the predetermined radiant intensity ratio of the thermal or electrical anomaly,

wherein the mobile platform is configured to carry the camera between various portions of the scene.

14. The monitoring system of claim 13 , wherein the logic device is further configured to generate an alert notification in response to an occurrence of a first condition associated with the infrared light imaging sensor and a second condition associated with the ultraviolet light imaging sensor, wherein the first condition comprises detection of a first source associated with the first spectral band in a field of view of the infrared light imaging sensor that has a temperature associated with an intensity value of a pixel of the composite image data that exceeds a preset threshold value, and wherein the second condition comprises detection of a second source associated with the second spectral band in a field of view of the ultraviolet light imaging sensor that has shortwave ultraviolet radiation associated with the intensity value of the pixel of the composite image data that exceeds a preset radiant intensity threshold value.

15. A method, comprising:

receiving, by a logic device, multispectral image data from a multispectral imaging system;

determining, by the logic device, a spectrum-differentiated radiant intensity ratio based, at least in part, on the multispectral image data; and

identifying, by the logic device, at least a portion of an imaged scene corresponding to one or more of a thermal or electrical anomaly present within the image scene based, at least in part, on the spectrum-differentiated radiant intensity ratio.

16. The method of claim 15 , wherein receiving the multispectral image data from a multispectral imaging system comprises:

receiving, by the logic device, infrared image data associated with a first spectral band, of at least a portion of a scene, from an infrared light imaging sensor in the multispectral imaging system; and

receiving, by the logic device, ultraviolet image data associated with a second spectral band, of at least a corresponding portion of the scene from an ultraviolet light imaging sensor in the multispectral imaging system.

17. The method of claim 16 , further comprising:

combining, by the logic device, the ultraviolet image data and the infrared image data to generate composite image data.

18. The method of claim 17 , wherein the determining the spectrum-differentiated radiant intensity ratio comprises determining, by the logic device, a ratio of a first radiant intensity in the first spectral band to a second radiant intensity in the second spectral band, from the composite image data.

19. The method of claim 18 , wherein the identifying the at least the portion of the imaged scene corresponding to the one or more of the thermal or electrical anomaly present within the image scene comprises:

determining, by the logic device, whether the ratio corresponds to a predetermined radiant intensity ratio of the thermal or electrical anomaly; and

detecting, by the logic device, at least one of the thermal or electrical anomaly associated with the scene when the ratio corresponds to the predetermined radiant intensity ratio of the thermal or electrical anomaly.

20. The method of claim 19 , further comprising:

generating, by the logic device, an alert notification in response to the detecting of the at least one of the thermal or electrical anomaly.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2022
From: RICHARDS, AUSTIN A.; HOGASTEN, NICHOLAS; ARGENT, SELAH
To: FLIR COMMERCIAL SYSTEMS, INC.
Reel/Frame 061632/0826 →
CHANGE OF NAME Recorded Nov 2, 2022
From: FLIR COMMERCIAL SYSTEMS, INC.
To: TELEDYNE FLIR COMMERCIAL SYSTEMS, INC.
Reel/Frame 061633/0012 →
Continuity (3)
Continuation PCTUS2021026486 · Apr 8, 2021
Provisional Application 63007728 · Apr 9, 2020
Related Publication 20230040707A1 · Feb 9, 2023