IP Library Granted Patent US 11,029,211
Granted Patent B2
US 11,029,211 · App. 15/987,819 · Granted Jun 8, 2021

Unmanned aerial system based thermal imaging systems and methods

Inventors: Jeffrey D. Frank (Santa Barbara, CA); Theodore R. Hoelter (Santa Barbara, CA); Nicholas Högasten (Santa Barbara, CA); Austin A. Richards (Santa Barbara, CA); Michael Kent (Goleta, CA); Julie R. Moreira (Goleta, CA); Pierre Boulanger (Goleta, CA); Raymond Valdes (Walnut Park, CA); Jonathan Li (Goleta, CA)
Assignee: FLIR Systems, Inc.
G01J5/00B64C39/024G01J5/007G01J5/0265G01J5/06G01J5/061G03B15/006G06K9/0063G08G5/0091H02S50/00H02S50/15H04N5/2351H04N5/243H04N5/33H04N7/185B64C2201/123B64C2201/127B64C2201/141B64C2201/146G01J2005/0048G01J2005/0055G01J2005/0077G01J2005/068H02J4/00H04W84/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,029,211
App. No.
15/987,819
Granted
Jun 8, 2021
Kind
B2
Abstract

Flight based infrared imaging systems and related techniques, and in particular UAS based thermal imaging systems, are provided to improve the monitoring capabilities of such systems over conventional infrared monitoring systems. An infrared imaging system is configured to compensate for various environmental effects (e.g., position and/or strength of the sun, atmospheric effects) to provide high resolution and accuracy radiometric measurements of targets imaged by the infrared imaging system. An infrared imaging system is alternatively configured to monitor and determine environmental conditions, modify data received from infrared imaging systems and other systems, modify flight paths and other commands, and/or create a representation of the environment.

Claims (84)

1. A system comprising:

a flight platform;

an infrared imager coupled to the flight platform and configured to capture infrared images of a scene in view of the flight platform and output infrared data associated with the infrared images and/or the scene;

an environmental sensor configured to measure environmental data associated with the flight platform, the infrared imager, and/or the scene; and

a logic device configured to:

receive the infrared data from the infrared imager, wherein the infrared data is configured to measure an aspect of at least a portion of the scene,

receive the environmental data from the environmental sensor,

determine a range between a target in the scene and a source corresponding to the target, the range being a distance between the target and the source, the logic device being configured to determine the range regardless of whether or not the target is directly below the flight platform, and

correct the infrared data received from the infrared imager based, at least in part, on the environmental data and the range, to determine corrected infrared data, wherein the range is used to determine an amount of correction of the infrared data based on the environmental data.

2. The system of claim 1 , wherein the environmental sensor comprises at least one of a barometric pressure sensor, a visible irradiance data sensor, a temperature sensor, a humidity sensor, a thermopile, a nephelometer, an ozone sensor, a carbon monoxide sensor, a carbon dioxide sensor, a wind strength sensor, a wind speed sensor, a wind direction sensor, a visible spectrum imaging device, an anemometer and/or a high dynamic range (HDR) imaging device.

3. The system of claim 1 , wherein the logic device is further configured to:

detect a gas leak in the scene based, at least in part, on the environmental data from the environmental sensor.

4. A system comprising:

a flight platform;

an infrared imager coupled to the flight platform and configured to capture infrared images of a scene in view of the flight platform and output infrared data associated with the infrared images and/or the scene;

an environmental sensor configured to measure environmental data associated with the flight platform, the infrared imager, and/or the scene; and

a logic device configured to:

receive the infrared data from the infrared imager, wherein the infrared data is configured to measure an aspect of at least a portion of the scene,

receive the environmental data from the environmental sensor, and

determine corrected infrared data based, at least in part, on the infrared data and the environmental data;

wherein the logic device is further configured to:

determine a particulate count associated with the scene based, at least in part, on the environmental data from the environmental sensor, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined particulate count.

5. The system of claim 4 , wherein the logic device is further configured to:

determine a wind condition based, at least in part, on the environmental data from the environmental sensor, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined wind condition.

6. The system of claim 1 , wherein the environmental sensor comprises a visible spectrum imaging device and the logic device is further configured to:

receive visible spectrum data from the visible spectrum imaging device; and

determine a solar feature based, at least in part, on the visible spectrum data from the visible spectrum imaging device, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined solar feature.

7. The system of claim 1 , wherein the logic device is further configured to:

determine an environmental condition based, at least in part, on the environmental data from the environmental sensor; and

adjust a flight path of the flight platform responsive to the determined environmental condition.

8. The system of claim 1 , wherein the logic device is further configured to:

determine a solar position and/or a solar intensity, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined solar position and/or solar intensity.

9. The system of claim 1 , further comprising a blackbody coupled to the flight platform and viewable by the infrared imager, wherein the thermal imager is configured to output calibration data associated with a thermal image of the blackbody, and wherein the logic device is further configured to:

receive the calibration data; and

compare the calibration data to a known temperature of the blackbody, wherein the corrected infrared data is determined based, at least in part, on the infrared data, the calibration data, and/or the comparison.

10. The system of claim 1 , wherein the logic device is further configured to:

detect a blackbody and/or greybody within the scene;

receive known and/or estimated temperatures of the blackbody and/or the greybody;

determine measured temperatures of the blackbody and/or the greybody based, at least in part, on the received infrared data of the scene; and

compare the known and/or estimated temperatures to the measured temperatures, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the comparison.

11. The system of claim 1 , wherein the logic device is configured to:

receive an image of the target in the scene;

determine the source position corresponding to the received image;

determine an altitude corresponding to the source position;

determine a directional target vector to the imaged target; and

determine the range from the source position to the imaged target based, at least in part, on the source position, the altitude, and the directional target vector.

12. The system of claim 1 , further comprising a base station configured to communicate via one or more communications modules with the flight platform and/or the infrared imager, wherein the logic device is configured to:

determine a flight path for the flight platform to image the scene; and

modify the flight path based, at least in part, on the infrared data, the environmental data, and/or the corrected infrared data.

13. A method of using the system of claim 1 , the method comprising:

positioning the flight platform in view of the scene;

capturing at least one of the infrared images of the scene;

measuring the environmental data; and

transmitting the at least one of the infrared images, corresponding infrared data, the environmental data, and/or the corrected infrared data to a user interface.

14. A method comprising:

receiving infrared data from an infrared imager coupled to a flight platform, wherein the infrared imager is configured to capture infrared images of a scene in view of the flight platform and output infrared data associated with the infrared images and/or the scene, and wherein the infrared data is configured to measure an aspect of at least a portion of the scene;

receiving environmental data from an environmental sensor configured to measure environmental data associated with the flight platform, the infrared imager, and/or the scene;

determining a range between a target in the scene and a source corresponding to the target, using a process operable to determine the range regardless of whether or not the target is directly below the flight platform, the range being a distance between the target and the source, and

correcting the infrared data received from the infrared imager based, at least in part, on the environmental data and the range, to determine corrected infrared data, wherein the range is used to determine a radiance adjustment of the infrared data based on the environmental data.

15. The method of claim 14 , further comprising:

detecting a gas leak in the scene based, at least in part, on the environmental data from the environmental sensor.

16. A method comprising:

receiving infrared data from an infrared imager coupled to a flight platform, wherein the infrared imager is configured to capture infrared images of a scene in view of the flight platform and output infrared data associated with the infrared images and/or the scene, and wherein the infrared data is configured to measure an aspect of at least a portion of the scene;

receiving environmental data from an environmental sensor configured to measure environmental data associated with the flight platform, the infrared imager, and/or the scene; and

determining corrected infrared data based, at least in part, on the infrared data and the environmental data;

wherein the method further comprises:

determining a particulate count associated with the scene based, at least in part, on the environmental data from the environmental sensor, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined particulate count.

17. The method of claim 14 , further comprising:

determining a wind condition based, at least in part, on the environmental data from the environmental sensor, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined wind condition.

18. The method of claim 14 , further comprising:

receiving visible spectrum data from a visible spectrum imaging device; and

determining a solar feature based, at least in part, on the visible spectrum data from the visible spectrum imaging device, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined solar feature.

19. The method of claim 14 , further comprising:

determining an environmental condition based, at least in part, on the environmental data from the environmental sensor; and

adjusting a flight path of the flight platform responsive to the determined environmental condition.

20. The method of claim 14 , further comprising:

detecting a blackbody and/or greybody within the scene;

receiving known and/or estimated temperatures of the blackbody and/or the greybody;

determine measured temperatures of the blackbody and/or the greybody based, at least in part, on the received infrared data of the scene; and

comparing the known and/or estimated temperatures to the detected temperatures, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the comparison.

21. The system of claim 1 , wherein the logic device is further configured to:

determine a particulate count associated with the scene based, at least in part, on the environmental data from the environmental sensor, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined particulate count;

determine a wind condition based, at least in part, on the environmental data from the environmental sensor, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined wind condition;

adjust a flight path of the flight platform based on the wind condition determined based, at least in part, on the environmental data from the environmental sensor.

Assignments (2)
MERGER AND CHANGE OF NAME Recorded Nov 24, 2021
From: FLIR SYSTEMS, INC.; FIREWORK MERGER SUB II, LLC
To: TELEDYNE FLIR, LLC
Reel/Frame 058250/0300 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2018
From: FRANK, JEFFREY D.; HOELTER, THEODORE R.; HÖGASTEN, NICHOLAS; RICHARDS, AUSTIN A.; KENT, MICHAEL; MOREIRA, JULIE R.; BOULANGER, PIERRE; VALDES, RAYMOND; LI, JONATHAN
To: FLIR SYSTEMS, INC.
Reel/Frame 045941/0025 →
Continuity (8)
Continuation PCTUS2016066009 · Dec 9, 2016
Provisional Application 62265413 · Dec 9, 2015
Provisional Application 62265415 · Dec 9, 2015
Provisional Application 62265416 · Dec 9, 2015
Provisional Application 62374709 · Aug 12, 2016
Provisional Application 62374716 · Aug 12, 2016
Provisional Application 62402992 · Sep 30, 2016
Related Publication 20180266887A1 · Sep 20, 2018
Cited By (3)
US 12,322,100 US 12,400,762 US 12,590,841