IP Library Granted Patent US 11,971,329
Granted Patent B2
US 11,971,329 · App. 17/538,717 · Granted Apr 30, 2024

Methods and apparatus to autonomously detect thermal anomalies

Inventors: Brandon S. Good (Niskayuna, NY); Bijan Chitsaz (Evendale, OH); Guanghua Wang (Niskayuna, NY); Bernard P. Bewlay (Niskayuna, NY); Gyeong Woo Cheon (Niskayuna, NY); Alberto Santamaria-Pang (Bellevue, WA)
Assignee: GENERAL ELECTRIC COMPANY
G01M3/38F02C7/00G01J5/0003G06T7/0002G06T7/90G08B21/182H04N23/90F05D2260/80G01J2005/0077G06T2207/10048G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,971,329
App. No.
17/538,717
Granted
Apr 30, 2024
Kind
B2
Abstract

Methods, apparatus, systems, and articles of manufacture are disclosed to autonomously detect thermal anomalies. Disclosed examples include an example apparatus to detect engine anomalies comprising: at least one memory; instructions in the apparatus; and processor circuitry to execute the instructions to: control a plurality of infrared cameras to capture a baseline image set, the baseline image set including at least two thermal images; generate emissivity data based on the baseline image set; provide the baseline image set and the emissivity data to an artificial intelligence model, the artificial intelligence model to generate a reconstructed image set; determine a difference between the baseline image set and the reconstructed image set; and in response to the difference exceeding a threshold, generate an alert indicating detection of an engine anomaly.

Claims (40)

1. An apparatus to detect engine anomalies comprising:

at least one memory to store instructions; and

processor circuitry to execute the instructions to:

control a plurality of infrared cameras to capture a baseline image set, the baseline image set including at least two thermal images;

generate emissivity data based on the baseline image set, wherein the emissivity data is generated based on (1) associating a recognized object with an emissivity value stored in a database or (2) applying multi-color pyrometry to electromagnetic radiation of two different wavelength bands;

provide the baseline image set and the emissivity data to an artificial intelligence model, the artificial intelligence model to generate a reconstructed image set;

determine a difference between the baseline image set and the reconstructed image set based on:

a ratio of the baseline image set to the reconstructed image set; and

a neighboring area estimation; and

in response to the difference exceeding a threshold, generate an alert indicating detection of an engine anomaly.

2. The apparatus of claim 1 , wherein the artificial intelligence model includes at least one of a variational autoencoder and a generative adversarial neural network.

3. The apparatus of claim 1 , wherein the difference is determined based on a ratio of an image of the baseline image set to an image of the reconstructed image set.

4. The apparatus of claim 1 , wherein in response to a first camera of the plurality of infrared cameras detecting the engine anomaly, the processor circuitry is to execute the instructions to direct a second camera of the plurality of infrared cameras to image the engine anomaly.

5. The apparatus of claim 1 , wherein the processor circuitry is to execute the instructions to generate a two-dimensional temperature map.

6. The apparatus of claim 1 , wherein the engine anomaly is an engine leak in an under cowl area of a gas turbine engine.

7. A non-transitory computer readable medium comprising instructions, which, when executed, cause processor circuitry to at least:

control a plurality of infrared cameras to capture a baseline image set, the baseline image set including at least two thermal images;

generate emissivity data based on the baseline image set, wherein the emissivity data is generated based on (1) associating a recognized object with an emissivity value stored in a database or (2) applying multi-color pyrometry to electromagnetic radiation of two different wavelength bands;

provide the baseline image set and the emissivity data to an artificial intelligence model, the artificial intelligence model to generate a reconstructed image set;

determine a difference between the baseline image set and the reconstructed image set based on:

a ratio of the baseline image set to the reconstructed image set; and

a neighboring area estimation; and

in response to the difference exceeding a threshold, generate an alert indicating detection of an engine anomaly.

8. The non-transitory computer readable medium of claim 7 , wherein the artificial intelligence model includes at least one of a variational autoencoder and a generative adversarial neural network.

9. The non-transitory computer readable medium of claim 7 , wherein the difference is determined based on a ratio of an image of the baseline image set to an image of the reconstructed image set.

10. The non-transitory computer readable medium of claim 7 , wherein in response to a first camera of the plurality of infrared cameras detecting the engine anomaly, the processor circuitry is to execute the instructions to direct a second camera of the plurality of infrared cameras to image the engine anomaly.

11. The non-transitory computer readable medium of claim 7 , wherein the processor circuitry is to execute the instructions to generate a two-dimensional temperature map.

12. The non-transitory computer readable medium of claim 7 , wherein the engine anomaly is an engine leak in an under cowl area of a gas turbine engine.

13. A method comprising:

controlling a plurality of infrared cameras to capture a baseline image set, the baseline image set including at least two thermal images;

generating emissivity data based on the baseline image set, wherein the emissivity data is generated based on (1) associating a recognized object with an emissivity value stored in a database or (2) applying multi-color pyrometry to electromagnetic radiation of two different wavelength bands;

providing the baseline image set and the emissivity data to an artificial intelligence model, the artificial intelligence model to generate a reconstructed image set;

determining a difference between the baseline image set and the reconstructed image set based on:

a ratio of the baseline image set to the reconstructed image set; and

a neighboring area estimation; and

in response to the difference exceeding a threshold, generating an alert indicating detection of an engine anomaly.

14. The method of claim 13 , wherein the artificial intelligence model includes at least one of a variational autoencoder and a generative adversarial neural network.

15. The method of claim 13 , wherein determining the difference is based on a ratio of an image of the baseline image set to an image of the reconstructed image set.

16. The method of claim 13 , further including generating a two-dimensional temperature map.

17. The method of claim 13 , wherein the engine anomaly is an engine leak in an under cowl area of a gas turbine engine.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2021
From: GOOD, BRANDON S.; CHITSAZ, BIJAN; WANG, GUANGHUA; BEWLAY, BERNARD P.; CHEON, GYEONG WOO; SANTAMARIA-PANG, ALBERTO
To: GENERAL ELECTRIC COMPANY
Reel/Frame 058247/0404 →
Continuity (1)
Related Publication 20230168146A1 · Jun 1, 2023