Granted Patent B2

US 12,374,007 · App. 17/548,884 · Granted Jul 29, 2025

Inventors: Andrew Crispin Graham (Badminton, GB); Julian Matthew Foxall (Bristol, GB)

Assignee: Oliver Crispin Robotics Limited

G06T11/60G06T3/4038G06T5/50G06T2207/20104

Abstract

Claims (62)

1. A method, comprising:

selecting an area of interest on a gas turbine engine component;

receiving a plurality of source images, wherein one or more of the plurality of source images visually present the area of interest;

creating a composite image by stitching the plurality of source images of the gas turbine engine component, the composite image including the area of interest which in the composite image has lost detail compared to the same area of interest as presented in the one or more of the plurality of source images;

displaying the composite image on a user interface;

automatically highlighting the area of interest on the composite image as the composite image is displayed on the user interface;

displaying the one or more source images to visually present the area of interest on the user interface simultaneously with the composite image;

comparing the one or more source images to the composite image;

automatically highlighting, based on the comparing, the area of interest within a portion of the displayed source image as the one or more source images are displayed on the user interface, wherein a visual difference exists between the area of interest as presented in the composite image and the area of interest as presented in the one or more source images;

analyzing the area of interest to determine if damage is present on the gas turbine engine component as shown by the visual difference; and

based upon the analyzing, scheduling and initiating a maintenance operation when damage is present on the gas turbine engine component.

2. The method of claim 1 , further comprising:

highlighting the area of interest on the user interface by outlining the area of interest.

3. The method of claim 1 , further comprising:

highlighting the area of interest on the user interface by shading the area of interest.

4. The method of claim 1 , wherein displaying on the user interface the one or more source images comprises displaying on the user interface a plurality of source images, each source image of the plurality of source images containing at least one pixel in the area of interest.

5. The method of claim 1 , wherein the composite image comprises multiple areas of interest, and further comprising:

detecting an input from a user input device prior to displaying the one or more source images,

wherein the input relates to a first area of interest of the multiple areas of interest, and

wherein displaying the one or more source images on the user interface simultaneously with the composite image comprises displaying at least one first source image on the user interface simultaneously with the composite image, the at least one first source image having at least one pixel in the first area of interest.

6. The method of claim 5 , wherein the user input device is at least one of an optical input device, a tactile input device, and a gesture input device.

7. The method of claim 1 , wherein displaying the composite image on the user interface comprises projecting the composite image onto a representation of a three-dimensional surface displayed on the user interface.

8. The method of claim 1 , further comprising:

highlighting a first area of interest on the composite image and highlighting a second area of interest on the composite image.

9. The method of claim 8 , wherein displaying the one or more source images on the user interface simultaneously with the composite image comprises initially displaying at least one first source image on the user interface simultaneously with the composite image, the at least one first source image containing at least one pixel in the first area of interest, and further comprising:

transitioning to displaying at least one second source image on the user interface simultaneously with the composite image, the at least one second source image containing at least one pixel in the second area of interest.

10. The method of claim 8 , wherein displaying the one or more source images on the user interface simultaneously with the composite image comprises displaying at least one first source image and at least one second source image on the user interface simultaneously with the composite image, the at least one first source image containing at least one pixel in the first area of interest and the at least one second source image containing at least one pixel in the second area of interest.

11. The method of claim 1 , further comprising:

indicating on the composite image at least one boundary of the one or more source images.

12. The method of claim 11 , wherein the composite image comprises multiple areas of interest, and further comprising:

detecting an input from a user input device prior to indicating on the composite image the at least one boundary of the one or more source images,

displaying at least one boundary related to source images having at least one pixel in a first area of interest in response to the input from the user input device.

13. The method of claim 12 , wherein the user input device is at least one of an optical input device, a tactile input device, and a gesture input device.

14. The method of claim 1 , identifying and displaying at least two areas of interest onto the one or more source images and the composite image.

15. The method of claim 14 , wherein the at least two areas of interest displayed are highlighted via an outline, wherein the outline is different for each of the at least two areas of interest.

16. A method, comprising:

selecting an area of interest on a gas turbine engine component:

receiving a plurality of source images, wherein one or more of the plurality of source images visually present the area of interest;

creating a composite image by stitching the plurality of source images of the gas turbine engine component, the composite image including the area of interest which in the composite image has lost detail compared to the same area of interest as presented in the one or more of the plurality of source images;

projecting the composite image onto a representation of a three-dimensional (3D) surface displayed on a user interface to produce a 3D composite image;

changing an orientation of the 3D composite image in response to a first user input;

automatically highlighting a plurality of areas of interest as the 3D composite image is displayed on the user interface;

displaying the one or more source images to visually present the area of interest on the user interface simultaneously with the composite image, wherein displaying at least one source image on the user interface simultaneously with the composite image comprises displaying at least one first source image on the user interface simultaneously with the composite image, the at least one first source image containing at least one pixel in a first area of interest;

comparing the one or more source images to the composite image;

indicating on the 3D composite image one or more boundaries of the at least one first source image;

automatically highlighting, based on the comparing, the area of interest within a portion of the displayed source image as the one or more source images are displayed on the user interface, wherein a visual difference exists between the area of interest as presented in the composite image and the area of interest as presented in the one or more source images;

analyzing the area of interest to determine if damage is present on the gas turbine engine component as shown by the visual difference; and

based upon the analyzing, scheduling and initiating a maintenance operation when damage is present on the gas turbine engine component.

17. The method of claim 16 , wherein identifying the area of interest comprises recognizing the area of interest based on a second user input to a user input device.

18. The method of claim 16 , wherein the first user input is detected through at least one of an optical input device, tactile input device, and a gesture input device.

19. The method of claim 16 , identifying and displaying at least two areas of interest onto the at least one source image and the composite image.

20. A non-transitory computer-readable memory comprising instructions that, when executed, cause one or more processors to:

select an area of interest on a gas turbine engine component;

receive a plurality of source images, wherein one or more of the plurality of source images visually present the area of interest;

create a composite image by stitching the plurality of source images of the gas turbine engine component, the composite image including the area of interest which in the composite image has lost detail compared to the same area of interest as presented in the one or more of the plurality of source images;

display the composite image on a user interface;

highlight the area of interest on the composite image as the composite image is displayed on the user interface;

display the one or more source images to visually present the area of interest on the user interface simultaneously with the composite image;

compare the one or more source images to the composite image;

highlight, based on the comparison, the area of interest within a portion of the displayed source image as the one or more source images are displayed on the user interface, wherein a visual difference exists between the area of interest as presented in the composite image and the area of interest as presented in the one or more source images;

analyze the area of interest to determine if damage is present on the gas turbine engine component as shown by the visual difference; and

based upon the analyzing, a maintenance operation is scheduled and initiated when damage is present on the gas turbine engine component.

Assignments (1)

Continuity (1)

References Cited (21)