IP Library › Granted Patent US 12,456,170
Granted Patent B2
US 12,456,170 · App. 18/473,157 · Granted Oct 28, 2025

Inspection system and method

Inventors: Veniamin Stryzheus (Kent, WA); Matthew J. Chen (Seattle, WA)
Assignee: The Boeing Company
G06T5/50G06T7/0004H04N5/265H04N23/54H04N23/56H04N23/90G06T2200/24G06T2207/20212G06T2207/30108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,456,170
App. No.
18/473,157
Granted
Oct 28, 2025
Kind
B2
Abstract

An inspection system for capturing a topography of a surface includes a support frame configured to be positioned over the surface, at least three light sources configured to be mounted at different locations on the support frame, and at least two cameras each having a viewing direction and configured to be mounted at different locations on the support frame in a manner such that the viewing direction of each camera points generally toward a common region of the surface. The inspection system also includes a processor configured to: temporarily activate the light sources one at a time and cause all the cameras to capture a respective plurality of images of the common region each time a light source is activated, and combine the images in a manner that results in a reconstructed surface representing the topography of the common region.

Claims (68)

1. An inspection system for capturing a topography of a surface, comprising:

a rigid support frame configured to be positioned over the surface;

at least three light sources configured to be mounted at different locations on the support frame;

at least two cameras each having a viewing direction and configured to be mounted at different locations on the support frame in a manner such that the viewing direction of each camera points generally toward a common region of the surface;

a processor configured to:

temporarily activate the light sources one at a time and cause all the cameras to capture a respective plurality of images of the common region each time a light source is activated;

combine the images in a manner that results in a reconstructed surface representing the topography of the common region;

analyze the reconstructed surface for structural features, defects, and/or texture; and

mask out the structural features that can otherwise negatively impact the reliability and accuracy of the surface reconstruction process due to reflections, shadows, and/or other effects generated by the structural features, so that the structural features are absent in the reconstructed surface.

2. The inspection system of claim 1 , further comprising:

a graphic user interface (GUI) configured to display the reconstructed surface.

3. The inspection system of claim 2 , wherein:

the GUI is mountable on the support frame in a manner allowing viewing of the reconstructed surface while the support frame is held in position over the surface.

4. The inspection system of claim 1 , wherein:

at least one of the light sources is a directional light source having a lighting direction and mountable to the support frame in a manner such that the lighting direction forms an angle of incidence of 15-75 degrees with the common region.

5. The inspection system of claim 1 , wherein:

the light sources and/or the cameras are equiangularly spaced apart from each other when the inspection system is viewed from a top-down perspective.

6. The inspection system of claim 1 , wherein:

the support frame is comprised of beams interconnected by connecting elements configured to allowing for changing the size and/or shape of the support frame for accommodating surfaces of different sizes and/or shapes.

7. An inspection system for capturing a topography of a surface, comprising:

a rigid support frame configured to be positioned over the surface;

at least three light sources configured to be mounted at different locations on the support frame;

at least two cameras each having a viewing direction and configured to be mounted at different locations on the support frame in a manner such that the viewing direction of each camera points generally toward a common region of the surface;

one or more reference targets mounted on a bottom end of the support frame;

a processor configured to:

temporarily activate the light sources one at a time and cause all the cameras to capture a respective plurality of images of the common region each time a light source is activated, and each of the cameras is oriented in a manner to include the reference targets in the images;

combine the images in a manner that results in a reconstructed surface representing the topography of the common region; and

analyze the images containing the reference targets and determine, using the reference targets, a scaling factor of the images and three-dimensional locations of the cameras relative to each other.

8. The inspection system of claim 1 , further comprising at least one of the following:

a background light shield mountable to the support frame and configured to at least partially block background light from impinging on the common region of the surface;

a lens filter mountable on each of the cameras and configured to filter out one or more wavelengths of the background light, and the light sources are configured to emit light in at least one wavelength that is different than the wavelengths filtered out by the lens filter.

9. An inspection system for capturing a topography of a surface, comprising:

a rigid support frame;

a movable platform configured to position the support frame at one or more different locations on the surface;

at least three light sources configured to be mounted at different locations on the support frame;

at least two cameras each having a viewing direction and configured to be mounted at different locations on the support frame in a manner such that the viewing direction of each camera points generally toward a common region of the surface;

a processor configured to:

temporarily activate the light sources one at a time and cause all the cameras to capture a respective plurality of images of the common region each time a light source is activated;

combine the images in a manner that corrects for shape distortion and results in a reconstructed surface representing the topography of the common region;

analyze the reconstructed surface for structural features, defects, and/or texture; and

mask out the structural features that can otherwise negatively impact the reliability and accuracy of the surface reconstruction process due to reflections, shadows, and/or other effects generated by the structural features, so that the structural features are absent in the reconstructed surface.

10. A method of capturing a topography of a surface, comprising:

positioning a rigid support frame over the surface, the support frame having at least three light sources mounted at different locations on the support frame, and at least two cameras each having a viewing direction and mounted at different locations on the support frame in a manner such that the viewing direction of each camera points generally toward a common region of the surface;

temporarily activating the light sources one at a time and causing all the cameras to capture a respective plurality of images of the common region each time a light source is activated;

combining the images in a manner that results in a reconstructed surface representing a topography of the common region;

analyzing the reconstructed surface for structural features, defects, and/or texture; and

masking out the structural features that can otherwise negatively impact the reliability and accuracy of the surface reconstruction process due to reflections, shadows, and/or other effects generated by the structural features, so that the structural features are absent in the reconstructed surface.

11. The method of claim 10 , further comprising:

displaying the reconstructed surface on a graphic user interface (GUI).

12. The method of claim 10 , wherein displaying the reconstructed surface on the GUI comprises:

viewing the reconstructed surface on the GUI mounted on the support frame.

13. The method of claim 10 , further comprising:

orienting at least one of the light sources in a manner such that a lighting direction of the light source forms an angle of incidence of 15-75 degrees with the common region.

14. The method of claim 10 , wherein:

mounting the light sources and/or the cameras to the support frame in a manner such that the light sources and/or the cameras are equiangularly spaced apart from each other when the support frame is viewed from a top-down perspective.

15. The method of claim 10 , wherein:

changing the size and/or shape of the support frame by changing an arrangement of a plurality of beams interconnected by a plurality of connecting elements, to thereby accommodate surfaces of different sizes and/or shapes.

16. The method of claim 10 , further comprising:

mounting one or more reference targets proximate a bottom end of the support frame;

capturing, using the cameras, images of the reference targets; and

analyzing, using a processor, the images containing the reference targets and determining, based on the reference targets, a scaling factor of the images and three-dimensional locations of the cameras relative to each other.

17. The method of claim 10 , further comprising at least one of the following:

at least partially blocking background light from impinging on the common region of the surface using a background light shield mounted to the support frame;

filtering out, using a lens filter mounted on each of the cameras, one or more wavelengths of the background light, and emitting light from the light sources in at least one wavelength that is different than the wavelengths filtered out by the lens filter.

18. The method of claim 10 , wherein positioning the support frame over the surface comprises:

positioning the support frame at one or more different locations on the surface via a movable platform to which the support frame is attached.

19. The inspection system of claim 1 , wherein the structural features comprise at least one of fasteners, section joins, and window surrounds.

20. The method of claim 10 , wherein the structural features comprise at least one of fasteners, section joins, and window surrounds.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2023
From: STRYZHEUS, VENIAMIN; CHEN, MATTHEW J.
To: THE BOEING COMPANY
Reel/Frame 065002/0517 →
Continuity (1)
Related Publication 20250104190A1 · Mar 27, 2025
References Cited (13)
US 20110228052A1 · Ohnishi · 2011 [cited by applicant]
US 20180022621A1 · Von Drasek · 2018 [cited by examiner]
US 20180322647A1 · Harrington · 2018 [cited by applicant]
US 20200134773A1 · Pinter · 2020 [cited by applicant]
US 20220026397A1 · Kamel · 2022 [cited by examiner]
US 20230031023A1 · Wang · 2023 [cited by examiner]
US 20240221341A1 · Colonna · 2024 [cited by examiner]
US 20240296620A1 · Amavasai · 2024 [cited by examiner]
US 20240351705A1 · Ferry · 2024 [cited by examiner]
WO 2021174181 · 2021 [cited by applicant]
Wikipedia, “Photogrammetry,” available at <https://en.wikipedia.org/wiki/Photogrammetry>; retrieved on Aug. 26, 2023. [cited by applicant]
Wikipedia, “Photometric stereo,” available at <https://en.wikipedia.org/wiki/Photometric_stereo#>; retrieved on Aug. 26, 2023. [cited by applicant]
EPO, Extended European Search Report, application No. 24185691, dated Dec. 12, 2024. [cited by applicant]