IP Library Granted Patent US 11,176,287
Granted Patent B2
US 11,176,287 · App. 17/011,392 · Granted Nov 16, 2021

System and method for internal structural defect analysis using three-dimensional sensor data

Inventor: Michael J. Wilsher (Letchworth, GB)
Assignee: Xerox Corporation
G06F30/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,176,287
App. No.
17/011,392
Granted
Nov 16, 2021
Kind
B2
Abstract

A method and system for structural analysis of an object detects deviations between a physical object model and a predetermined three-dimensional model of the object. The physical object model is generated from scanned surface data of an object produced by a three-dimensional sensor. The physical object model is aligned with the predetermined three-dimensional model of the object to identify an interference between a location of the aligned physical object model and the predetermined three-dimensional model of the object that corresponds with any elastic deformation of an internal component within the predetermined three-dimensional model. An indicator of expected damage to the internal component arising from the elastic deformation is generated.

Claims (61)

1. A method for structural analysis comprising:

generating with a three-dimensional sensor surface scan data of an object;

generating with a processor a physical object model of a surface of the object using the surface scan data of the object that was generated by the three-dimensional sensor;

aligning with the processor the generated physical object model of the surface of the object with a surface of a predetermined three-dimensional model of the surface of the object and at least one internal component of the object in a three-dimensional virtual environment;

identifying with the processor an interference between the generated physical object model and a volume occupied by the at least one internal component in the predetermined three-dimensional model, the at least one internal component not being present in the sensor surface scan data of the object; and

generating with an output device an indicator of expected damage to the at least one internal component within the object using the identified interference.

2. The method of claim 1 , the generation of the surface scan data and physical object model further comprising:

generating with the three-dimensional sensor a point cloud including a plurality of three-dimensional coordinates corresponding to a plurality of locations on the surface of the object; and

generating with the processor the physical object model as a geometric mesh corresponding to the surface of the object using the point cloud.

3. The method of claim 2 , the generation of the geometric mesh further comprising:

connecting a plurality of vertices in the point cloud with a plurality of edges to form the geometric mesh that corresponds to the surface of the object.

4. The method of claim 3 , the connecting of the plurality of vertices with a plurality of edges further comprising:

using a plurality of polygons to connect the plurality of vertices with the plurality of edges.

5. The method of claim 4 , the identification of the interference further comprising:

identifying with the processor a location of a vertex in the geometric mesh that corresponds to the surface of the object;

identifying with the processor the volume occupied by the at least one internal component using another geometric mesh that corresponds to the at least one internal component in the predetermined three-dimensional object model; and

identifying with the processor the interference between the physical object model and the at least one internal component when the processor determines the location of the vertex in the geometric mesh that corresponds to the surface of the object is within the identified volume occupied by the at least one internal component.

6. The method of claim 4 , the identification of the interference further comprising:

identifying with the processor a location of a vertex in the geometric mesh that deviates from a location of a corresponding vertex in the predetermined three-dimensional object model;

identifying with the processor a surface of the at least one internal component using another geometric mesh that corresponds to the at least one internal component in the predetermined three-dimensional object model; and

identifying with the processor the interference between the physical object model and the at least one internal component when the processor determines the location of the vertex in the geometric mesh that deviates from the location of the corresponding vertex in the predetermined three-dimensional object model is on or within a predetermined distance of the identified surface of the at least one internal component.

7. The method of claim 1 , the alignment further comprising:

identifying with the processor a first feature in the physical object model;

identifying with the processor a second feature in the predetermined three-dimensional object model, the second feature corresponding to the first feature in the physical object model; and

aligning with the processor the first feature in the physical object model with the second feature of the predetermined three-dimensional object model.

8. The method of claim 1 , the generation of the indicator further comprising:

generating with the output device a graphical depiction of the object and the at least one internal component in the three-dimensional virtual environment.

9. The method of claim 1 , the generation of the surface scan data further comprising:

generating surface scan data of an exterior surface of a motor vehicle.

10. A structural analysis system comprising:

a three-dimensional sensor configured to generate surface scan data of a surface of an object;

an output device; and

a processor operatively connected to the three-dimensional sensor, the output device and a memory, the processor being configured to:

receive the sensor surface scan data of the surface of the object generated by the three-dimensional sensor;

generate a physical object model of the surface of the object using the surface scan data of the object;

align the physical object model with a surface of a predetermined three-dimensional model of the object in a three-dimensional environment that is stored in the memory;

identify an interference between the physical object model aligned with the predetermined three-dimensional model and a volume occupied by at least one internal component in the predetermined three-dimensional model, the at least one internal component not being present in the sensor surface scan data of the object generated by the three-dimensional sensor; and

generate with the output device an indicator of expected damage to the at least one internal component within the identified volume occupied by the at least one internal component using the identification of the interference.

11. The system of claim 10 , the processor being further configured to:

generate with the three-dimensional sensor a point cloud including a plurality of three-dimensional coordinates corresponding to a plurality of locations on the surface of the object; and

use the point cloud to generate the physical object model as a geometric mesh that corresponds to the surface of the object.

12. The system of claim 11 , the processor being further configured to:

connect a plurality of vertices in the point cloud with a plurality of edges to form the geometric mesh that corresponds to the surface of the object.

13. The system of claim 12 , the processor being further configured to:

connect of the plurality of vertices with a plurality of edges using a plurality of polygons.

14. The system of claim 13 , the processor being further configured to:

identify a location of a vertex in the geometric mesh that corresponds to the surface of the object;

identify the volume occupied by the at least one internal component within the predetermined three-dimensional object model in the three-dimensional virtual environment using another geometric mesh that corresponds to the at least one internal component and is stored in the memory; and

identify the interference between the physical object model and the at least one internal component when the processor determines the identified location of the vertex in the geometric mesh that corresponds to the surface of the object is within the identified volume occupied by the at least one internal component.

15. The system of claim 13 , the processor being further configured to:

identify with the processor a location of a vertex in the geometric mesh that corresponds to the surface of the object;

identify with the processor a surface of the at least one internal component within the predetermined three-dimensional object model in the three-dimensional virtual environment using another geometric mesh corresponding to the at least one internal component; and

identify with the processor the interference between the physical object model and the at least one internal component when the processor determines the identified location of the vertex in the geometric mesh that corresponds to the surface of the object is on or within a predetermined distance of a surface of the geometric mesh that corresponds to the at least one internal component.

16. The system of claim 10 , the processor being further configured to:

identify a first feature in the physical object model;

identify a second feature in the predetermined three-dimensional object model, the second feature corresponding to the first feature in the physical object model; and

align the first feature in the physical object model with the second feature of the predetermined three-dimensional object model in the three-dimensional virtual environment.

17. The system of claim 10 , the processor being further configured to:

operate the output device to generate the indicator as a graphical depiction of the object and the at least one internal component in the predetermined three-dimensional object model in the three-dimensional virtual environment.

18. The system of claim 10 , the three-dimensional sensor being further configured to:

generate surface scan data of an exterior surface of a motor vehicle.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2025
From: XEROX CORPORATION
To: GENESEE VALLEY INNOVATIONS, LLC
Reel/Frame 073562/0677 →
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
RELEASE OF SECURITY INTEREST IN PATENTS AT R/F 062740/0214 Recorded May 18, 2023
From: CITIBANK, N.A., AS AGENT
To: XEROX CORPORATION
Reel/Frame 063694/0122 →
SECURITY INTEREST Recorded Nov 10, 2022
From: XEROX CORPORATION
To: CITIBANK, N.A., AS AGENT
Reel/Frame 062740/0214 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 3, 2020
From: WILSHER, MICHAEL J.
To: XEROX CORPORATION
Reel/Frame 053686/0933 →
Continuity (2)
Continuation 14848402 · Sep 9, 2015
Related Publication 20210012044A1 · Jan 14, 2021