IP Library Granted Patent US 11,651,577
Granted Patent B2
US 11,651,577 · App. 16/482,412 · Granted May 16, 2023

Augmented reality-based ply layups on a composite part layup tool

Inventors: Edward Bernardon (Bedford, MA); Robert S. Flory (Concord, MA)
Assignee: Siemens Industry Software Inc.
G06T19/20G02B27/0172G02B27/0179G06F30/00G06T7/74G06T19/006G02B2027/0187G06T2207/30164
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,651,577
App. No.
16/482,412
Granted
May 16, 2023
Kind
B2
Abstract

A system may support augmented reality (AR)-based layup of plies to form a composite laminate. The system may include an AR headset configured to drive an AR view that digitally visualizes ply placement data on a composite part layup tool physically visible through the AR headset. The system may also include an AR ply layup engine AR ply layup engine configured to analyze a view of the AR headset to identify the composite part layup tool, obtain ply placement data, and provide ply placement data to the AR headset to digitally overlay on the composite part layup tool physically visible through the AR headset.

Claims (53)

1. A system comprising:

an augmented reality (AR) headset configured to drive an AR view that digitally visualizes ply placement data on a composite part layup tool physically visible through the AR headset; and

an AR ply layup engine configured to:

analyze a view of the AR headset to identify the composite part layup tool;

match a computer-aided design (CAD) generated ply placement position of a given ply to layup via the composite part layup tool;

determine an incremental placement path for the given ply, wherein the incremental placement path specifies a layup sequence for different portions of the given ply via the composite part layup tool; and

provide the CAD generated ply placement position of the given ply to the AR headset and the incremental placement path for the given ply as the ply placement data to digitally overlay on a view visible through the AR headset.

2. The system of claim 1 , wherein the AR ply layup engine is further configured to:

access a layup simulation of applying the given ply via the composite part layup tool,

wherein the layup simulation comprises a simulated view of an application of a ply layup for the given ply via the composite part layup tool and wherein the layup simulation identifies surface complexities that impact an effectiveness of the ply layup for the given ply; and

provide the layup simulation tool to the AR headset further as the ply placement data to digitally overlay on the view visible through the AR headset; and

wherein the AR headset is configured to drive the AR view to overlay the layup simulation over an applicable portion of the view visible through the AR headset.

3. The system of claim 1 , wherein the AR ply layup engine is configured to analyze the view of the AR headset to identify the composite part layup tool by determining an orientation of the view with respect to the composite part layup tool, identifying other plies already placed using the composite part layup tool, or a combination of both.

4. The system of claim 3 , wherein the AR ply layup engine is configured to continually analyze the view of the AR headset to identify the composite part layup tool as a user of the AR headset physically moves.

5. The system of claim 1 , wherein the AR headset is further configured to capture an image of the composite part layup tool after physical layup of the given ply; and

wherein the AR ply layup engine is further configured to:

analyze the captured image to compare the physical layup of the given ply with a CAD simulated layup of the given ply; and

provide real-time feedback resulting for the analysis to the AR headset for presentation in the AR view.

6. The system of claim 1 , wherein the AR ply layup engine is further configured to identify a ply interest zone for the given ply, wherein the ply interest zone identifies a selected portion of the given ply that exhibits a layup characteristic different than other portions of the given ply; and

wherein the AR ply layup engine is configured to provide the ply interest zone further as part of the ply placement data to digitally overlay on the view visible through the AR headset.

7. A method comprising:

by a computing system:

analyzing a view of an augmented reality (AR) headset to identify a composite part layup tool visible through an AR headset;

matching a computer-aided design (CAD) generated ply placement position of a given ply to layup via the composite part layup tool;

accessing a layup simulation of applying the given ply via the composite part layup tool, wherein the layup simulation comprises a simulated view of an application of a ply layup for the given ply via the composite part layup tool and wherein the layup simulation identifies surface complexities that impact an effectiveness of the ply layup for the given ply; and

providing the CAD generated ply placement position of the given ply and the layup simulation to the AR headset as ply placement data to digitally overlay on a view visible through the AR headset.

8. The method of claim 7 , further comprising:

determining an incremental placement path for the given ply, wherein the incremental placement path specifies a layup sequence for different portions of the given ply via the composite part layup tool; and

providing the incremental placement path for the given ply to the AR headset further as the ply placement data to digitally overlay on the view visible through the AR headset.

9. The method of claim 7 , wherein analyzing the view of the AR headset to identify the composite part layup tool comprises determining an orientation of the view with respect to the composite part layup tool, identifying other plies already placed using the composite part layup tool, or a combination of both.

10. The method of claim 9 , comprising continually analyzing the view of the AR headset to identify the composite part layup tool as a user of the AR headset moves.

11. The method of claim 7 , further comprising

analyzing an image of the composite part layup tool captured after physical layup of the given ply has completed to compare the physical layup of the given ply with a CAD simulated layup of the given ply; and

providing real-time feedback resulting for the analysis to the AR headset for presentation in an AR view.

12. The method of claim 7 , further comprising:

identifying a ply interest zone for the given ply, wherein the ply interest zone identifies a selected portion of the given ply that exhibits a layup characteristic different than other portions of the given ply; and

providing the ply interest zone further as part of the ply placement data to digitally overlay on the view visible through the AR headset.

13. A non-transitory machine-readable medium comprising instructions that, when executed by a processor, cause a system to:

analyze a view of an augmented reality (AR) headset to identify a composite part layup tool visible through an AR headset;

match a computer-aided design (CAD) generated ply placement position of a given ply to layup via the composite part layup tool;

determine an incremental placement path for the given ply, wherein the incremental placement path specifies a layup sequence for different portions of the given ply via the composite part layup tool; and

provide the CAD generated ply placement position and the incremental placement path for the given ply to the AR headset as ply placement data to digitally overlay on a view visible through the AR headset.

14. The non-transitory machine-readable medium of claim 13 , further comprising instructions that, when executed by the processor, cause the system to:

access a layup simulation of applying the given ply on the composite part layup tool, wherein the layup simulation comprises a simulated view of an application of a ply layup for the given ply via the composite part layup tool and wherein the layup simulation identifies surface complexities that impact an effectiveness of the ply layup for the given ply; and

provide the layup simulation to the AR headset further as part of the ply placement data to digitally overlay on the view visible through the AR headset.

15. The non-transitory machine-readable medium of claim 13 , further comprising instructions that, when executed by the processor, cause the system to:

analyze an image of the composite part layup tool captured after physical layup of the given ply has completed to compare the physical layup of the given ply with a CAD simulated layup of the given ply; and

provide real-time feedback resulting for the analysis to the AR headset for presentation in an AR view.

16. The non-transitory machine-readable medium of claim 13 , wherein the instructions, when executed, cause the system to analyze the view of the AR headset to identify the composite part layup tool by determining an orientation of the view with respect to the composite part layup tool, identifying other plies already placed using the composite part layup tool, or a combination of both.

17. The non-transitory machine-readable medium of claim 16 , wherein the instructions, when executed, cause the system to continually analyze the view of the AR headset to identify the composite part layup tool as a user of the AR headset physically moves.

18. The non-transitory machine-readable medium of claim 13 , further comprising instructions that, when executed by the processor, cause the system to:

identify a ply interest zone for the given ply, wherein the ply interest zone identifies a selected portion of the given ply that exhibits a layup characteristic different than other portions of the given ply; and

provide the ply interest zone further as part of the ply placement data to digitally overlay on the view visible through the AR headset.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2019
From: SIEMENS PRODUCT LIFECYCLE MANAGEMENT SOFTWARE INC.
To: SIEMENS INDUSTRY SOFTWARE INC.
Reel/Frame 051171/0024 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2019
From: BERNARDON, EDWARD; FLORY, ROBERT S.
To: SIEMENS PRODUCT LIFECYCLE MANAGEMENT SOFTWARE INC.
Reel/Frame 049916/0618 →
Continuity (2)
Provisional Application 62563116 · Sep 26, 2017
Related Publication 20200250893A1 · Aug 6, 2020