IP Library Granted Patent US 12,517,501
Granted Patent B2
US 12,517,501 · App. 17/963,905 · Granted Jan 6, 2026

Ply templating for composite fabrication with AI quality control modules

Inventors: Matthew J. deFreese (Holdrege, NE); Judah Crowe (Kearney, NE); John Loucks (Sauble Beach, CA)
Assignee: Royal Engineered Composites, Inc.
G05B19/41875G05B19/4183G05B19/41885G05B2219/32368
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,517,501
App. No.
17/963,905
Granted
Jan 6, 2026
Kind
B2
Abstract

A quality control system may include a controller configured to be communicatively coupled with a monitoring assembly including one or more detectors. The controller may implement two or more AI quality control (AIQC) modules associated with two or more process steps for fabricating a composite material, where each of the two or more AIQC modules is associated with a different one of the two or more process steps. A particular AIQC module may receive monitoring data associated with the particular process step for a workpiece, generate quality control data using a particular AI model, and update the particular AI model based on testing data associated with the workpiece from one or more testing tools after at least the particular process step.

Claims (77)

1 . A ply templating system comprising:

one or more optical elements configured to project one or more placement patterns onto a workpiece;

a monitoring assembly including one or more detectors; and

a controller communicatively coupled with the monitoring assembly, the controller including one or more processors configured to execute program instructions causing the one or more processors to:

receive a map of a workpiece and a desired placement position of a ply on the workpiece;

receive image data from the monitoring assembly associated with the workpiece;

implement one or more artificial intelligence (AI) models to identify the workpiece in the image data and further identify the desired placement position of the ply on the workpiece;

analyze the image data with the one or more AI models to generate one or more tracking points on the workpiece based on the image data;

track a location of the one or more tracking points on the workpiece,

wherein a relative location or orientation of the workpiece is independently tracked based on the one or more tracking points;

direct the one or more optical elements to project a placement pattern on the workpiece at the desired placement position;

detect movements of the workpiece in the image data; and

direct the one or more optical elements to update the placement pattern on the workpiece based on the movements of the workpiece.

2 . The ply templating system of claim 1 , wherein the one or more optical elements comprise:

an optical projector.

3 . The ply templating system of claim 1 , wherein the one or more optical elements comprise:

a scanner.

4 . The ply templating system of claim 3 , wherein the monitoring assembly includes an imaging detector to generate the two-dimensional image data.

5 . The ply templating system of claim 1 , further comprising a platform for securing the workpiece, wherein implementing the one or more AI models to identify the workpiece in the image data and further identify the desired placement position of the ply on the workpiece further comprises:

analyze the image data with the one or more AI models to generate one or more tracking points on a platform securing the workpiece based on the image data;

tracking locations of the one or more additional tracking points; and

identifying movements of the workpiece relative to the platform.

6 . The ply templating system of claim 5 , wherein the platform is at least partially transparent, wherein the ply templating system further comprises:

an illumination source to illuminate the workpiece through the at least partially transparent platform.

7 . The ply templating system of claim 5 , wherein at least a portion of the platform is rotatable.

8 . The ply templating system of claim 1 , wherein the image data comprises:

two-dimensional image data.

9 . The ply templating system of claim 3 , wherein the AI model identifies the workpiece in the image data and the desired placement position of the ply using two-dimensional object detection.

10 . The ply templating system of claim 1 , wherein the image data comprises:

three-dimensional image data.

11 . The ply templating system of claim 10 , wherein the monitoring assembly includes two spatially-separated imaging detectors to generate the three-dimensional image data.

12 . The ply templating system of claim 10 , wherein the AI model identifies the workpiece in the image data and the desired placement position of the ply using three-dimensional object detection.

13 . The ply templating system of claim 10 , wherein the monitoring assembly includes one or more depth sensors to generate the three-dimensional image data.

14 . The ply templating system of claim 1 , wherein an orientation of the workpiece is known prior to generating the image data.

15 . The ply templating system of claim 1 , wherein an orientation of the workpiece is unknown prior to generating the image data, wherein the AI model further determines the orientation of the workpiece.

16 . A system comprising:

a hardware controller communicatively coupled with a monitoring assembly including one or more detectors and to one or more optical elements configured to project one or more placement patterns onto a workpiece, the controller including one or more processors configured to execute program instructions causing the one or more processors to:

receive a map of a workpiece and a desired placement position of a ply on the workpiece;

receive image data from the monitoring assembly associated with the workpiece;

implement one or more artificial intelligence (AI) models to identify the workpiece in the image data and further identify the desired placement position of the ply on the workpiece;

analyze the image data with the one or more AI models to generate one or more tracking points on the workpiece based on the image data;

track a location of the one or more tracking points on the workpiece,

wherein a relative location or orientation of the workpiece is independently tracked based on the one or more tracking points;

direct the one or more optical elements to project a placement pattern on the workpiece at the desired placement position;

detect movements of the workpiece in the image data; and

direct the one or more optical elements to update the placement pattern on the workpiece based on the movements of the workpiece.

17 . A ply templating method comprising:

receiving a map of a workpiece and a desired placement position of a ply on a workpiece;

receiving image data associated with the workpiece from a monitoring assembly including one or more detectors;

implementing one or more artificial intelligence (AI) models to identify the workpiece in the image data and further identify the desired placement position of the ply on the workpiece;

analyze the image data with the one or more AI models to generate one or more tracking points on the workpiece based on the image data;

tracking locations of the one or more tracking points on the workpiece,

wherein a relative location or orientation of the workpiece is independently tracked based on the one or more tracking points;

directing a scanner to project a placement pattern on the workpiece at the desired placement position;

detecting movements of the workpiece in the image data; and

directing the scanner to update the placement pattern on the workpiece based on the movements of the workpiece.

18 . The method of claim 17 , wherein the monitoring assembly further comprises one or more optical elements including an optical projector.

19 . The method of claim 18 , wherein the one or more optical elements comprise:

the scanner.

20 . The method of claim 17 , wherein implementing the one or more AI models to identify the workpiece in the image data and further identify the desired placement position of the ply on the workpiece further comprises:

analyze the image data with the one or more AI models to generate one or more tracking points on a platform securing the workpiece based on the image data;

tracking locations of the one or more additional tracking points; and

identifying movements of the workpiece relative to the platform.

21 . The method of claim 20 , wherein the platform is at least partially transparent, wherein a ply templating system associated with the platform comprises:

an illumination source to illuminate the workpiece through the at least partially transparent platform.

22 . The method of claim 20 , wherein at least a portion of the platform is rotatable.

23 . The method of claim 17 , wherein the image data comprises:

two-dimensional image data.

24 . The method of claim 17 , wherein the monitoring assembly includes an imaging detector to generate the two-dimensional image data.

25 . The method of claim 24 , wherein the AI model identifies the workpiece in the image data and the desired placement position of the ply using two-dimensional object detection.

26 . The method of claim 17 , wherein the image data comprises:

three-dimensional image data.

27 . The method of claim 26 , wherein the monitoring assembly includes two spatially-separated imaging detectors to generate the three-dimensional image data.

28 . The method of claim 26 , wherein the AI model identifies the workpiece in the image data and the desired placement position of the ply using three-dimensional object detection.

29 . The method of claim 26 , wherein the monitoring assembly includes one or more depth sensors to generate the three-dimensional image data.

30 . The method of claim 17 , wherein an orientation of the workpiece is known prior to generating the image data.

31 . The method of claim 17 , wherein an orientation of the workpiece is unknown prior to generating the image data, wherein the method further determines the orientation of the workpiece.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2025
From: DEFREESE, MATTHEW J.; CROWE, JUDAH; LOUCKS, JOHN
To: ROYAL ENGINEERED COMPOSITES, INC.
Reel/Frame 073104/0643 →
Continuity (2)
Provisional Application 63254641 · Oct 12, 2021
Related Publication 20230115037A1 · Apr 13, 2023
References Cited (89)
US 5153839A · Cross · 1992 [cited by applicant]
US 5353356A · Waugh et al. · 1994 [cited by applicant]
US 5646859A · Petta et al. · 1997 [cited by applicant]
US 6036319A · Rueb et al. · 2000 [cited by applicant]
US 6170163B1 · Bordignon et al. · 2001 [cited by applicant]
US 6381509B1 · Thiel et al. · 2002 [cited by applicant]
US 6871684B2 · Engelbart et al. · 2005 [cited by applicant]
US 7443282B2 · Tu et al. · 2008 [cited by applicant]
US 7835567B2 · Oldani · 2010 [cited by applicant]
US 7969306B2 · Ebert et al. · 2011 [cited by applicant]
US 8069071B2 · Kall et al. · 2011 [cited by applicant]
US 8184281B2 · Engelbart et al. · 2012 [cited by applicant]
US 8468670B2 · Baigorri · 2013 [cited by applicant]
US 8965539B2 · Hayes et al. · 2015 [cited by applicant]
US 9037282B2 · Reid et al. · 2015 [cited by applicant]
US 9102083B2 · David et al. · 2015 [cited by applicant]
US 9187188B2 · Richter et al. · 2015 [cited by applicant]
US 9205933B2 · Oberoi et al. · 2015 [cited by applicant]
US 9233469B2 · Lee et al. · 2016 [cited by applicant]
US 9440376B2 · Mao et al. · 2016 [cited by applicant]
US 9591273B1 · Wu et al. · 2017 [cited by applicant]
US 9842303B2 · Remtulla et al. · 2017 [cited by applicant]
US 9873230B1 · DesJardien et al. · 2018 [cited by applicant]
US 10213943B2 · Akasaki et al. · 2019 [cited by applicant]
US 10262232B2 · Klimovski et al. · 2019 [cited by applicant]
US 10466041B2 · Joachim · 2019 [cited by applicant]
US 10500721B2 · Takamizawa · 2019 [cited by applicant]
US 10737446B2 · Marcoe et al. · 2020 [cited by applicant]
US 10755401B2 · Bian et al. · 2020 [cited by applicant]
US 10794834B2 · Monchalin et al. · 2020 [cited by applicant]
US 11158041B2 · Ota et al. · 2021 [cited by applicant]
US 20060191622A1 · Ritter et al. · 2006 [cited by applicant]
US 20070115354A1 · Ohtomo · 2007 [cited by examiner]
US 20090199948A1 · Kisch et al. · 2009 [cited by applicant]
US 20100063610A1 · Angell et al. · 2010 [cited by applicant]
US 20110089591A1 · Gordon et al. · 2011 [cited by applicant]
US 20110114247A1 · Lee et al. · 2011 [cited by applicant]
US 20140110875A1 · Khan · 2014 [cited by applicant]
US 20150253766A1 · Pettersson et al. · 2015 [cited by applicant]
US 20160339652A1 · Safai · 2016 [cited by examiner]
US 20160343125A1 · Keitler · 2016 [cited by examiner]
US 20170100894A1 · Burns et al. · 2017 [cited by applicant]
US 20170248406A1 · Shadmehri · 2017 [cited by examiner]
US 20170350764A1 · Thompson et al. · 2017 [cited by applicant]
US 20180046139A1 · Stahl et al. · 2018 [cited by applicant]
US 20180067464A1 · Budge et al. · 2018 [cited by applicant]
US 20180311914A1 · Marcoe et al. · 2018 [cited by applicant]
US 20180319046A1 · Johnson et al. · 2018 [cited by applicant]
US 20190143565A1 · Mohanty et al. · 2019 [cited by applicant]
US 20190180152A1 · Krompaß et al. · 2019 [cited by applicant]
US 20190266261A1 · Vinnik et al. · 2019 [cited by applicant]
US 20190310204A1 · Rueb · 2019 [cited by applicant]
US 20190318444A1 · Juarez et al. · 2019 [cited by applicant]
US 20190366574A1 · Bosworth et al. · 2019 [cited by applicant]
US 20190375171A1 · Choi et al. · 2019 [cited by applicant]
US 20190389681A1 · Miller, II · 2019 [cited by applicant]
US 20200005422A1 · Subramanian et al. · 2020 [cited by applicant]
US 20200047414A1 · Kothari et al. · 2020 [cited by applicant]
US 20200070370A1 · Wakabayashi · 2020 [cited by applicant]
US 20200117271A1 · Bosworth et al. · 2020 [cited by applicant]
US 20200125846A1 · Laughlin et al. · 2020 [cited by applicant]
US 20200160497A1 · Shah et al. · 2020 [cited by applicant]
US 20200166909A1 · Noone et al. · 2020 [cited by applicant]
US 20200226770A1 · Rueb · 2020 [cited by examiner]
US 20200250893A1 · Bernardon et al. · 2020 [cited by applicant]
US 20200262051A1 · Rueb · 2020 [cited by applicant]
US 20200293019A1 · Putman et al. · 2020 [cited by applicant]
US 20200327651A1 · Srivastava et al. · 2020 [cited by applicant]
US 20200387824A1 · Kelsey et al. · 2020 [cited by applicant]
US 20200402222A1 · Shah et al. · 2020 [cited by applicant]
US 20210042570A1 · Iskandar et al. · 2021 [cited by applicant]
US 20210254970A1 · Isabelle · 2021 [cited by examiner]
US 20220121170A1 · Fornander et al. · 2022 [cited by applicant]
US 20220175454A1 · Chen · 2022 [cited by examiner]
US 20220207684A1 · Sugino et al. · 2022 [cited by applicant]
US 20220388017A1 · Itoh · 2022 [cited by examiner]
US 20230150056A1 · Zheng · 2023 [cited by examiner]
CN 1728173A · 2006 [cited by applicant]
CN 110678740A · 2020 [cited by applicant]
DE 102019116750A1 · 2020 [cited by applicant]
EP 0229159B1 · 1991 [cited by applicant]
EP 3605453A1 · 2020 [cited by applicant]
IN 201917026430A · 2019 [cited by applicant]
KR 101035791B1 · 2011 [cited by applicant]
TW I384340B · 2013 [cited by examiner]
WO 2020039104 · 2020 [cited by applicant]
WO 2020228932A1 · 2020 [cited by applicant]
Sacco, C.(2019). Machine Learning Methods for Rapid Inspection of Automated Fiber Placement Manufactured Composite Structures. (Master's thesis). [cited by applicant]
Sacco, et al., Machine learning in composites manufacturing: A case study of Automated Fiber Placement inspection, Composite Structures, vol. 250, 2020, ISSN 0263-8223, https://doi.org/10.1016/j.compstruct.2020.112514. [cited by applicant]