IP Library Granted Patent US 11,731,368
Granted Patent B2
US 11,731,368 · App. 17/444,619 · Granted Aug 22, 2023

Systems, methods, and media for artificial intelligence process control in additive manufacturing

Inventors: Vadim Pinskiy (Wayne, NJ); Matthew C. Putman (Brooklyn, NY); Damas Limoge (Brooklyn, NY); Aswin Raghav Nirmaleswaran (Brooklyn, NY)
Assignee: Nanotronics Imaging, Inc.
B33Y50/02B22F10/30B22F10/85B22F12/90B29C64/209B29C64/393B33Y10/00G06F18/2411G06F18/295G06N3/04G06V10/764G06V10/82G06V10/993B22F10/12B22F10/18B22F10/25B22F10/28
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,731,368
App. No.
17/444,619
Granted
Aug 22, 2023
Kind
B2
Abstract

Systems, methods, and media for additive manufacturing are provided. In some embodiments, an additive manufacturing system comprises: a hardware processor that is configured to: receive a captured image; apply a trained failure classifier to a low-resolution version of the captured image; determine that a non-recoverable failure is not present in the printed layer of the object; generate a cropped version of the low-resolution version of the captured image; apply a trained binary error classifier to the cropped version of the low-resolution version of the captured image; determine that an error is present in the printed layer of the object; apply a trained extrusion classifier to the captured image, wherein the trained extrusion classifier generates an extrusion quality score; and adjust a value of a parameter of the print head based on the extrusion quality score to print a subsequent layer of the printed object.

Claims (99)

1. An additive manufacturing system, comprising:

a print head that is configured to print an object in a layer-by-layer manner;

an image sensor configured to capture an image of a printed layer of the object; and

a computing system in communication with the image sensor and the print head, the computing system configured to perform operations comprising:

receiving the image from the image sensor;

generating a low-resolution version of the image;

applying a binary error classifier to the low-resolution version of the image to determine whether an error is present in the printed layer of the object;

determining, based on an output from the binary error classifier, that the error is present in the printed layer of the object;

in response to determining that the error is present in the printed layer of the object, applying an extrusion classifier to a high-resolution version of the image to generate an extrusion quality score indicating a quality of extrusion of material in the printed layer of the object; and

adjusting a value of a parameter of the print head based on the extrusion quality score to print a subsequent layer of the object.

2. The additive manufacturing system of claim 1 , further comprising:

generating a cropped version of the low-resolution version of the image by identifying a region of interest that includes a mesh pattern representative of the extrusion quality score.

3. The additive manufacturing system of claim 1 , wherein the operations further comprise:

receiving a second image of the subsequent layer of the object;

generating a second low-resolution version of the second image;

applying a failure classifier to the second low-resolution version of the second image;

determining, based on a second classification obtained from the failure classifier, that a non-recoverable failure is present in the subsequent layer of the object; and

in response to determining that the non-recoverable failure is present in the subsequent layer, terminate printing of the object.

4. The additive manufacturing system of claim 1 , wherein the operations further comprise:

receiving a second image of the subsequent layer of the object;

generating a second low-resolution version of the second image;

applying the binary error classifier to the second low-resolution version of the second image to determine whether a second error is present in the printed layer of the object;

determining, based on a second output from the binary error classifier, that the second error is not present in the printed layer of the object; and

continuing printing of additional layers.

5. The additive manufacturing system of claim 1 , wherein the operations further comprise:

receiving a second image of the subsequent layer of the object;

generating a second low-resolution version of the second image;

applying the binary error classifier to the second low-resolution version of the second image to determine whether a second error is present in the printed layer of the object;

determining, based on a second output from the binary error classifier, that the second error is present in the printed layer of the object;

in response to determining that the second error is present in the subsequent layer of the object, applying the extrusion classifier to a second high-resolution version of the image to generate a second extrusion quality score indicating a quality of extrusion of material in the subsequent layer of the object; and

adjusting a second value of a second parameter of the print head based on the second extrusion quality score to print a second subsequent layer of the object.

6. The additive manufacturing system of claim 1 , wherein the operations further comprise:

applying a failure classifier to the low-resolution version of the image to determine that a non-recoverable failure is not present.

7. The additive manufacturing system of claim 1 , wherein applying the extrusion classifier to the high-resolution version of the image comprises:

identifying a centroid of the image based on an infill density of the printed layer;

generating a window positioned about the centroid in the high-resolution version of the image; and

applying the extrusion classifier to the window.

8. A method, comprising:

receiving, by a computing system, an image of a printed layer on an object, the printed layer generated by a print head configured to print the object in a layer-by-layer manner;

generating, by the computing system, a low-resolution version of the image;

applying, by the computing system, a binary error classifier to the low-resolution version of the image to determine whether an error is present in the printed layer of the object;

determining, by the computing system and based on an output from the binary error classifier, that the error is present in the printed layer of the object;

in response to determining that the error is present in the printed layer of the object, applying, by the computing system, an extrusion classifier to a high-resolution version of the image to generate an extrusion quality score indicating a quality of extrusion of material in the printed layer of the object; and

adjusting, by the computing system, a value of a parameter of the print head based on the extrusion quality score to print a subsequent layer of the object.

9. The method of claim 8 , further comprising:

generating, by the computing system, a cropped version of the low-resolution version of the image by identifying a region of interest that includes a mesh pattern representative of the extrusion quality score.

10. The method of claim 8 , further comprising:

receiving, by the computing system, a second image of the subsequent layer of the object;

generating, by the computing system, a second low-resolution version of the second image;

applying, by the computing system, a failure classifier to the second low-resolution version of the second image;

determining, by the computing system and based on a second classification obtained from the failure classifier, that a non-recoverable failure is present in the subsequent layer of the object; and

in response to determining that the non-recoverable failure is present in the subsequent layer, terminate, by the computing system, printing of the object.

11. The method of claim 8 , further comprising:

receiving, by the computing system, a second image of the subsequent layer of the object;

generating, by the computing system, a second low-resolution version of the second image;

applying, by the computing system, the binary error classifier to the second low-resolution version of the second image to determine whether a second error is present in the printed layer of the object;

determining, by the computing system and based on a second output from the binary error classifier, that the second error is not present in the printed layer of the object; and

continuing, by the computing system, printing of additional layers.

12. The method of claim 8 , further comprising:

receiving, by the computing system, a second image of the subsequent layer of the object;

generating, by the computing system, a second low-resolution version of the second image;

applying, by the computing system, the binary error classifier to the second low-resolution version of the second image to determine whether a second error is present in the printed layer of the object;

determining, by the computing system and based on a second output from the binary error classifier, that the second error is present in the printed layer of the object;

in response to determining that the second error is present in the subsequent layer of the object, applying, by the computing system, the extrusion classifier to a second high-resolution version of the image to generate a second extrusion quality score indicating a quality of extrusion of material in the subsequent layer of the object; and

adjusting, by the computing system, a second value of a second parameter of the print head based on the second extrusion quality score to print a second subsequent layer of the object.

13. The method of claim 8 , further comprising:

applying, by the computing system, a failure classifier to the low-resolution version of the image to determine that a non-recoverable failure is not present.

14. The method of claim 8 , further comprising, wherein applying, by the computing system, the extrusion classifier to the high-resolution version of the image comprises:

identifying a centroid of the image based on an infill density of the printed layer;

generating a window positioned about the centroid in the high-resolution version of the image; and

applying the extrusion classifier to the window.

15. A non-transitory computer readable medium comprising one or more sequences of instructions, which, when executed by one or more processors, causes a computing system to perform operations comprising:

receiving, by the computing system, an image of a printed layer on an object, the printed layer generated by a print head configured to print the object in a layer-by-layer manner;

generating, by the computing system, a low-resolution version of the image;

applying, by the computing system, a binary error classifier to the low-resolution version of the image to determine whether an error is present in the printed layer of the object;

determining, by the computing system and based on an output from the binary error classifier, that the error is present in the printed layer of the object;

in response to determining that the error is present in the printed layer of the object, applying, by the computing system, an extrusion classifier to a high-resolution version of the image to generate an extrusion quality score indicating a quality of extrusion of material in the printed layer of the object; and

adjusting, by the computing system, a value of a parameter of the print head based on the extrusion quality score to print a subsequent layer of the object.

16. The non-transitory computer readable medium of claim 15 , further comprising:

generating, by the computing system, a cropped version of the low-resolution version of the image by identifying a region of interest that includes a mesh pattern representative of the extrusion quality score.

17. The non-transitory computer readable medium of claim 15 , further comprising:

receiving, by the computing system, a second image of the subsequent layer of the object;

generating, by the computing system, a second low-resolution version of the second image;

applying, by the computing system, a failure classifier to the second low-resolution version of the second image;

determining, by the computing system and based on a second classification obtained from the failure classifier, that a non-recoverable failure is present in the subsequent layer of the object; and

in response to determining that the non-recoverable failure is present in the subsequent layer, terminate, by the computing system, printing of the object.

18. The non-transitory computer readable medium of claim 15 , further comprising:

receiving, by the computing system, a second image of the subsequent layer of the object;

generating, by the computing system, a second low-resolution version of the second image;

applying, by the computing system, the binary error classifier to the second low-resolution version of the second image to determine whether a second error is present in the printed layer of the object;

determining, by the computing system and based on a second output from the binary error classifier, that the second error is present in the printed layer of the object;

in response to determining that the second error is present in the subsequent layer of the object, applying, by the computing system, the extrusion classifier to a second high-resolution version of the image to generate a second extrusion quality score indicating a quality of extrusion of material in the subsequent layer of the object; and

adjusting, by the computing system, a second value of a second parameter of the print head based on the second extrusion quality score to print a second subsequent layer of the object.

19. The non-transitory computer readable medium of claim 15 , further comprising:

applying, by the computing system, a failure classifier to the low-resolution version of the image to determine that a non-recoverable failure is not present.

20. The non-transitory computer readable medium of claim 15 , wherein applying, by the computing system, the extrusion classifier to the high-resolution version of the image comprises:

identifying a centroid of the image based on an infill density of the printed layer;

generating a window positioned about the centroid in the high-resolution version of the image; and

applying the extrusion classifier to the window.

Assignments (2)
SECURITY INTEREST Recorded Nov 30, 2023
From: NANOTRONICS IMAGING, INC.; NANOTRONICS HEALTH LLC; CUBEFABS INC.
To: ORBIMED ROYALTY & CREDIT OPPORTUNITIES IV, LP
Reel/Frame 065726/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: PINSKIY, VADIM; PUTMAN, MATTHEW C.; LIMOGE, DAMAS; NIRMALESWARAN, ASWIN RAGHAV
To: NANOTRONICS IMAGING, INC.
Reel/Frame 057106/0584 →
Continuity (9)
Continuation 16853640 · Apr 20, 2020
Continuation In Part 16723212 · Dec 20, 2019
Continuation PCTUS2019024795 · Mar 29, 2019
Continuation 15943442 · Apr 2, 2018
Provisional Application 62898535 · Sep 10, 2019
Provisional Application 62836202 · Apr 19, 2019
Provisional Application 62836213 · Apr 19, 2019
Provisional Application 62836199 · Apr 19, 2019
Related Publication 20220024140A1 · Jan 27, 2022