IP Library Granted Patent US 10,481,579
Granted Patent B1
US 10,481,579 · App. 16/289,422 · Granted Nov 19, 2019

Dynamic training for assembly lines

Inventors: Matthew C. Putman (Brooklyn, NY); Vadim Pinskiy (Akron, OH); Eun-Sol Kim (Cliffside Park, NJ); Andrew Sundstrom (Brooklyn, NY)
Assignee: NANOTRONICS IMAGING, INC.
G05B19/406G05B19/19G06N20/20G05B2219/40556
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,481,579
App. No.
16/289,422
Granted
Nov 19, 2019
Kind
B1
Abstract

Aspects of the disclosed technology provide an Artificial Intelligence Process Control (AIPC) for automatically detecting errors in a manufacturing workflow of an assembly line process, and performing error mitigation through the update of instructions or guidance given to assembly operators at various stations. In some implementations, the disclosed technology utilizes one or more machine-learning models to perform error detection and/or propagate instructions/assembly modifications necessary to rectify detected errors or to improve the product of manufacture.

Claims (41)

1. A method for optimizing workflow in an assembly line, the method comprising:

receiving first motion data from a first image capture device disposed at a first station in the assembly line, wherein the first motion data corresponds with motions executed by a first operator while interacting with an article of manufacture, and wherein the first operator is selected from among one or more operators associated with the first station;

calculating an error variance for the motions executed by the first operator based on the first motion data;

identifying, based on the error variance, deviations in the article of manufacture; and

automatically adjusting assembly instructions that are provided to at least one of the one or more operators based on the calculated error variance to generate modified assembly instructions.

2. The method of claim 1 , wherein the modified assembly instructions are configured to provide the at least one of the one or more operators with instructions for reducing or eliminating the identified deviations in the article of manufacture.

3. The method of claim 1 , wherein the one or more operators comprises the first operator.

4. The method of claim 1 , wherein the one or more operators comprises a second operator that is associated with a second station, and wherein the second station is downstream from the first station in the assembly line.

5. The method of claim 1 , wherein the one or more operators comprises a second operator that is associated with a second station, and a third operator that is associated with a third station, and wherein the second station is downstream from the first station in the assembly line, and the third station is downstream from the second station in the assembly line.

6. The method of claim 1 , further comprising:

receiving fourth motion data from a fourth image capture device disposed at a fourth station in an assembly line, wherein the fourth motion data corresponds with motions executed by a fourth operator associated with the fourth station while interacting with the article of manufacture, and

wherein calculating the error variance is further based on the motions executed by the fourth operator.

7. The method of claim 1 , wherein identifying the deviations in the assembly of the article of manufacture is performed using one or more machine learning models.

8. A system for optimizing workflow in an assembly line, the system comprising:

a plurality of image capture devices, wherein each of the image capture devices is disposed at one or more of a plurality of stations in an assembly line; and

an assembly instruction module configured to automatically modify guidance and instructions provided to one or more of the plurality of stations, wherein the assembly instruction module is coupled to the plurality of image capture devices, and wherein the assembly instruction module is configured to perform operations comprising:

receiving, by the assembly instruction module, first motion data from a first image capture device from among the plurality of image capture devices, and wherein the first image capture device is disposed at a first station in the assembly line, wherein the first motion data corresponds with motions executed by a first operator while interacting with an article of manufacture, and wherein the first operator is selected from among one or more operators associated with the first station;

calculating an error variance for the motions executed by the first operator based on the first motion data;

identifying, based on the error variance, deviations in the article of manufacture; and

automatically adjusting assembly instructions that are provided to at least one of the one or more operators based on the calculated error variance to generate modified assembly instructions.

9. The system of claim 8 , wherein the modified assembly instructions are configured to provide the at least one of the one or more operators with instructions for reducing or eliminating the identified deviations in the article of manufacture.

10. The system of claim 8 , wherein the one or more operators comprises the first operator.

11. The system of claim 8 , wherein the one or more operators comprises a second operator that is associated with a second station, and wherein the second station is downstream from the first station in the assembly line.

12. The system of claim 8 , wherein the one or more operators comprises a second operator that is associated with a second station, and a third operator that is associated with a third station, and wherein the second station is downstream from the first station in the assembly line, and the third station is downstream from the second station in the assembly line.

13. The system of claim 8 , further comprising:

receiving fourth motion data from a fourth image capture device disposed at a fourth station in an assembly line, wherein the fourth motion data corresponds with motions executed by a fourth operator associated with the fourth station while interacting with the article of manufacture, and

wherein calculating the error variance is further based on the motions executed by the fourth operator.

14. The system of claim 8 , wherein identifying the deviations in the assembly of the article of manufacture is performed using one or more machine learning models.

15. A non-transitory computer-readable media comprising instructions stored thereon which, when executed by one or more processors, are configured to cause the processors to execute instructions comprising:

receiving first motion data from a first image capture device disposed at a first station in the assembly line, wherein the first motion data corresponds with motions executed by a first operator while interacting with an article of manufacture, and wherein the first operator is selected from among one or more operators associated with the first station;

calculating an error variance for the motions executed by the first operator based on the first motion data;

identifying, based on the error variance, deviations in the article of manufacture; and

automatically adjusting assembly instructions that are provided to at least one of the one or more operators based on the calculated error variance to generate modified assembly instructions.

16. The non-transitory computer-readable media of claim 15 , wherein the modified assembly instructions are configured to provide the at least one of the one or more operators with instructions for reducing or eliminating the identified deviations in the article of manufacture.

17. The non-transitory computer-readable media of claim 15 , wherein the one or more operators comprises the first operator.

18. The non-transitory computer-readable media of claim 15 , wherein the one or more operators comprises a second operator that is associated with a second station, and wherein the second station is downstream from the first station in the assembly line.

19. The non-transitory computer-readable media of claim 15 , wherein the one or more operators comprises a second operator that is associated with a second station, and a third operator that is associated with a third station, and

wherein the second station is downstream from the first station in the assembly line, and the third station is downstream from the second station in the assembly line.

20. The non-transitory computer-readable media of claim 15 , further comprising instructions configured for causing the processors to perform operations for:

receiving fourth motion data from a fourth image capture device disposed at a fourth station in an assembly line, wherein the fourth motion data corresponds with motions executed by a fourth operator associated with the fourth station while interacting with the article of manufacture, and

wherein calculating the error variance is further based on the motions executed by the fourth operator.

Assignments (2)
SECURITY INTEREST Recorded Nov 30, 2023
From: NANOTRONICS IMAGING, INC.; NANOTRONICS HEALTH LLC; CUBEFABS INC.
To: ORBIMED ROYALTY & CREDIT OPPORTUNITIES IV, LP
Reel/Frame 065726/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2019
From: PUTMAN, MATTHEW C.; PINSKIY, VADIM; KIM, EUN-SOL; SUNDSTROM, ANDREW
To: NANOTRONICS IMAGING, INC.
Reel/Frame 048556/0475 →
Cited By (12)
US 12,196,074 US 12,236,362 US 12,346,088 US 12,447,687 US 12,449,792 US 12,493,805 US 12,571,301 US 12,579,332 US 12,591,227 US 12,646,419 US 12,664,573 US 12,682,384