Sewing machine and methods of using the same
An exemplary sewing machine includes a sewing head, a needle bar holding a needle, a motor for moving the needle during a sewing operation, a user interface, a data gathering device, a data storage device, and a processor. The data gathering device gathers data related to at least one of the sewing machine, an environment surrounding the sewing machine, a sewing material, the sewing operation performed by the sewing machine, and one or more interactions of a user with the sewing machine. The data storage device stores gathered data and data related to a neural network. The processor processes the gathered data through the neural network to generate processed data. Based on the processed data, the processor controls at least one of the user interface, the data storage device, and the motor.
1. A sewing machine, comprising:
a sewing bed, the sewing bed comprising a feed mechanism and a needle plate, wherein a workpiece can be placed on and moved across the sewing bed;
a sewing head arranged above the sewing bed, the sewing head comprising:
a needle bar extending toward the sewing bed to a distal end;
a needle attached to the distal end of the needle bar, wherein a thread is threaded through the needle;
an accessory bar extending toward the sewing bed to a distal end; and
an accessory attached to the distal end of the accessory bar;
a camera having a field of view encompassing at least a portion of any of the sewing bed, the needle plate, the workpiece, the needle, and the accessory, wherein the camera generates a camera data signal related to the portions of the sewing bed, the needle plate, the workpiece, the needle, and the accessory in the field of view of the camera;
a user interface configured to present information to the user of the sewing and to receive input from the user of the sewing machine;
an object recognition neural network that is trained to detect and to classify a recognized object from the camera data signal as at least one of the needle plate, the at least one needle, the at least one accessory, the workpiece, the thread, an embroidery hoop, and a foreign object, wherein the object recognition neural network generates an object detection data signal related to at least one of a position, an orientation, and a velocity of the recognized object and an object classification data signal related to an identity of the recognized object, wherein the recognized object comprises a first recognized object and a second recognized object; and
a processor configured to:
receive, from the object recognition neural network, an indication of at least one of the position and the orientation of the recognized object from the object recognition data signal;
receive, from the object recognition neural network, an indication of the identity of the recognized object from the object classification data signal;
control the user interface to present at least one of the position, the orientation, and the identity of the recognized object to the user;
receive, from the object recognition neural network, a first indication of at least one of a first position, a first orientation, and a first velocity of the first recognized object from the object detection data signal;
receive, from the object recognition neural network, a second indication of at least one of a second position, a second orientation, and a second velocity of the second recognized object from the object detection data signal; and
determine, based on the first indication and the second indication, whether a collision will occur or has already occurred between the first recognized object and the second recognized object.
2. The sewing machine of claim 1 , wherein the processor is configured to:
determine, based on at least one of the position and the orientation of the recognized object, whether the recognized object is at least one of installed incorrectly and damaged; and
control the user interface to present to the user an indication of the incorrect installation or damage of the recognized object.
3. The sewing machine of claim 2 , wherein the processor is configured to alter the operation of the sewing machine while the recognized object remains at least one of incorrectly installed and damaged.
4. The sewing machine of claim 1 , wherein the processor is configured to determine, based on the first position, the first orientation, the second position, and the second orientation, whether an incompatibility exists between the first recognized object and the second recognized object.
5. The sewing machine of claim 4 , wherein the processor is configured to control, based on the determination of an existing incompatibility, the user interface to present the existing incompatibly to the user.
6. The sewing machine of claim 4 , wherein the processor is configured to alter the operation of the sewing machine based on the determination of an existing incompatibility.
7. The sewing machine of claim 1 , wherein the processor is configured to:
receive, from the object recognition neural network, an indication of a first identity of the first recognized object from the object classification data signal;
receive, from the object recognition neural network, an indication of a second identity of the second recognized object from the object classification data signal; and
determine, based on the first identity and the second identity, whether an incompatibility exists between the first recognized object and the second recognized object.
8. The sewing machine of claim 7 , wherein the processor is configured to control, based on the determination of an existing incompatibility, the user interface to present the existing incompatibly to the user.
9. The sewing machine of claim 7 , wherein the processor is configured to alter the operation of the sewing machine based on the determination of an existing incompatibility.
10. The sewing machine of claim 7 , wherein the processor is configured to:
determine, based on the first identity, the second identity, and the existing incompatibility, a substitute component for at least one of the first recognized object and the second recognized object, wherein installation of the substitute component resolves the existing incompatibility; and
control the user interface to present the substitute component to the user.
11. The sewing machine of claim 1 , wherein the processor is configured to alter the operation of the sewing machine based on the determination the first recognized object and the second recognized object will collide or have already collided.
12. A sewing machine, comprising:
a sewing bed, the sewing bed comprising a feed mechanism and a needle plate, wherein a workpiece can be placed on and moved across the sewing bed;
a sewing head arranged above the sewing bed, the sewing head comprising:
a needle bar extending toward the sewing bed to a distal end;
a needle attached to the distal end of the needle bar, wherein a thread is threaded through the needle;
an accessory bar extending toward the sewing bed to a distal end; and
an accessory attached to the distal end of the accessory bar;
a camera having a field of view encompassing at least a portion of any of the sewing bed, the needle plate, the workpiece, the needle, and the accessory, wherein the camera generates a camera data signal related to the portions of the sewing bed, the needle plate, the workpiece, the needle, and the accessory in the field of view of the camera;
a user interface configured to present information to the user of the sewing and to receive input from the user of the sewing machine;
an object recognition neural network that is trained to detect and to classify a first recognized object and a second recognized object from the camera data signal, wherein the object recognition neural network generates an object detection data signal related to at least one of a first position, a first orientation, and a first velocity of the first recognized object and at least one of a second position, a second orientation, and a second velocity of the second recognized object; and
a processor configured to:
receive, from the object recognition neural network, a first indication of at least one of a first position, a first orientation, and a first velocity of the first recognized object from the object detection data signal;
receive, from the object recognition neural network, a second indication of at least one of a second position, a second orientation, and a second velocity of the second recognized object from the object detection data signal; and
determine, based on the first indication and the second indication, whether a collision will occur or has already occurred between the first recognized object and the second recognized object.
13. The sewing machine of claim 12 , wherein the processor is configured to alter the operation of the sewing machine based on the determination the first recognized object and the second recognized object will collide or have already collided.
14. The sewing machine of claim 12 , wherein the processor is configured to control, based on the determination the first recognized object and the second recognized object will collide or have already collided, the user interface to present the determination to the user.
15. The sewing machine of claim 12 , wherein the processor is configured to determine, based on at least one of first position, the first orientation, the second position, and the second orientation, whether at least one of the first recognized object and the second recognized object is at least one of installed incorrectly and damaged.
16. The sewing machine of claim 15 , wherein the processor is configured to control the user interface to present to the user an indication of the incorrect installation or damage of at least one of the first recognized object and the second recognized object.
17. The sewing machine of claim 15 , wherein the processor is configured to alter the operation of the sewing machine while at least one of the first recognized object and the second recognized object remains at least one of incorrectly installed and damaged.
18. The sewing machine of claim 12 , wherein the object recognition neural network generates an object classification data signal related to a first identity of the first recognized object and a second identify of the second recognized object.
19. The sewing machine of claim 18 , wherein the processor is configured to control the user interface to present at least one of the first identity and the second identity to the user.
20. The sewing machine of claim 18 , wherein the processor is configured to determine, based on the first identity and the second identity, whether an incompatibility exists between the first recognized object and the second recognized object.
21. The sewing machine of claim 20 , wherein the processor is configured to alter the operation of the sewing machine based on the determination of an existing incompatibility.
22. The sewing machine of claim 20 , wherein the processor is configured to control, based on the determination of an existing incompatibility, the user interface to present the existing incompatibly to the user.
23. The sewing machine of claim 22 , wherein the processor is configured to alter the operation of the sewing machine based on input received from the user of the sewing machine after the presentation of the existing incompatibility via the user interface.
24. The sewing machine of claim 20 , wherein the processor is configured to determine, based on the first identity, the second identity, and the determination of an existing incompatibility, a substitute component for at least one of the first recognized object and the second recognized object, wherein installation of the substitute component resolves the existing incompatibility.
25. The sewing machine of claim 24 , wherein the processor is configured to control the user interface to present the substitute component to the user.
26. The sewing machine of claim 12 , wherein at least one of the first recognized object and the second recognized object are classified by the object recognition neural network as at least one of the needle plate, the at least one needle, the at least one accessory, the workpiece, the thread, an embroidery hoop, and a foreign object.