Augmented reality system for stitching along a predetermined path
Disclosed are various systems and features for use with a machine, such as a sewing machine, to facilitate augmented-reality features such as projecting assistive visual elements or virtual UI elements into an operational area. Such systems and features may be useful in the context of performing an action along a self-guided path on a substrate.
1. A system for performing augmented reality-assisted sewing operations, the system comprising:
a guiding apparatus;
an operational area;
one or more operational objects; and
an augmented reality system comprising a vision system and an illumination system, the illumination system being configured to project augmented reality features onto the one or more operational objects,
wherein the augmented reality system is configured to enable a user to interact with a projected augmented reality feature via at least one of: touch and gesture; and wherein the guiding apparatus is configured to respond to at least one of the touch and the gesture.
2. The system of claim 1 , wherein the system is configured to perform a calibration process comprising:
placing a calibration target in the operational area;
projecting, by the illumination system, fiducials onto the calibration target;
determining, by the vision system, image information and spatial characteristics associated with the calibration target;
calibrating the illumination system based at least one of the image information and spatial characteristics;
projecting, by the calibrated illumination system, a calibration grid pattern onto the operational area;
sewing, by the guiding apparatus, a stitch pattern matching the calibration grid pattern; and
calibrating the vision system based at least on the stitch pattern.
3. The system of claim 1 , wherein the system is further configured to perform a patch sewing process comprising:
positioning a substrate in the operational area based at least on first augmented reality features projected by the illumination system;
removing from the substrate any abnormalities detected by the vision system;
positioning one or more patches at a position on the substrate based at least on second augmented reality features projected by the illumination system;
sewing, by the guiding apparatus, the one or more patches using a stitch pattern; and
determining, by the vision system, the stitch pattern of the one or more patches matches the second augmented reality features.
4. The system of claim 1 , wherein the illumination system comprises a bank of illumination sources comprising at least one of diode sources, laser sources, electric discharge sources, and incandescent sources; and wherein the bank of illumination sources is configured to provide uniform illumination and uniform positional accuracy of the augmented reality features throughout the operational area.
5. The system of claim 1 , wherein the projected augmented reality features comprise virtual user interface elements projected into the operational area.
6. The system of claim 1 , wherein the projected augmented reality features comprise visual indication of non-processable features.
7. The system of claim 1 , wherein the vision system is configured to detect abnormalities in the one or more operational objects; and wherein the projected augmented reality features comprise visual indication of detected abnormalities.
8. A computer implemented method of providing a projected assistive feature in an operational area of a guiding apparatus, the method comprising:
receiving a notification to assist with at least one of: substrate placement and patch placement; and
projecting into the operational area at least one of:
guiding imagery associated with at least one of: a position of the substrate and an orientation of the substrate based at least on a notification to assist with substrate placement; and
guiding imagery associated with at least one of: a position of the patch and an orientation of the patch based at least on a notification to assist with patch placement.
9. The method of claim 8 , wherein information related to at least one of substrate placement and patch placement is accessed from a patch library system.
10. The method of claim 8 , further comprising projecting virtual user interface elements into the operational area.
11. The method of claim 8 , further comprising:
detecting, by a vision system, user interaction with a projected assistive feature; and
performing, by the guiding apparatus, an operation based at least on the user interaction with the projected assistive feature; wherein the user interaction comprises at least one of: touch interaction and gesture interaction.
12. A guiding apparatus comprising:
an operational area;
a virtual light curtain system; and
an augmented reality system comprising:
a vision system, and
an illumination system,
wherein the augmented reality system is configured to project augmented reality features onto one or more operational objects.
13. The guiding apparatus of claim 12 , wherein the augmented reality system is configured to position the one or more operational objects for a subsequent stitching operation of the guiding apparatus along a predetermined path.
14. The guiding apparatus of claim 12 , further comprising a patch library system.
15. The guiding apparatus of claim 12 , further comprising at least one of a 3-dimensional vision system and a multi-patch multi-view system.
16. The guiding apparatus of claim 12 , further comprising a calibration process for the augmented reality system, the calibration process comprising:
placing a calibration target in the operational area;
projecting fiducials onto the calibration target;
determining, by the vision system, image information and spatial characteristics associated with the calibration target;
calibrating the illumination system based at least one of the image information and spatial characteristics;
projecting, by the calibrated illumination system, a calibration grid pattern onto the operational area;
sewing a stitch pattern matching the calibration grid pattern; and
calibrating the vision system based at least on the stitch pattern.
17. The guiding apparatus of claim 12 , further comprising a patch sewing process comprising:
positioning a substrate in the operational area based at least on first augmented reality features projected by the augmented reality system;
removing from the substrate any abnormalities detected by the vision system;
positioning one or more patches at a position on the substrate based at least on second augmented reality features projected by the augmented reality system;
sewing, by the guiding apparatus, the one or more patches using a stitch pattern; and
determining, by the vision system, the stitch pattern of the one or more patches matches the second augmented reality features.