Granted Patent B2

US 12,353,187 · App. 17/624,529 · Granted Jul 8, 2025

Inventors: Alexander Bley (Munich, DE); Tim Doerks (Munich, DE); Till Rickert (Munich, DE)

Assignee: SEWTS GMBH

G05B19/402G05B2219/50047

Abstract

Claims (43)

1. A method of positioning a limp flat workpiece using a positioning device which includes at least one control unit, a camera, at least one first gripper and at least one second gripper, the method comprising the steps of:

a) providing the flat workpiece in a random state on a manipulation surface;

b) generating, by the camera, a camera image showing the flat workpiece;

c) identifying, by a first machine learning module of the control unit, a grippable edge of the flat workpiece by extracting characteristic image features of the camera image;

d) determining, by a second machine learning module of the control unit, a first gripping point for the first gripper at the grippable edge; and

e) determining, by the second machine learning module of the control unit, a second gripping point for the second gripper at the grippable edge, the second gripping point being spaced apart from the first gripping point,

wherein the flat workpiece is held by the second gripper and the first gripper is moved along the gripped edge until the first gripper grips a first corner of the flat workpiece, and/or

the flat workpiece is held by the first gripper and the second gripper is moved along the gripped edge until the second gripper grips a second corner of the flat workpiece, and

wherein prior to generating the camera image, an area of contact of the flat workpiece with the manipulation surface is enlarged starting from a random state.

2. The method according to claim 1 , wherein the flat workpiece is gripped in an automated manner by the first gripper and the second gripper, the first gripper gripping at the first gripping point and the second gripper gripping at the second gripping point.

3. The method according to claim 2 , wherein the flat workpiece is deposited in a flat state by the first gripper and the second gripper.

4. The method according to claim 1 , wherein for moving along with the first gripper, a gripping force of the first gripper is reduced in comparison to a gripping force of the second gripper, or the first gripper is opened by a specified amount.

5. The method according to claim 1 , wherein for moving along with the second gripper, a gripping force of the second gripper is reduced in comparison to a gripping force of the first gripper, or the second gripper is opened by a specified amount.

6. The method according to claim 1 , wherein prior to identifying the grippable edge, a type of the flat workpiece is identified by a third machine learning module of the control unit.

7. The method according to claim 6 , wherein the third machine learning module includes a trained artificial neural network configured to receive the camera image or partial images of the camera image for extracting characteristic image features.

8. The method according to claim 1 , wherein the first machine learning module includes a trained artificial neural network configured to receive the camera image or partial images of the camera image for extracting characteristic image features.

9. The method according to claim 1 , wherein for identifying the grippable edge, the camera image is subdivided into a plurality of partial images, and characteristic image features are extracted by the first machine learning module of the control unit for each partial image and, based on the characteristic image features, for each partial image a probability is established with which it shows an edge of the flat workpiece.

10. The method according to claim 1 , wherein the first gripping point and the second gripping point are determined in a section of the flat workpiece for the imaging of which in the camera image or in an associated partial image the relatively highest probability with which the camera image or the partial image shows an edge has been established by the first machine learning module.

11. The method according to claim 1 , wherein the second machine learning module includes a trained artificial neural network which, for determining the first gripping point and the second gripping point, receives the camera image or at least one partial image of the camera image and extracts characteristic image features of the camera image or of the at least one partial image, wherein, based on the characteristic image features, gripping coordinates and a gripping orientation are calculated for the first gripper and/or gripping coordinates and a gripping orientation are calculated for the second gripper.

12. The method according to claim 1 , wherein the flat workpiece is provided in a folded state on a manipulation surface in step a).

13. A method of positioning a limp flat workpiece using a positioning device which includes at least one control unit, a camera, at least one first gripper and at least one second gripper, the method comprising the steps of:

a) providing the flat workpiece in a random state on a manipulation surface;

b) generating, by the camera, a camera image showing the flat workpiece;

c) identifying, by a first machine learning module of the control unit, a grippable edge of the flat workpiece by extracting characteristic image features of the camera image;

d) determining, by a second machine learning module of the control unit, a first gripping point for the first gripper at the grippable edge; and

e) determining, by the second machine learning module of the control unit, a second gripping point for the second gripper at the grippable edge, the second gripping point being spaced apart from the first gripping point,

wherein prior to generating the camera image, an area of contact of the flat workpiece with the manipulation surface is enlarged starting from the random state.

14. A method of positioning a limp flat workpiece using a positioning device which includes at least one control unit, a camera, at least one first gripper and at least one second gripper, the method comprising the steps of:

a) providing the flat workpiece in a random state on a manipulation surface;

b) generating, by the camera, a camera image showing the flat workpiece;

c) identifying, by a first machine learning module of the control unit, a grippable edge of the flat workpiece by extracting characteristic image features of the camera image;

d) determining, by a second machine learning module of the control unit, a first gripping point for the first gripper at the grippable edge; and

e) determining, by the second machine learning module of the control unit, a second gripping point for the second gripper at the grippable edge, the second gripping point being spaced apart from the first gripping point,

wherein the first gripper and the second gripper grip the first and second gripping points respectively of the flat workpiece lying on the manipulation surface, and

wherein prior to generating the camera image, an area of contact of the flat workpiece with the manipulation surface is enlarged starting from the random state.

15. The method according to claim 14 , wherein the area of contact of the flat workpiece with the manipulation surface is enlarged by a ventilation unit comprising a plurality of outflow openings.

16. The method according to claim 14 , wherein the flat workpiece is provided via a drop distance delimited by a ventilation unit comprising a plurality of outflow openings.

17. The method according to claim 14 , wherein prior to identifying the grippable edge, a type of the flat workpiece is identified by a third machine learning module of the control unit.

18. The method according to claim 14 , wherein for moving along with the first gripper, a gripping force of the first gripper is reduced in comparison to a gripping force of the second gripper, or wherein for moving along with the second gripper, a gripping force of the second gripper is reduced in comparison to a gripping force of the first gripper.

19. The method according to claim 14 , wherein

the flat workpiece is held by the second gripper and the first gripper is moved along the gripped edge until the first gripper grips a first corner of the flat workpiece, and/or

the flat workpiece is held by the first gripper and the second gripper is moved along the gripped edge until the second gripper grips a second corner of the flat workpiece.

20. The method according to claim 14 , wherein prior to generating the camera image, an area of contact of the flat workpiece with the manipulation surface is enlarged starting from the random state.

Assignments (1)

Continuity (1)

References Cited (48)