IP Library Granted Patent US 11,731,283
Granted Patent B2
US 11,731,283 · App. 17/151,259 · Granted Aug 22, 2023

Method for checking a safety area of a robot

Inventors: Andreas Huber (Stallhofen, AT); Tomaz Kukovec (Makole, SI); Christoph Monschein (Jagerberg, AT)
Assignee: MAGNA STEYR FAHRZEUGTECHNIK GMBH & CO KG
B25J13/06B25J9/1666G06T11/00G06V20/10B25J9/1671B25J19/0095
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,731,283
App. No.
17/151,259
Granted
Aug 22, 2023
Kind
B2
Abstract

A method for checking a safety area of a robot with an augmented reality human machine interface (AR-HMI) that comprises a display and a video camera. The method includes: acquiring, at the AR-HMI, a robot type of the robot, displaying, in the display of the AR-HMI, a virtual robot image of at least part of a robot of the robot type in a manner such that the virtual robot image overlays an actual robot image of the robot of the robot type in the video camera of the AR-HMI, aligning a position of the virtual robot image with a position of the actual robot image by moving the AR-HMI in three-dimensional space, confirming the alignment of the position between the virtual robot image and the actual robot image, and displaying a virtual first safety cell area around the virtual robot image in the confirmed position as an overlay of the actual robot image in the display of the AR-HMI.

Claims (34)

1. A method for checking a safety area of a robot with an augmented reality human machine interface (AR-HMI) that comprises a display and a video camera, the method comprising:

acquiring, at the AR-HMI, a robot type;

displaying, in the display of the AR-HMI, a virtual robot image of at least part of a robot of the acquired robot type in a manner such that the virtual robot image overlays an actual robot image of the robot of the acquired robot type in the video camera of the AR-HMI;

aligning a position of the virtual robot image with a position of the actual robot image by moving the AR-HMI in three-dimensional space;

confirming the alignment of the position between the virtual robot image and the actual robot image;

displaying, in response to confirming the alignment of the position, a virtual first safety cell area around the virtual robot image in the confirmed position as an overlay of the actual robot image in the display of the AR-HMI for positioning a reference coordinate system in a base of the robot;

displaying a virtual second safety cell area around the virtual robot image in the confirmed position as an overlay of the real or actual image in the display of the AR-HMI for positioning the reference coordinate system in the base of the robot; and

displaying a working space and a protected space, taking into consideration at least one current axis position of the robot, for positioning the reference coordinate system in the base of the robot.

2. The method of claim 1 , wherein the virtual first safety cell area has a shape of a cube, or a cuboid, or a prism.

3. The method of claim 1 , wherein acquiring the robot type comprises capturing a physical identifier of the robot type with the video camera of the AR-HMI, the physical identifier of the robot type comprising an alphanumeric label of the robot type.

4. The method of claim 1 , wherein the virtual second safety cell area has a defined distance from the virtual first safety cell area.

5. The method of claim 1 , further comprising, before displaying the virtual first safety cell area and/or the virtual second safety cell area, reading, by the AR-HMI, a planned safety configuration from a data memory, and then displaying the virtual first safety cell area and/or the virtual second safety cell area based on the planned safety configuration.

6. The method of claim 1 , further comprising, before displaying the virtual first safety cell area and/or the virtual second safety cell area, transmitting to the AR-HMI a planned safety configuration, and then displaying the virtual first safety cell area and/or the second safety cell area based on the planned safety configuration.

7. The method of claim 1 , wherein:

the AR-HMI further comprises at least one stationary computer and at least one mobile computer, and

the at least one mobile computer comprises the display and the video camera.

8. The method of claim 7 , wherein the at least one mobile computer comprises as augmented reality (AR) glasses.

9. The method of claim 1 , further comprising acquiring current axis positions of the robot, via transmission from the robot to the AR-HMI, or via the video camera of the AR-HMI.

10. The method of claim 9 , further comprising determining, using the current axis positions, a flange centre point via forward transformation.

11. The method of claim 10 , further comprising displaying at least one virtual safe tool space, having a spherical shape, around the flange centre point as an overlay of the actual robot image in the display of the AR-HMI.

12. The method of claim 1 , further comprising displaying at least one working space in the display of the AR-HMI.

13. The method of claim 1 , further comprising displaying at least one protected space in the display of the AR-HMI.

14. The method of claim 3 , wherein the physical identifier of the robot type comprises a QR code.

15. The method of claim 1 , wherein acquiring the robot type comprises a user selecting the robot type at the AR-HMI.

16. A method for checking a safety area of a robot, the method comprising:

acquiring a robot of a specific robot type via an augmented reality human machine interface (AR-HMI) that comprises a display and a video camera;

displaying, in the display of the AR-HMI, a virtual robot image of an area of a base of the acquired robot in a manner such that the virtual robot image overlays an actual robot image of the acquired robot in the video camera of the AR-HMI;

aligning a position of the virtual robot image with a position of the actual robot image by moving the AR-HMI in three-dimensional space;

confirming the alignment of the position between the virtual robot image and the actual robot image;

displaying a virtual first safety cell area and a virtual second safety cell area around the virtual robot image in the confirmed position as an overlay of the actual robot image in the display of the AR-HMI for positioning a reference coordinate system in a base of the acquired robot;

displaying a working space and a protected space, taking into consideration at least one current axis position of the acquired robot, for positioning the reference coordinate system in the base of the acquired robot.

17. The method of claim 16 , wherein acquiring the robot type comprises capturing a physical identifier of the robot type with the video camera of the AR-HMI, the physical identifier of the robot type comprising an alphanumeric label of the robot type.

18. The method of claim 17 , wherein the physical identifier of the robot type comprises a QR code.

19. The method of claim 16 , wherein acquiring the robot type comprises a user selecting the robot type at the AR-HMI.

Assignments (2)
CHANGE OF NAME Recorded Mar 22, 2023
From: MAGNA STEYR FAHRZEUGTECHNIK AG & CO KG
To: MAGNA STEYR FAHRZEUGTECHNIK GMBH & CO KG
Reel/Frame 063056/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2021
From: HUBER, ANDREAS; KUKOVEC, TOMAZ; MONSCHEIN, CHRISTOPH
To: MAGNA STEYR FAHRZEUGTECHNIK AG & CO KG
Reel/Frame 054943/0032 →
Priority Claims (1)
DE 102020201375.6 · Feb 5, 2020 · national
Continuity (1)
Related Publication 20210237278A1 · Aug 5, 2021