IP Library › Granted Patent US 12,353,215
Granted Patent B2
US 12,353,215 · App. 17/797,900 · Granted Jul 8, 2025

Method and a system for conveying a robot in an elevator

Inventor: Christian Sternitzke (Leipzig Sachsen, DE)
Assignee: METRALABS GMBH NEUE TECHNOLOGIEN UND SYSTEME
G05D1/0225B66B1/468G06T7/70G06V10/764G06V20/52G06V40/10B66B2201/463G05D1/0242G05D1/0246G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,353,215
App. No.
17/797,900
Granted
Jul 8, 2025
Kind
B2
Abstract

The invention comprises a method and a system for conveying a mobile robot in an elevator involving the monitoring of elevator operating components and of persons surrounding the elevator and operating the elevator by selecting a floor to which the mobile robot is to move. In one aspect an inertial sensor is used to learn or determine the number of floors. The robot may also have methods implemented to assess the floor space inside the elevator or to position itself in front of the elevator in such a way that it can, for example, monitor the operation of elevator operating components without being perceived as an obstacle from the elevator users' perspective.

Claims (45)

1. A computer-implemented method for monitoring an elevator comprising a robot,

wherein the robot comprises a sensor system and at least one output unit, and

wherein the computer-implemented method comprises:

the robot leveraging the sensor system to detect one or more persons in a vicinity of the robot;

the robot leveraging the sensor system to detect an elevator operating component for the elevator;

the robot leveraging the sensor system to monitor the elevator operating component;

the robot leveraging the sensor system to detect a selected floor based on said leveraging of the sensor system to monitor the elevator operating component; and

the robot leveraging the at least one output unit to prompt at least one of the one or more detected persons to select a predetermined floor using the elevator operating component.

2. The method according to claim 1 , wherein the robot leveraging the sensor system to monitor the elevator operating component comprises the robot leveraging the sensor system to monitor body part positions of at least one of the one or more detected persons when selecting the selected floor using the elevator operating component.

3. The method according to claim 2 , wherein:

the robot leveraging the sensor system to monitor comprises the robot leveraging the sensor system to determine a distance between the elevator operating component and the body part positions of the at least one of the one or more detected persons.

4. The method according to claim 3 , further comprising:

triggering an event when the distance between the elevator operating component and the body part positions of the at least one of the one or more detected persons falls below a threshold value.

5. The method according to claim 4 , wherein the event comprises at least one of the group of calling the elevator, selecting the predetermined floor, or requesting one of the one or more persons in the vicinity of the robot to select the predetermined floor using the elevator operating component.

6. The method according to claim 1 , wherein the robot leveraging the sensor system to detect one or more persons in the vicinity of the robot comprises the robot leveraging a person-recognition module thereof to create a skeleton model of at least one person of the one or more persons in the vicinity of the robot.

7. The method according to claim 6 , wherein the robot leveraging the sensor system to monitor the elevator operating component is carried out on the basis of recorded joint points from the skeleton model.

8. The method according to claim 1 , wherein the robot leveraging the sensor system to monitor the elevator operating component includes the robot capturing an image and classifying the captured image.

9. The method according to claim 1 , further comprising:

the robot leveraging the sensor system to detect an elevator display element; and

the robot accessing memory associated with the robot and a classification database stored in the memory to identify a floor at which the elevator is located based upon the detected elevator display element.

10. The method according to claim 9 , further comprising:

the robot leveraging the memory to compare the identified floor at which the elevator is located with the predetermined floor based upon patterns stored in the memory.

11. The method according to claim 1 , further comprising:

the robot leaving the elevator based upon the comparing of the identified floor at which the elevator is located with the predetermined floor upon reaching the predetermined floor.

12. The method according to claim 1 , further comprising:

the robot leveraging a motion planner to place the robot in a robot position in front of the elevator, wherein the leveraging of the motion planner selects the robot position such that a distance between the robot position and an elevator door from the elevator depends on a predetermined speed of the robot and an opening time of the elevator door or on the probability of hitting a moving obstacle.

13. The method according to claim 1 , further comprising:

the robot leveraging the sensor system to determine whether the elevator has a free area sufficiently large to receive the robot in the elevator; and

the robot determining whether to enter the elevator based upon the determination of whether the elevator has the free area sufficiently large to receive the robot in the elevator.

14. The method according to claim 1 , wherein when the elevator is located on a first floor that is different than a second floor at which the robot is located, the method further comprises:

the robot sending a signal to a signaling system located in the elevator, the signal system comprising a receiving unit and an output unit; and

leveraging the output unit of the signaling system to, upon receiving the signal, signal at least one person on the elevator to actuate the elevator operating component to select the second floor on which the robot is located.

15. A robot comprising:

a sensor system configured to:

detect one or more persons in a vicinity of the robot;

detect an elevator operating component for the elevator;

monitor the elevator operating component; and

detect a selected floor based on the monitored elevator operating component; and

an output unit configured to prompt at least one of the one or more detected persons to select a predetermined floor using the elevator operating component.

16. The robot according to claim 15 , wherein the sensor system is configured to monitor body part positions of the at least one of the one or more detected persons when selecting the floors using the elevator operating component.

17. The robot according to claim 16 , wherein the sensor system is configured to determine a distance between the elevator operating component and the body part positions of the at least one of the one or more detected persons.

18. The robot according to claim 15 , wherein the sensor system comprises a person-recognition module configured to create a skeleton model of the at least one person of the one or more persons in the vicinity of the robot.

19. The robot according to claim 18 , wherein the sensor system is configured to monitor the elevator operating component based on recorded joint points from the skeleton model.

20. The robot according to claim 15 , further comprising:

a transmitter configured to send a signal to a signaling system located in the elevator when the elevator is located at a first floor that is different than a second floor on which the robot is located, wherein signaling system comprises a receiving unit and an output unit, and wherein the output unit is configured to signal at least one person on the elevator to actuate the elevator operating component to select the second floor on which the robot is located.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2022
From: STERNITZKE, CHRISTIAN
To: METRALABS GMBH NEUE TECHNOLOGIEN UND SYSTEME
Reel/Frame 060734/0873 →
Priority Claims (1)
DE 10 2020 103 308.7 · Feb 10, 2020 · national
Continuity (1)
Related Publication 20230039466A1 · Feb 9, 2023
References Cited (19)
US 20190218060A1 · Koba · 2019 [cited by applicant]
US 20190248013A1 · Deyle · 2019 [cited by applicant]
CN 108002154A · 2018 [cited by applicant]
JP 2002302353A · 2002 [cited by applicant]
Kang, Jeong-Gwan, Su-Yong An, Won-Seok Choi, and Se-Young Oh. “Recognition and path planning strategy for autonomous navigation in the elevator environment.” International Journal of Control, Automation and Systems 8 (2… [cited by examiner]
Kang, Jeong-Gwan, Su-Yong An, and Se-Young Oh. “Navigation strategy for the service robot in the elevator environment.” In 2007 International Conference on Control, Automation and Systems, pp. 1092-1097. IEEE, 2007. [cited by examiner]
McAree, Owen, Jonathan M. Aitken, Luke Boorman, David Cameron, Adriel Chua, Emily C. Collins, Samuel Fernando, James Law, and Uriel Martinez-Hernandez. “Floor determination in the operation of a lift by a mobile guide r… [cited by examiner]
An, Su-Yong, Jeong-Gwan Kang, Won-Seok Choi, and Se-Young Oh. “A neural network based retrainable framework for robust object recognition with application to mobile robotics.” Applied Intelligence 35 (2011): 190-210. [cited by examiner]
Veloso, Manuela M., Joydeep Biswas, Brian Coltin, Stephanie Rosenthal, Susana Brandao, Tekin Mericli, and Rodrigo Ventura. “Symbiotic-autonomous service robots for user-requested tasks in a multi-floor building.” (2012). [cited by examiner]
Jiang, Shenlu, Wei Yao, Man-Sing Wong, Meng Hang, Zhonghua Hong, Eun-Jin Kim, Sung-Hyeon Joo, and Tae-Yong Kuc. “Automatic elevator button localization using a combined detecting and tracking framework for multi-story n… [cited by examiner]
Troniak, Daniel, Junaed Sattar, Ankur Gupta, James J. Little, Wesley Chan, Ergun Calisgan, Elizabeth Croft, and Machiel Van der Loos. “Charlie rides the elevator . . . ” In 2013 international conference on computer and … [cited by examiner]
Backhaus, Nils, Patricia H. Rosen, Andrea Scheidig, Horst-Michael Gross, and Sascha Wischniewski. “Somebody help me, please?! interaction design framework for needy mobile service robots.” In 2018 IEEE workshop on advan… [cited by examiner]
Rosenthal, Stephanie, Manuela Veloso, and Anind K. Dey. “Task behavior and interaction planning for a mobile service robot that occasionally requires help.” In Workshops at the Twenty-Fifth AAAI Conference on Artificial… [cited by examiner]
Islam, Kh Tohidul, Ghulam Mujtaba, Ram Gopal Raj, and Henry Friday Nweke. “Elevator button and floor No. recognition through hybrid image classification . . . ” In 2017 International Conference on Engineering Technology… [cited by examiner]
Zhao, Junxin, Yujing Chen, and Yunjiang Lou. “A human-aware robotic system for mobile robot navigating in multi-floor building with elevator.” In 2019 WRC Symposium on Advanced Robotics and Automation (WRC SARA), pp. 17… [cited by examiner]
Zhu, Delong, Tingguang Li, Danny Ho, Tong Zhou, and Max QH Meng. “A novel OCR-RCNN for elevator button recognition.” In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3626-3631. IEE… [cited by examiner]
Dong, Zijian, Delong Zhu, and Max Q-H. Meng. “An autonomous elevator button recognition system based on convolutional neural networks.” In 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 2533… [cited by examiner]
Kim, Heon-Hui, Dae-Jin Kim, and Kwang-Hyun Park. “Robust elevator button recognition in the presence of partial occlusion and clutter by specular reflections.” IEEE Transactions on Industrial Electronics 59, No. 3 (2011… [cited by examiner]
International Search Report and Written Opinion of PCT International Application No. PCT/EP2021/053113, dated Jun. 15, 2021. [cited by applicant]
Cited By (2)
US 12,662,351 US 12,717,346