IP Library › Granted Patent US 12,307,824
Granted Patent B2
US 12,307,824 · App. 17/421,098 · Granted May 20, 2025

System for capturing the movement pattern of a person

Inventors: Horst-Michael Groß (Ilmenau, DE); Andrea Scheidig (Ilmenau, DE); Thanh Quang Trinh (Ilmenau, DE); Benjamin Schütz (Ilmenau, DE); Alexander Vorndran (Ilmenau, DE); Andreas Bley (Niestetal, DE); Anke Mayfarth (Ilmenau, DE); Robert Arenknecht (Ilmenau, DE); Johannes Trabert (Ilmenau, DE); Christian Martin (Ilmenau, DE); Christian Sternitzke (Ilmenau, DE)
Assignee: TEDIRO Healthcare Robotics GmbH
G06V40/25G06V10/751
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,307,824
App. No.
17/421,098
Granted
May 20, 2025
Kind
B2
Abstract

A system and a method for capturing a movement pattern of a person. The method comprises capturing a plurality of images of the person executing a movement pattern by means of a non-contact sensor, the plurality of images representing the movements of the body elements of the person, generating at least one skeleton model having limb positions for at least some of the plurality of images, and calculating the movement pattern from the movements of the body elements of the person by comparing changes in the limb positions in the at least one skeleton model generated.

Claims (24)

1. A computer-implemented method for capturing a movement pattern of a person, the movement pattern comprising movements of body elements of the person, the method comprising the following:

capturing a plurality of images of the person when executing a movement pattern by means of a non-contact sensor, the plurality of images representing the movements of the body elements of the person;

generating at least one skeleton model having limb positions for at least some of the plurality of images;

calculating the movement pattern from the movements of the body elements of the person by comparing the changes in the limb positions in the at least one generated skeleton model;

comparing the calculated movement pattern to a predetermined movement pattern stored in a memory; and

a notification of when the movements in the captured movement pattern deviate from the movements in the predetermined movement pattern, wherein the number of output messages depends on the number and type of detected deviations of the movements.

2. The method of claim 1 , wherein the movement pattern is a gait pattern.

3. The method of claim 1 , wherein calculating the movement pattern comprises evaluating movements of the body elements over at least one complete gait cycle.

4. A method according to claim 1 , further comprising detecting at least one walking aid in the plurality of images by means of comparison to walking aid models.

5. The method of claim 3 , further comprising coherently evaluating the at least one walking aid and at least one foot skeleton point obtained from the skeleton model.

6. The method of claim 4 , wherein the evaluation comprises determining a difference between the at least one foot skeleton point and a ground-level end point of the at least one walking aid.

7. The method of claim 6 , wherein the difference is determined in the sagittal plane.

8. The method of claim 5 , wherein the evaluation is performed at a time of placement on the ground.

9. Apparatus for carrying out the method according to claim 1 .

10. A system for capturing a movement pattern of a person, the movement pattern comprising movements of body elements of the person, the system comprising the following:

at least one sensor for the non-contact capture of a large quantity of images of the person executing a movement pattern, with the quantity of images representing the movements of the body elements of the person;

a memory;

a processor, the processor executing a software-based evaluation module for calculating movements of the body elements of the person by comparing the generated skeleton models; and

an output unit for outputting messages upon detecting deviations between the movements of body elements and the predetermined movement pattern, wherein the output unit comprises at least one of a speaker, a display, and a projector, and wherein the number of the output messages depends on the number and type of detected deviations of the movements.

11. The system of claim 10 , wherein the movement pattern is a gait pattern.

12. The system of claim 10 , wherein the software-based evaluation module running on the processor, when operated, evaluates the positions of the body elements with the aid of walking aids over at least one gait cycle.

13. A system according to claim 10 , wherein the software-based evaluation module running on the processor evaluates a symmetry of the movement of the body elements during operation.

14. System according to claim 10 wherein the processor is further configured to process a segmentation algorithm for recognizing objects in the plurality of images.

15. The system of claim 10 , wherein the sensor is at least a 2D camera, a depth camera, an ultrasonic sensor, a radar sensor, or a LIDAR sensor.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2025
From: TEDIRO GMBH
To: TEDIRO HEALTHCARE ROBOTICS GMBH
Reel/Frame 071373/0444 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2023
From: METRALABS GMBH NEUE TECHNOLOGIEN UND SYSTEME
To: TEDIRO GMBH
Reel/Frame 064464/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2023
From: GROSS, HORST-MICHAEL, DR.; SCHEIDIG, ANDREA, DR.; TRINH, THANH QUANG; SCHÜTZ, BENJAMIN; VORNDRAN, ALEXANDER
To: METRALABS GMBH NEUE TECHNOLOGIEN UND SYSTEME
Reel/Frame 064435/0761 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2023
From: BLEY, ANDREAS, DR.; MAYFARTH, ANKE; ARENKNECHT, ROBERT; TRABERT, JOHANNES, DR.; MARTIN, CHRISTIAN, DR.; STERNITZKE, CHRISTIAN, DR.
To: METRALABS GMBH NEUE TECHNOLOGIEN UND SYSTEME
Reel/Frame 062891/0844 →
Priority Claims (2)
DE 10 2019 100 228.1 · Jan 7, 2019 · national
DE 10 2019 116 848.1 · Jun 21, 2019 · national
Continuity (1)
Related Publication 20220108561A1 · Apr 7, 2022
References Cited (41)
US 7450024B2 · Fleck et al. · 2008 [cited by applicant]
US 8279060B2 · Liu et al. · 2012 [cited by applicant]
US 20080045804A1 · Williams · 2008 [cited by examiner]
US 20110152726A1 · Cuddihy · 2011 [cited by examiner]
US 20150310629A1 · Utsunomiya · 2015 [cited by examiner]
US 20160066820A1 · Sales · 2016 [cited by examiner]
US 20160125626A1 · Wang · 2016 [cited by examiner]
CN 101862245A · 2010 [cited by applicant]
CN 203338133U · 2013 [cited by applicant]
CN 203527474U · 2014 [cited by applicant]
CN 104889994A · 2015 [cited by applicant]
CN 105078445B · 2015 [cited by applicant]
CN 105078450B · 2015 [cited by applicant]
CN 105082149B · 2015 [cited by applicant]
CN 204772554U · 2015 [cited by applicant]
CN 106407715A · 2017 [cited by applicant]
CN 205950753U · 2017 [cited by applicant]
CN 106671105A · 2017 [cited by applicant]
CN 106709254B · 2017 [cited by applicant]
CN 107518989A · 2017 [cited by applicant]
CN 107544266A · 2018 [cited by applicant]
CN 107598943A · 2018 [cited by applicant]
CN 206833244U · 2018 [cited by applicant]
CN 108039193A · 2018 [cited by applicant]
CN 108053889A · 2018 [cited by applicant]
CN 108073104A · 2018 [cited by applicant]
CN 105078449B · 2018 [cited by applicant]
CN 108422427A · 2018 [cited by applicant]
Naoaki Tsuda, et al., “Measurement and evaluation of crutch walk motion by Kinect sensor”, Mechanical Engineering Journal, vol. 3, No. 6, , Dec. 5, 2016, pp. 15-00472. [cited by applicant]
Jaeschke, B., Vorndran, A., Trinh,T.Q., Scheidig, A., Gross, H.-M., Sander, K., Layher, F. “Making Gait Training Mobile—A Feasibility Analysis” in: IEEE Int. Conf. on Biomedical Robotics and Biomechatronics (Biorob), En… [cited by applicant]
Trinh, T.Q., Wengefeld, T., Mueller, St., Vorndran, A., Volkhardt, M., Scheidig, A., Gross, H.-M. “Take a seat, please”: Approaching and Recognition of Seated Persons by a Mobile Robot. in: Int. Symposium on Robotics (I… [cited by applicant]
Vorndran, A., Trinh, T.Q., Mueller, St., M., Scheidig, A., Gross, H.-M., “How to Always Keep an Eye on the User with a Mobile Robot?” in: Int. Symposium on Robotics (ISR), Munich, Germany, pp. 219-225, VDE Verlag 2018. [cited by applicant]
Götz-Neumann, “Gehen verstehen”, Thieme-Verlag, 2016, Chapter 2. [cited by applicant]
Smolenski et al, “Janda, Manuelle Muskelfunktionsdiagnostik” (Elsevier-Verlag, 2016), Chapter 6. [cited by applicant]
Borchani et al, “A survey on multi-output regression”, WIREs Data Mining Knowl Discov Jul. 15, 2015, DOI: 10.1002/widm.1157. [cited by applicant]
Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh. OpenPose: “Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields”; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 7291-729… [cited by applicant]
G. Guidi, S. Gonizzi, L. Mico, 3D Capturing Performances of Low-Cost Range Sensors for Mass-Market Applications, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XL… [cited by applicant]
Fox, W. Burgard and S. Thrun, “The dynamic window approach to collision avoidance,” in IEEE Robotics & Automation Magazine, vol. 4, No. 1, pp. 23-33, Mar. 1997. [cited by applicant]
Müller S., Trinh T.Q., Gross HM. (2017) Local Real-Time Motion Planning Using Evolutionary Optimization. In: Gao Y., Fallah S., Jin Y., Lekakou C. (eds) Towards Autonomous Robotic Systems. TAROS 2017. Lecture Notes in C… [cited by applicant]
R. Philippsen and R. Siegwart, “An Interpolated Dynamic Navigation Function,” Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, 2005, pp. 3782-3789. [cited by applicant]
Borchani, H. , Varando, G. , Bielza, C. and Larrañaga, P. (2015), A survey on multi-output regression. WIREs Data Mining and Knowledge Discovery, 5: 216-233. DOI: 10.1002/widm.1157. [cited by applicant]
Cited By (1)
US 12,576,812