IP Library › Granted Patent US 12,533,807
Granted Patent B2
US 12,533,807 · App. 18/350,743 · Granted Jan 27, 2026

Robotic apparatus and control method thereof

Inventors: Carlos Ma (Guangdong, CN); Yueqiang Lu (Guangdong, CN)
Assignee: CORNERSTONE TECHNOLOGY (SHENZHEN) LIMITED
B25J9/1664A61B34/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,533,807
App. No.
18/350,743
Filed
Jul 11, 2023
Granted
Jan 27, 2026
Kind
B2
Art Unit
3656
USPC
700/245
Abstract

The present disclosure provides robot apparatus and a control method thereof. The robotic apparatus includes an executing device and a driving device. The method includes: acquiring inertial sensing data from at least one inertial sensor disposed on one or both of the executing device and the driving device; performing data fusion on at least the inertial sensing data to obtain fused data of the robotic apparatus; and determining an operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status. In the present disclosure, inertial sensing data is detected by inertial sensor and data fusion and analysis are performed.

Claims (104)

1 . A method for controlling a robotic apparatus, wherein the robotic apparatus comprises an executing device on which an executing instrument is mounted and a driving device configured to drive the executing device to move on the driving device, and wherein the method comprises:

acquiring inertial sensing data from at least one inertial sensor disposed on one or both of the executing device and the driving device;

performing data fusion on at least the inertial sensing data to obtain fused data of the robotic apparatus; and

determining an operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status,

wherein the robotic apparatus further comprises a transmission device mechanically connected to the driving device and configured to move the driving device;

wherein performing the data fusion on at least the inertial sensing data to obtain the fused data of the robotic apparatus, comprises:

acquiring a control signal of the robotic apparatus;

fusing the inertial sensing data and the control signal to obtain the fused data;

calculating an output angle of the transmission device based on the inertial sensing data;

calculating, each time, a respective difference between the output angle of the transmission device and an input angle of the transmission device; and

estimating an unrecoverable consumption in the transmission device based on a mathematical kinematic model for the transmission device and one or both of a change and a rate of change in neighboring differences, the unrecoverable consumption indicating unrecoverable degradation of the transmission device; and

wherein determining the operation status of the robotic apparatus based on the fused data, comprises:

determining whether the unrecoverable consumption exceeds a preset consumption, and determining remaining usage time or a remaining usage number of times of the transmission device based on the unrecoverable consumption.

2 . The method according to claim 1 , wherein performing the data fusion on the inertial sensing data, further comprises:

calculating one or more of an actual pitching angle, an actual rolling angle and an actual yawing angle of the driving device based on at least the inertial sensing data; and

wherein determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status, comprises:

in response to one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle being not synchronized with one or more respective target angles, determining that the robotic apparatus is working abnormally; and

in response to the robotic apparatus being working abnormally, controlling the robotic apparatus to stop working.

3 . The method according to claim 2 , wherein before determining that the robotic apparatus is working abnormally, determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status, further comprises:

determining whether each of the actual pitching angle, the actual rolling angle and the actual yawing angle falls within a respective preset angle range, wherein the respective preset angle range comprises a respective target angle of the one or more respective target angles; and

in response to one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle not falling within the respective preset angle range, determining that one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle are not synchronized with the one or more respective target angles.

4 . The method according to claim 1 , wherein determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus according to the operation status, comprises:

calculating one or more respective synchronization rates for one or more of an actual pitching angle, an actual rolling angle and an actual yawing angle based on one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle and one or more respective target angles;

determining whether each synchronization rate of the one or more respective synchronization rates for one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle is greater than or equal to a respective synchronization rate threshold; and

in response to at least one synchronization rate of the one or more respective synchronization rates for one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle being less than one or more respective synchronization rate thresholds, determining that the robotic apparatus is working abnormally and controlling the robotic apparatus to stop working.

5 . The method according to claim 4 , wherein determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status, further comprises:

calculating, based on the one or more respective synchronization rates for one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle, one or more respective changes in the one or more respective synchronization rates for one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle within a first preset time period; and

in response to the one or more respective changes within the first preset time period exceeding one or more respective change thresholds, determining that the robotic apparatus is working abnormally and controlling the robotic apparatus to stop working.

6 . The method according to claim 1 , comprising:

using a complementary algorithm, an algorithm based on noise models, or an algorithm based on particle swarm optimization to perform the data fusion on at least the inertial sensing data to obtain the fused data of the robotic apparatus.

7 . The method according to claim 1 , wherein the inertial sensing data comprises one or more of acceleration data, angular velocity data, and direction data.

8 . A robotic apparatus, comprising:

an executing device, on which an executing instrument is mounted;

a driving device, mechanically connected to the executing device and configured to drive the executing device to move on the driving device;

at least one processor; and

a memory being communicatively coupled to the at least one processor;

wherein the memory is configured to store instructions, which, when executed by the at least one processor, cause the at least one processor to implement operations of the method of claim 1 .

9 . The robotic apparatus according to claim 8 , wherein performing the data fusion on the inertial sensing data, further comprises:

calculating one or more of an actual pitching angle, an actual rolling angle and an actual yawing angle of the driving device based on at least the inertial sensing data; and

wherein determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status, comprises:

in response to one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle being not synchronized with one or more respective target angles, determining that the robotic apparatus is working abnormally; and

in response to the robotic apparatus being working abnormally, controlling the robotic apparatus to stop working.

10 . The robotic apparatus according to claim 9 , wherein before determining that the robotic apparatus is working abnormally, determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status, further comprises:

determining whether each of the actual pitching angle, the actual rolling angle and the actual yawing angle falls within a respective preset angle range, wherein the respective preset angle range comprises a respective target angle of the one or more respective target angles; and

in response to one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle not falling within the respective preset angle range, determining that one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle are not synchronized with the one or more respective target angles.

11 . The robotic apparatus according to claim 8 , wherein determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus according to the operation status, comprises:

calculating one or more respective synchronization rates for one or more of an actual pitching angle, an actual rolling angle and an actual yawing angle based on one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle and one or more respective target angles;

determining whether each synchronization rate of the one or more respective synchronization rates for one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle is greater than or equal to a respective synchronization rate threshold; and

in response to at least one synchronization rate of the one or more respective synchronization rates for one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle being less than one or more respective synchronization rate thresholds, determining that the robotic apparatus is working abnormally and controlling the robotic apparatus to stop working.

12 . The robotic apparatus according to claim 11 , wherein determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status, further comprises:

calculating, based on the one or more respective synchronization rates for one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle, one or more respective changes in the one or more respective synchronization rates for one or more of the actual pitching angle, the actual rolling angle and the actual yawing angle within a first preset time period; and

in response to the one or more respective changes within the first preset time period exceeding one or more respective change thresholds, determining that the robotic apparatus is working abnormally and controlling the robotic apparatus to stop working.

13 . A control device, comprising:

at least one processor; and

a memory being in communication connection with the at least one processor;

wherein the memory is configured to store instructions, which, when executed by the at least one processor, causes the at least one processor to implement operations of the method of claim 1 .

14 . The method according to claim 1 , wherein the transmission device comprises a transmission strip, and the unrecoverable consumption refers to unrecoverable elongation of the transmission strip.

15 . A method for controlling a robotic apparatus, wherein the robotic apparatus comprises an executing device on which an executing instrument is mounted and a driving device configured to drive the executing device to move on the driving device, and wherein the method comprises:

acquiring inertial sensing data from at least one inertial sensor disposed on one or both of the executing device and the driving device;

performing data fusion on at least the inertial sensing data to obtain fused data of the robotic apparatus; and

determining an operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status;

wherein the robotic apparatus further comprises a transmission device mechanically connected to the driving device and configured to move the driving device, and a force providing device mechanically connected to the transmission device and configured to provide a driving force to the transmission device, and the inertial sensing data comprises acceleration data;

wherein performing the data fusion on at least the inertial sensing data, comprises:

acquiring a control signal of the robotic apparatus;

fusing the inertial sensing data and the control signal to obtain the fused data;

acquiring actual input current data of the force providing device; and

estimating theoretical acceleration data of the transmission device based on the actual input current data and a mathematical kinematic model for the transmission device; and

wherein determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status, comprises:

determining whether a collision occurs on the robotic apparatus based on the theoretical acceleration data and the acceleration data; and

in response to determining that a collision occurs on the robotic apparatus, controlling the robotic apparatus to stop working.

16 . The method according to claim 15 , wherein

the control signal comprises one or more of an output signal of the force providing device, an input signal of the transmission device, and an output signal of the driving device.

17 . A robotic apparatus, comprising:

an executing device, on which an executing instrument is mounted;

a driving device mechanically connected to the executing device and configured to drive the executing device to move on the driving device;

a transmission device mechanically connected to the driving device and configured to move the driving device;

a force providing device mechanically connected to the transmission device and configured to provide a driving force to the transmission device;

at least one processor; and

a memory being communicatively coupled to the at least one processor;

wherein the memory is configured to store instructions, which, when executed by the at least one processor, cause the at least one processor to implement operations of the method of claim 7 .

18 . A method for controlling a robotic apparatus, wherein the robotic apparatus comprises an executing device on which an executing instrument is mounted and a driving device configured to drive the executing device to move on the driving device, and wherein the method comprises:

acquiring inertial sensing data from at least one inertial sensor disposed on one or both of the executing device and the driving device;

performing data fusion on at least the inertial sensing data to obtain fused data of the robotic apparatus; and

determining an operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status;

wherein the robotic apparatus further comprises: a transmission device mechanically connected to the driving device and configured to move the driving device, a force providing device mechanically connected to the transmission device and configured to provide a driving force to the transmission device, and an adjusting device mechanically connected to the force providing device and configured to adjust one or more of a position and an orientation of the force providing device;

wherein performing the data fusion on at least the inertial sensing data, comprises:

acquiring a control signal of the robotic apparatus;

fusing the inertial sensing data and the control signal to obtain the fused data;

calculating deformation data of the transmission device based on the inertial sensing data, the deformation data indicating a deformation degree of the transmission device initiated by a user; and

calculating magnitude and a direction of a force applied by a user on the driving device based on the deformation data; and

wherein determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status, comprises:

controlling at least one angle of the adjusting device based on the magnitude and the direction of the force.

19 . A robotic apparatus, comprising:

an executing device, on which an executing instrument is mounted;

a driving device mechanically connected to the executing device and configured to drive the executing device to move on the driving device;

a transmission device mechanically connected to the driving device and configured to move the driving device;

a force providing device mechanically connected to the transmission device and configured to provide a driving force to the transmission device;

an adjusting device mechanically connected to the force providing device and configured to adjust one or more of a position and an orientation of the force providing device;

at least one processor; and

a memory being communicatively coupled to the at least one processor;

wherein the memory is configured to store instructions, which, when executed by the at least one processor, cause the at least one processor to implement operations of the method of claim 8 .

20 . The method according to claim 18 , wherein the determining the operation status of the robotic apparatus based on the fused data, and controlling the robotic apparatus in response to the operation status comprises:

acquiring a torque and a speed output required by each joint of the adjusting device basing on the magnitude and the direction of the force applied by the user on the driving device using an inverse kinematics algorithm; and

transmitting a command to provide the torque and the speed output to the adjusting device to control an angle of the adjusting device so as to facilitate a user in moving the adjusting device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2025
From: MA, CARLOS; LU, YUEQIANG
To: CORNERSTONE TECHNOLOGY (SHENZHEN) LIMITED
Reel/Frame 071958/0038 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2025
From: MA, CARLOS; LU, YUEQIANG
To: CORNERSTONE TECHNOLOGY (SHENZHEN) LIMITED
Reel/Frame 071724/0695 →
Priority Claims (1)
CN 202110035516.X · Jan 12, 2021 · national
Continuity (2)
Continuation PCTCN2021129098 · Nov 5, 2021
Related Publication 20230347517A1 · Nov 2, 2023
References Cited (36)
US 20060058919A1 · Sommer · 2006 [cited by examiner]
US 20130245825A1 · Vicentini · 2013 [cited by examiner]
US 20160129595A1 · Gerio · 2016 [cited by examiner]
US 20180168749A1 · Dozeman · 2018 [cited by examiner]
US 20190200844A1 · Shelton, IV · 2019 [cited by examiner]
US 20200001459A1 · Song · 2020 [cited by examiner]
US 20230028689A1 · Rabindran · 2023 [cited by examiner]
US 20230114137A1 · Wu · 2023 [cited by examiner]
US 20230320798A1 · Blake · 2023 [cited by examiner]
CN 104764451A · 2015 [cited by applicant]
CN 104772756A · 2015 [cited by applicant]
CN 106383521A · 2017 [cited by applicant]
CN 108132053A · 2018 [cited by applicant]
CN 109069209A · 2018 [cited by applicant]
CN 110076776A · 2019 [cited by applicant]
CN 112043380A · 2020 [cited by applicant]
CN 112720503A · 2021 [cited by applicant]
CN 116792493A · 2023 [cited by examiner]
JP 2000271888A · 2000 [cited by applicant]
JP 2012020343A · 2012 [cited by applicant]
WO WO2014104086A1 · 2014 [cited by examiner]
WO 2019094794A2 · 2019 [cited by applicant]
Shirazi, A.R., M.M.S. Fakhrabadi, and A. Ghanbari. 2012. Optimal Design of a 6-DOF Parallel Manipulator Using Particle Swarm Optimization. Advanced Robotics 26 (13): 1419-1441. doi:10.1080/01691864.2012.690187. (Year: 2… [cited by examiner]
Unknown Inventor, Translation of CN116792493, Application filed Jun. 26, 2023, Published on Sep. 22, 2023, Translation acquired from Patent Translate via Espacenet. (Year: 2023). [cited by examiner]
Song, Translation of WO2014104086A1, Application filed on Dec. 25, 2013, Published on Jul. 3, 2014, Translation acquired from Patent Translate via Espacenet. (Year: 2014). [cited by examiner]
Jung, Won-Jo, Kyung-Soo Kwak, and Soo-Chul Lim. “Vision-based suture tensile force estimation in robotic surgery.” Sensors 21.1 (2020): 110. (Year: 2020). [cited by examiner]
Shao, Ziyan, et al. “Force and deformation transmission characteristics of a compliant tendon-sheath actuation system based on Hill-type muscle model.” Proceedings of the Institution of Mechanical Engineers, Part H: Jou… [cited by examiner]
Lukas Stadelmann, et al, “End-Effector Pose Correction for Versatile Large-Scale Multi-Robotic Systems”, IEEE Robotics and Automation Letters, IEEE, vol. 4, No. 2, Apr. 1, 2019, 8 pgs. [cited by applicant]
Sukhan Lee, et al, “Intelligent Sensing and Control for Advanced Teleoperation”, Proceedings of the International Symposium on Intelligent Control. Glasgow, Aug. 11-13, 1992, [Proceedings of the International Symposium … [cited by applicant]
Andry M. Pinto, et al, A Localization Method Based on Map-Matching and Particle Swarm Optimization, Journal of Intelligent, Springer Netherlands, Dordrecht, vol. 77, No. 2, Dec. 21, 2013, 14 pgs. [cited by applicant]
Cornerstone Technology (Shenzhen) Limited, Extended European Search Report, EP 21919007.1, May 3, 2024, 8 pgs. [cited by applicant]
Cornerstone Technology (Shenzhen) Limited, International Search Report with English translation, PCT/CN2021/129098, Feb. 10, 2022, 6 pgs. [cited by applicant]
Cornerstone Technology (Shenzhen) Limited, CN First Office Action with English translation, CN 202110035516X, Nov. 29, 2021, 17 pgs. [cited by applicant]
Cornerstone Technology (Shenzhen) Limited, CN Second Office Action with English translation, CN 202110035516X, Mar. 23, 2022, 16 pgs. [cited by applicant]
Xuexiang Yu, et al., “GPS Survey and Data Process”, China University of Mining and Technology Press, Oct. 31, 2013, 11 pgs. [cited by applicant]
Cornerstone Technology (Shenzhen) Limited, EP Article A94(3), EP 21919007.1, Dec. 20, 2024, 16 pgs. [cited by applicant]