IP Library › Granted Patent US 12,269,180
Granted Patent B2
US 12,269,180 · App. 17/951,536 · Granted Apr 8, 2025

Stereoscopic visualization camera and integrated robotics platform with force/torque sensor non-linearity correction

Inventors: Hossein Faraji (Goleta, CA); Stephen Minne (Goleta, CA); Michael Larkin (Goleta, CA)
Assignee: Digital Surgery Systems, Inc.
B25J9/1697B25J9/1692A61B90/25A61B90/37
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,269,180
App. No.
17/951,536
Granted
Apr 8, 2025
Kind
B2
Abstract

New and innovative systems and methods for calibrating and correcting sensors associated with a collaborative robot are disclosed. An example system comprises: at least one robotic arm; a sensor affixed to a location on the robotic arm, wherein the sensor measures force and torque across six degrees of freedom (6DOF); a processor; and memory. The system may receive, from the sensor, sensor input in real-time that indicate a measured force or torque. The system may generate, in real-time, sensor corrections that correspond to offset, linear, and non-linear deviations of the measured force in each sensor axis. The sensor corrections may correspond to offset, linear, and non-linear cross-coupling of the measured force between two or more sensor axes. The sensor corrections may be determined by applying offset, linear, and non nonlinear corrections to each degree of freedom (DOF) from every other DOF.

Claims (79)

1. A system for calibrating and correcting sensors associated with a collaborative robot, the system comprising:

a robotic arm,

a sensor affixed to a location on the robotic arm, wherein the sensor measures force and torque across six degrees of freedom (6DOF),

a processor, and

memory storing computer-executable instructions that, when executed by the processor, cause the processor to:

receive, from the sensor, sensor input in real-time, the sensor input indicating a measured force applied at the location of the sensor; and

generate, in real-time, sensor corrections to the sensor input,

wherein the sensor corrections correspond to offset, linear, and non-linear deviations of the measured force in each sensor axis,

wherein the sensor corrections correspond to offset, linear, and non-linear cross-coupling of the measured force between two or more sensor axes, and

wherein the sensor corrections are determined by applying offset, linear, and non nonlinear corrections to each degree of freedom from every other degree of freedom.

2. The system of claim 1 , wherein the instructions, when executed by the processor, cause the processor to:

determine, based on the sensor corrections, a proposed movement for the robotic arm; and

execute the proposed movement for the robotic arm.

3. The system of claim 1 , wherein the instructions, when executed by the processor, cause the proceddor to:

generate, based on a mass of a payload associated with the sensor and a motion of the robotic arm, one or more calibration coefficients for the sensor, wherein the sensor corrections are based on the one or more calibration coefficients.

4. The system of claim 3 , wherein the instructions, when executed by the processor, cause the processor to:

receive, from the sensor, a measurement of a gravitational force applied at the location of the sensor, wherein the sensor corrections are further based on the gravitational force.

5. The system of claim 1 , wherein the robotic arm comprises:

a first end,

a second end, and

a joint connecting the first end to the second end,

wherein the joint comprises a motor configured to rotate the joint around an axis and the sensor, wherein the sensor is configured to transmit an indication of a potential position of the joint.

6. The system of claim 5 , wherein the instructions, when executed by the processor, cause the processor to:

receive the indication of the potential position of the joint, the indication based on a translational force or a rotational force;

apply the sensor corrections to the indication of the potential position of the joint to determine an actual position of the joint; and

determine a movement sequence for the robotic arm based on the actual position of the joint.

7. The system of claim 6 , wherein the instructions, when executed by the processor, cause the processor to:

cause the joint of the robotic arm to rotate based on the determined movement sequence via one or more motor control signals provided to the joint,

wherein the rotation of the joint provides power-assisted movement of the robotic arm based on the translational force or the rotational force imparted on a stereoscopic camera by an operator.

8. The system of claim 7 , wherein:

the stereoscopic camera is connected to the robotic arm, the stereoscopic camera configured to generate image data of a target surgical site.

9. The system of claim 8 , wherein the stereoscopic camera includes at least one control unit having a button to enable the power-assisted movement, and

wherein the processor is configured to:

receive an input message indicative that the button was selected; and

determine the movement sequence by applying the sensor corrections to the sensor input from the sensor after receiving the input message related to the button.

10. The system of claim 1 , wherein the instructions, when executed by the processor, cause the processor to:

identify a moment arm associated with the received sensor input; and

determine, based on the moment arm and the measured force, a measured torque associated with the sensor input.

11. A system comprising:

a robotic arm;

a sensor affixed to a location on the robotic arm, wherein the sensor measures force and torque across six degrees of freedom (6DOF);

a processor; and

a memory storing computer-executable instructions that, when executed by the processor, cause the processor to:

determine, when the robotic arm is not in use, a baseline value for the sensor;

generate, based on the baseline value of the sensor, a correction model based on the baseline value of the sensor;

receive, in real-time when the robotic arm is in use, a sensor input from the sensor indicating a measured force;

generate, based on training data associated with the sensor, correction parameters for the correction model; and

apply, in real-time, the correction model to the sensor input to generate a sensor correction for the sensor input.

12. The system of claim 11 , wherein the instructions, when executed by the processor, further cause the processor to:

receive a measurement of a gravitational force applied at the location associated with the sensor input, wherein the correction parameters are further based on the gravitational force.

13. The system of claim 11 , wherein the robotic arm comprises:

a first end,

a second end, and

a joint connecting the first end to the second end,

wherein the joint comprises a motor configured to rotate the joint around an axis and the sensor, wherein the sensor is configured to transmit an indication of a potential position of the joint.

14. The system of claim 13 , wherein the instructions, when executed by the processor, cause the processor to:

receive the indication of the potential position of the joint, the indication based on a translational force or a rotational force;

apply the sensor correction to the indication of the potential position of the joint to determine an actual position of the joint; and

determine a movement sequence for the robotic arm based on the actual position of the joint.

15. The system of claim 14 , wherein the instructions, when executed by the processor, cause the processor to:

cause the joint of the robotic arm to rotate based on the determined movement sequence via one or more motor control signals provided to the joint,

wherein the rotation of one joint provides power-assisted movement of the robotic arm based on the translational force or the rotational force imparted on a stereoscopic camera by an operator.

16. The system of claim 15 , wherein: the stereoscopic camera is connected to the robotic arm, the stereoscopic camera configured to generate image data of a target surgical site.

17. The system of claim 16 , wherein the stereoscopic camera includes at least one control unit having a button to enable the power-assisted movement, and

wherein the processor is configured to:

receive an input message indicative that the button was selected; and

determine the movement sequence by applying the correction model to the sensor input from the sensor after receiving the input message related to the button.

18. The system of claim 11 , wherein the instructions, when executed by the processor, cause the processor to:

identify a moment arm associated with the received sensor input; and

determine, based on the moment arm and the measured force, a measured torque associated with the sensor input.

19. A method for correcting a sensor associated with a robotic arm in real-time, the method comprising:

determining, by a computing device having one or more processors, while the robotic arm is not in use, a baseline value for the sensor;

generating, based on the baseline value of the sensor, a correction model based on the baseline value of the sensor;

receiving, in real-time when the robotic arm is in use, a sensor input from the sensor indicating a measured force;

generating, based on training data associated with the sensor, correction parameters for the correction model; and

applying, in real-time, the correction model to the sensor input to generate a sensor correction for the sensor input.

20. The method of claim 19 , further comprising:

identifying a moment arm associated with the received sensor input; and

determining, based on the moment arm and the measured force, a measured torque associated with the sensor input.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2024
From: TRUE DIGITAL SURGERY
To: DIGITAL SURGERY SYSTEMS, INC.
Reel/Frame 069693/0056 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2022
From: FARAJI, HOSSEIN; MINNE, STEPHEN; LARKIN, MICHAEL
To: TRUE DIGITAL SURGERY
Reel/Frame 061194/0741 →
Continuity (2)
Provisional Application 63248297 · Sep 24, 2021
Related Publication 20230110248A1 · Apr 13, 2023
References Cited (3)
US 8375808B2 · Blumenkranz · 2013 [cited by examiner]
US 20200238526A1 · Nammoto · 2020 [cited by examiner]
US 20230054209A1 · Roh · 2023 [cited by examiner]
Cited By (2)
US 12,569,313 US 12,629,171