Co-manipulation surgical system having automated user override detection
Co-manipulation robotic systems are described herein that may be used for assisting with surgical procedures, including laparoscopic surgery. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.
1. A co-manipulation surgical system to assist with surgery performed using a surgical instrument, the co-manipulation surgical system comprising:
a robot arm comprising a plurality of links, a plurality of joints, and a distal end configured to be removably coupled to the surgical instrument;
a plurality of motors operatively coupled to corresponding joints of the plurality of joints; and
a controller operatively coupled to the robot arm and configured to permit the robot arm to be freely moveable in a co-manipulation mode responsive to movement at a handle of the surgical instrument for performing surgery, the controller programmed to:
monitor operating characteristics of the co-manipulation surgical system to detect if a condition exists;
modify, if the condition is detected, an operational mode of the robot arm;
cause the plurality of motors to apply a force at the distal end of the robot arm based on the modified operational mode of the robot arm;
determine a direction of the force applied at the distal end of the robot arm via the plurality of motors;
determine a direction of an external force applied at the distal end of the robot arm;
determine an angle between the direction of the force applied at the distal end of the robot arm via the plurality of motors and the direction of the external force applied at the distal end of the robot arm; and
apply a breakaway threshold to the robot arm based on the force applied at the distal end of the robot arm and the direction of the force, the breakaway threshold being an external force required to be applied to the distal end of the robot arm to cause the robot arm to switch from the modified operational mode to the co-manipulation mode,
wherein the breakaway threshold requires the direction of the external force applied at the distal end of the robot arm to be different from the direction of the force applied at the distal end of the robot arm via the plurality of motors.
2. The co-manipulation surgical system of claim 1 , wherein the breakaway threshold comprises a breakaway motion threshold being a predetermined amount of motion at the distal end of the robot arm responsive to the external force applied at the distal end of the robot arm required to cause the robot arm to switch from the modified operational mode to the co-manipulation mode.
3. The co-manipulation surgical system of claim 2 , wherein the predetermined amount of motion at the distal end of the robot arm required to cause the robot arm to switch from the modified operational mode to the co-manipulation mode is greater than motion at the distal end of the robot arm expected due to non-user forces applied at the distal end of the robot arm.
4. The co-manipulation surgical system of claim 1 , wherein the breakaway threshold comprises a breakaway angular threshold being a predetermined angle between the direction of the force applied at the distal end of the robot arm via the plurality of motors and the direction of the external force applied at the distal end of the robot arm required to cause the robot arm to switch from the modified operational mode to the co-manipulation mode.
5. The co-manipulation surgical system of claim 1 , wherein the condition comprises when movement of the robot arm due to movement at the handle of the surgical instrument is less than a predetermined amount for at least a predetermined dwell time period,
wherein the modified operational mode of the robot arm comprises a passive mode, and
wherein the controller is configured to cause the plurality of motors to apply a hold force required to maintain the distal end of the robot arm in a static position in the passive mode.
6. The co-manipulation surgical system of claim 5 , wherein the controller is configured to apply the breakaway threshold to the robot arm based on the force applied at the distal end of the robot arm after a predetermined time period upon initiation of the passive mode.
7. The co-manipulation surgical system of claim 6 , wherein the controller is configured to:
apply a high breakaway force threshold to the robot arm during the predetermined time period, the high breakaway force threshold greater than the breakaway threshold; and
cause, if the hold force required to maintain the distal end of the robot arm in the static position exceeds the high breakaway force threshold during the predetermined time period, the robot arm to switch to the co-manipulation mode.
8. The co-manipulation surgical system of claim 5 , wherein the hold force required to maintain the distal end of the robot arm in the static position is continuously calculated in the passive mode.
9. The co-manipulation surgical system of claim 5 , wherein the controller is configured to not disengage passive mode unless the external force applied to the distal end of the robot arm exceeds the breakaway force threshold.
10. The co-manipulation surgical system of claim 1 , wherein the surgical instrument coupled to the distal end of the robot arm comprises a scope,
wherein the condition comprises initiation of an instrument centering mode,
wherein the modified operational mode of the robot arm comprises the instrument centering mode, and
wherein the controller is configured to cause the plurality of motors to apply a force to the distal end of the robot arm required to move the scope to maintain an object within the field of view of the scope in the instrument centering mode.
11. The co-manipulation surgical system of claim 10 , wherein, in the instrument centering mode, the controller is configured to cause the plurality of motors to apply a force to the distal end of the robot arm required to move the scope in a panning motion and/or a zooming motion to maintain the object within the field of view of the scope.
12. The co-manipulation surgical system of claim 10 , wherein, in the instrument centering mode, the controller is configured to identify the object to be maintained within the field of view of the scope based on image data obtained by the scope.
13. The co-manipulation surgical system of claim 10 , wherein, in the instrument centering mode, a resistive force applied to the distal end of the robot arm via the scope by an obstacle during movement of the scope to maintain the object within the field of view of the scope does not cause motion at the distal end of the robot arm.
14. The co-manipulation surgical system of claim 13 , wherein the controller is configured to cause, upon application of the resistive force to the distal end of the robot arm via the scope by the obstacle in the instrument centering mode, the plurality of motors to apply a gradually increasing force within predetermined safety limits to the distal end of the robot arm to overcome the resistive force and move the scope to maintain the object within the field of view of the scope.
15. The co-manipulation surgical system of claim 13 , wherein the obstacle comprises an object or anatomical structure within the patient's body.
16. The co-manipulation surgical system of claim 13 , wherein the obstacle comprises an object outside the patient's body or a workspace limitation of the robot arm.
17. The co-manipulation surgical system of claim 10 , wherein the object comprises a surgical instrument or an anatomical structure within the field of view of the scope.
18. The co-manipulation surgical system of claim 1 , wherein the breakaway threshold is user-adjustable according to the user's preferences.
19. The co-manipulation surgical system of claim 18 , wherein the controller is configured to:
store the user-adjusted breakaway threshold in a user profile associated with the user;
load the user profile associated with the user; and
apply, if the condition is detected, the user-adjusted breakaway threshold to the robot arm.
20. The co-manipulation surgical system of claim 1 , wherein the controller is configured to apply an impedance to the plurality of joints of the robot arm to compensate for a mass of the robot arm and the surgical instrument.
21. The co-manipulation surgical system of claim 1 , wherein the controller is configured to measure current of the plurality of motors to monitor the operating characteristics of the co-manipulation surgical system to detect if the condition exists.
22. A method for assisting with surgery using a robot arm comprising a plurality of links, a plurality of joints, and a distal end configured to be removably coupled to the surgical instrument, the method comprising:
monitoring, via a controller operatively coupled to the robot arm, operating characteristics of the co-manipulation surgical system to detect if a condition exists;
modifying, if the condition is detected, an operational mode of the robot arm;
causing a plurality of motors operatively coupled to corresponding joints of the plurality of joints to apply a force at the distal end of the robot arm based on the modified operational mode of the robot arm;
determining a direction of the force applied at the distal end of the robot arm via the plurality of motors;
determining a direction of an external force applied at the distal end of the robot arm;
determining an angle between the direction of the force applied at the distal end of the robot arm via the plurality of motors and the direction of the external force applied at the distal end of the robot arm; and
applying a breakaway threshold to the robot arm based on the force applied at the distal end of the robot arm, the breakaway threshold being an external force required to be applied to the distal end of the robot arm to cause the robot arm to switch from the modified operational mode to the co-manipulation mode,
wherein the breakaway threshold requires the direction of the external force applied at the distal end of the robot arm to be different from the direction of the force applied at the distal end of the robot arm via the plurality of motors.
23. The method of claim 22 , wherein the breakaway threshold comprises a breakaway motion threshold being a predetermined amount of motion at the distal end of the robot arm responsive to the external force applied at the distal end of the robot arm required to cause the robot arm to switch from the modified operational mode to the co-manipulation mode, the method further comprising:
switching, when motion at the distal end of the robot arm responsive the external force applied at the distal end of the robot arm exceeds the breakaway motion threshold, the robot arm from the modified operational mode to the co-manipulation mode.
24. The method of claim 22 , wherein the breakaway threshold comprises a breakaway angular threshold being a predetermined angle between the direction of the force applied at the distal end of the robot arm via the plurality of motors and the direction of the external force applied at the distal end of the robot arm required to cause the robot arm to switch from the modified operational mode to the co-manipulation mode, the method further comprising:
switching, when the angle between the direction of the force applied at the distal end of the robot arm via the plurality of motors and the direction of the external force applied at the distal end of the robot arm exceeds the breakaway angular threshold, the robot arm from the modified operational mode to the co-manipulation mode.
25. The method of claim 22 , wherein the condition comprises when movement of the robot arm due to movement at the handle of the surgical instrument is less than a predetermined amount for at least a predetermined dwell time period,
wherein modifying, if the condition is detected, the operational mode of the robot arm comprises switching the robot arm to a passive mode, and
wherein causing the plurality of motors to apply the force at the distal end of the robot arm based on the modified operational mode of the robot arm comprises causing the plurality of motors to apply a hold force required to maintain the distal end of the robot arm in a static position in the passive mode.
26. The method of claim 22 , wherein the surgical instrument coupled to the distal end of the robot arm comprises a scope and the condition comprises initiation of an instrument centering mode,
wherein modifying, if the condition is detected, the operational mode of the robot arm comprises switching the robot arm to the instrument centering mode, and
wherein causing the plurality of motors to apply the force at the distal end of the robot arm based on the modified operational mode of the robot arm comprises causing the plurality of motors to apply a force to the distal end of the robot arm required to move the scope to maintain an object within the field of view of the scope in the instrument centering mode.
27. The method of claim 22 , further comprising:
adjusting the breakaway threshold based on a user's preference;
storing the user-adjusted breakaway threshold in a user profile associated with the user;
loading the user profile associated with the user; and
applying, if the condition is detected, the user-adjusted breakaway threshold to the robot arm.