Co-manipulation surgical system for use with surgical instruments for performing surgery according to stored surgeon's preferences
Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.
1 . A co-manipulation surgical system to assist with surgery performed using a surgical instrument, the co-manipulation surgical system comprising:
a robot arm comprising a plurality of links, a plurality of joints, a proximal region operatively coupled to a base, and a distal region configured to be removably coupled to the surgical instrument;
a plurality of motors operatively coupled to corresponding joints of the plurality of joints; and
a controller operatively coupled to the robot arm and configured to permit the robot arm to be freely moveable in a co-manipulation mode responsive to movement at a handle of the surgical instrument for performing surgery, the controller programmed to:
load a user profile associated with a first user, the user profile comprising one or more preferred operating parameters associated with a preference of the first user, the one or more preferred operating parameters at least partially based on laparoscopic image data collected during one or more past surgical procedures performed by the first user;
monitor operating characteristics of the co-manipulation surgical system to detect if a condition exists; and
control, based on detecting that the condition exists, the co-manipulation surgical system according to at least one of the one or more preferred operating parameters,
wherein, when the surgical instrument comprises a laparoscope, the controller is configured to cause the plurality of motors to move the robot arm to automatically move the laparoscope based on the laparoscopic image data collected during one or more past surgical procedures.
2 . The co-manipulation surgical system of claim 1 , wherein the one or more preferred operating parameters are at least partially based on data collected during one or more past surgical procedures performed by a plurality of users.
3 . The co-manipulation surgical system of claim 1 , wherein the one or more preferred operating parameters are at least partially based on manually entered user input indicative of the preference of the first user.
4 . The co-manipulation surgical system of claim 1 , wherein the controller is configured to:
record data indicative of interactions between the first user and the co-manipulation surgical system collected in real-time; and
update the user profile associated with the first user with the recorded data to learn the first user's preferences over time.
5 . The co-manipulation surgical system of claim 4 , wherein the controller is configured to execute one or more algorithms comprising trends over time, averaging, and/or optical flow to learn the first user's preferences over time based on the recorded data.
6 . The co-manipulation surgical system of claim 1 , wherein the user profile associated with the first user is stored in an online database, and wherein the controller is configured to access the online database to load the user profile associated with the first user.
7 . The co-manipulation surgical system of claim 1 , wherein the user profile associated with the first user comprises information associated with the first user comprising a username, level of expertise, types of procedures performed, and/or region of clinical practice.
8 . The co-manipulation surgical system of claim 1 , wherein the user profile associated with the first user comprises information indicative of the first user's preferred patient bed height, patient bed orientation, trocar port placement, and/or surgical instrument types, for a given surgical procedure.
9 . The co-manipulation surgical system of claim 1 , wherein the one or more preferred operating parameters comprise a setup joint parameter associated with the preference of the first user for a given surgical procedure, and wherein the controller is configured to cause a motor of the plurality of motors operatively coupled to a setup joint of the plurality of joints to automatically reposition the setup joint based on the setup joint parameter.
10 . The co-manipulation surgical system of claim 1 , further comprising:
an optical scanner configured to collect depth and/or RGB data,
wherein the controller is configured to automatically identify the first user based on the depth and/or RGB data collected by the optical scanner.
11 . The co-manipulation surgical system of claim 1 , wherein the controller is configured to:
receive user input indicative of an identity of the first user; and
automatically load the user profile associated with the first user based on the user input.
12 . The co-manipulation surgical system of claim 11 , wherein the user input indicative of the identity of the first user comprises a password, RFID key, and/or facial recognition.
13 . The co-manipulation surgical system of claim 1 , wherein the controller is configured to cause the robot arm to automatically switch to a passive mode responsive to determining that movement of the robot arm due to movement at the handle of the surgical instrument is less than a predetermined amount for at least a predetermined dwell time period, the controller configured to cause the robot arm to maintain a static position in the passive mode.
14 . The co-manipulation surgical system of claim 13 , wherein at least one of the one or more preferred operating parameters comprises a preferred predetermined dwell time period associated with the preference of the first user and/or a preferred predetermined amount of movement of the robot arm associated with the preference of the first user.
15 . The co-manipulation surgical system of claim 13 , wherein the controller is configured to cause the robot arm to automatically switch from the passive mode to the co-manipulation mode responsive to determining that force applied at the robot arm due to force applied at the handle of the surgical instrument exceeds a predetermined force threshold, and wherein one of the one or more preferred operating parameters comprise a preferred predetermined force threshold associated with the preference of the first user.
16 . The co-manipulation surgical system of claim 1 , wherein the controller is configured to apply an impedance to the robot arm to provide a predetermined level of viscosity perceived by the first user during movement of the handle of the surgical instrument, and wherein one of the one or more preferred operating parameters comprise a preferred impedance associated with the preferred level of viscosity of the first user.
17 . The co-manipulation surgical system of claim 1 , wherein one of the one or more preferred operating parameters comprise a preferred robot arm configuration for a given surgical procedure associated with the preference of the first user, and wherein the controller is configured to cause the plurality of motors to move the robot arm to the preferred robot arm configuration.
18 . The co-manipulation surgical system of claim 1 , wherein the condition comprises determining that the surgical instrument is not in an optimal or preferred location based on data collected during one or more past surgical procedures performed by the first user, and wherein the controller is configured to cause, based on detecting that the condition exists, the plurality of motors to move the robot arm to automatically move the surgical instrument to the optimal or preferred location.
19 . The co-manipulation surgical system of claim 1 , wherein the user profile associated with the first user comprises a patient list associated with the first user, and wherein the one or more preferred operating parameters are patient specific.
20 . The co-manipulation surgical system of claim 1 , further comprising a platform coupled to the base of the robot arm, the platform comprising a stage assembly configured to independently move the base of the robot arm in at least two degrees of freedom relative to the platform.
21 . The co-manipulation surgical system of claim 20 , wherein the user profile associated with the first user comprises a height of the first user, and wherein the controller is configured to cause one or more motors of the plurality of motors operatively coupled to the stage assembly to automatically move the base of the robot arm relative to the platform based on the height of the first user.
22 . The co-manipulation surgical system of claim 20 , wherein the controller is configured to:
access a hospital medical record database comprising information indicative of procedure type and/or patient specific information;
cause the plurality of motors to move the robot arm and/or the stage assembly to position the robot arm relative to the patient based on the information indicative of procedure type and/or patient specific information.
23 . A co-manipulation surgical system to assist with surgery performed using a surgical instrument, the co-manipulation surgical system comprising:
a robot arm comprising a plurality of links, a plurality of joints, a proximal region operatively coupled to a base, and a distal region configured to be removably coupled to the surgical instrument;
a plurality of motors operatively coupled to corresponding joints of the plurality of joints; and
a controller operatively coupled to the robot arm and configured to permit the robot arm to be freely moveable in a co-manipulation mode responsive to movement at a handle of the surgical instrument for performing surgery, the controller programmed to:
load a user profile associated with a first user, the user profile comprising one or more preferred operating parameters associated with a preference of the first user;
monitor operating characteristics of the co-manipulation surgical system to detect if a condition exists;
control, based on detecting that the condition exists, the co-manipulation surgical system according to at least one of the one or more preferred operating parameters;
record data indicative of interactions between the first user and the co-manipulation surgical system collected in real-time; and
execute one or more machine learning models to learn the first user's preferences over time based on the recorded data.
24 . The co-manipulation surgical system of claim 23 , wherein the one or more preferred operating parameters are at least partially based on data collected during one or more past surgical procedures performed by the first user.
25 . The co-manipulation surgical system of claim 24 , wherein the data collected during one or more past surgical procedures performed by the first user comprises laparoscopic image data, and wherein, when the surgical instrument comprises a laparoscope, the controller is configured to cause the plurality of motors to move the robot arm to automatically move the laparoscope based on the laparoscopic image data collected during one or more past surgical procedures.
26 . The co-manipulation surgical system of claim 12 , wherein the interactions between the first user and the co-manipulation surgical system comprise movement of a laparoscope coupled to the distal region of the robot arm by the first user.
27 . The co-manipulation surgical system of claim 23 , wherein the one or more machine learning models comprise classification, discrimination, neural networks, and/or reinforcement learning.
28 . The co-manipulation surgical system of claim 23 , wherein the controller is configured to:
annotate the recorded data based on the interactions between the first user and the co-manipulation surgical system; and
generate a training dataset comprising the annotated recorded data.
29 . The co-manipulation surgical system of claim 23 , wherein the interactions between the first user and the co-manipulation surgical system comprise a pose of the first user, a height of the first user, and/or a hand preference of the first user.
30 . A co-manipulation surgical system to assist with surgery performed using a surgical instrument, the co-manipulation surgical system comprising:
a robot arm comprising a plurality of links, a plurality of joints, a proximal region operatively coupled to a base, and a distal region configured to be removably coupled to the surgical instrument;
a plurality of motors operatively coupled to corresponding joints of the plurality of joints; and
a controller operatively coupled to the robot arm and configured to permit the robot arm to be freely moveable in a co-manipulation mode responsive to movement at a handle of the surgical instrument for performing surgery, the controller programmed to:
load a user profile associated with a first user, the user profile comprising one or more preferred operating parameters associated with a preference of the first user;
determine a sequence of clinical steps of a surgical procedure;
infer a clinical step of the sequence of clinical steps of the surgical procedure in real-time; and
estimate a procedure end time based at least partially on the inferred clinical step.