Systems and methods for sensing of and docking with a trocar
A surgical robotic system has a tool drive coupled to a distal end of a robotic arm that has a plurality of actuators. The tool drive has a docking interface to receive a trocar. The system also includes one or more sensors that are operable to visually sense a surface feature of the trocar. One or more processors determine a position and orientation of the trocar, based on the visually sensed surface feature. In response, the processor controls the actuators to orient the docking interface to the determined orientation of the trocar and to guide the robotic arm toward the determined position of the trocar. Other aspects are also described and claimed.
1. A surgical robotic system, comprising:
a tool drive to be coupled to a distal end of a robotic arm, the tool drive comprising a docking interface to receive a trocar and secure an attachment portion of the trocar to the docking interface;
one or more sensors operable to sense a sensed feature the trocar; and
one or more processors configured to
determine a first estimate of a location of the trocar, using a physical model;
signal one or more of a plurality of actuators in the surgical robotic arm to guide the surgical robotic arm based on the first estimate so that the docking interface, as coupled to the surgical robotic arm, moves into proximity of the trocar, and then determine a second estimate of a position and an orientation of the trocar based on the sensed feature, and then
alert an operator of the system, and provide a plurality of virtual fixture modes of operation as options to be selected by the operator for moving the docking interface closer to the trocar until the attachment portion of the trocar can be secured to the docking interface.
2. The surgical robotic system of claim 1 , wherein the one or more processors are configured to generate a planned trajectory to the determined position of the trocar, and guide the robotic arm along the planned trajectory.
3. The surgical robotic system of claim 2 , wherein the one or more processors are configured to guide the robotic arm by controlling one or more of the plurality of actuators to automatically drive the robotic arm along the planned trajectory.
4. The surgical robotic system of claim 2 , wherein the one or more processors are configured to guide the robotic arm by controlling one or more of the plurality of actuators to assist an operator who is manually forcing the robotic arm.
5. The surgical robotic system of claim 2 , wherein the one or more processors are configured to control one or more of the plurality of actuators to resist an operator's manual forcing of the robotic arm when the operator's manual forcing is directing the robotic arm away from the planned trajectory.
6. The surgical robotic system of claim 5 , wherein the one or more of the plurality of actuators controlled by the one or more processors resist an operator's manual guidance of the robotic arm away from the planned trajectory with a force that is proportional to a distance between the robotic arm and the planned trajectory.
7. The surgical robotic system of claim 2 wherein the planned trajectory avoids collision of the robotic arm with one or more of a patient, a table on which the patient rests, bedside staff, a cable, a pipe, and other surgical robotic arms.
8. The surgical robotic system of claim 1 , wherein the second estimate is more precise than the first estimate.
9. The surgical robotic system of claim 1 , wherein the one or more processors are configured to know a surgical plan including a type of surgery, size of a patient, location and orientation of the patient on a table, and a location of the trocar as inserted into a body of the patient.
10. The surgical robotic system of claim 9 wherein the one or more sensors are operable to sense the sensed feature by one of: magnetic sensing; structured light camera sensing; and sensing by analyzing image data from a visible light camera.
11. The surgical robotic system of claim 1 wherein the one or more sensors are operable to sense the sensed feature by one of:
magnetic sensing;
structured light camera sensing; and
sensing by analyzing image data from a visible light camera.
12. The surgical robotic system of claim 11 , wherein the one or more sensors are disposed in the docking interface.
13. The surgical robotic system of claim 12 , wherein the docking interface comprises a sterile adapter coupled to a frontal portion thereof, the one or more sensors being mounted on the sterile adapter.
14. A method for docking a robotic arm of a surgical robotic system to a trocar, the method comprising:
determining by a processor a first estimate of a location of the trocar, using a known surgical plan including a type of surgery, size of a patient, a location and an orientation of the patient on a table, and a location of the trocar as inserted into a body of the patient;
signaling one or more of a plurality of actuators in the robotic arm to guide the robotic arm based on the first estimate so that a docking interface of a tool drive that is coupled to the robotic arm can be moved into proximity of the trocar;
when the docking interface has moved into proximity of the trocar, producing, by one or more sensors that are coupled to the docking interface, a sensed feature of the trocar;
determining, by the processor, a sensed pose of the trocar based on the sensed feature, the sensed pose including a position and an orientation of the trocar; and then alerting, by the processor, an operator of the system and providing a plurality of virtual fixture modes of operation as options to be selected by the operator for moving the docking interface closer to the trocar until the trocar can be secured to the docking interface;
calculating, by the processor, a planned trajectory to the sensed pose of the trocar; and
responsive to a selection by the operator of one of the virtual fixture modes of operation, signaling one or more of the plurality of actuators in the robotic arm to guide the docking interface along the planned trajectory to the sensed pose of the trocar.
15. The method of claim 14 , further comprising determining, by the processor, a distance between the docking interface and the planned trajectory, and controlling one or more of the plurality of actuators in the robotic arm to guide the robotic arm toward the planned trajectory based on the distance.
16. The method of claim 14 , further comprising determining, by the processor, a component of a manual force applied by the operator on the robotic arm in a direction of the planned trajectory, and controlling one or more of the plurality of actuators in the robotic arm to guide the robotic arm along the planned trajectory based on the component of the manual force applied by the operator along the planned trajectory.
17. The method of claim 16 , wherein the processor controls one or more of the plurality of actuators in the robotic arm to guide the robotic arm along the planned trajectory with a force determined by a product of i) the component of the manual force applied by the operator along the planned trajectory and ii) a predetermined scalar value.
18. The method of claim 14 , further comprising determining, by the processor, a component of a manual force applied by an operator on the robotic arm in a direction away from a direction of the planned trajectory, and controlling one or more of the plurality of actuators in the robotic arm to guide the robotic arm toward the planned trajectory based on the component of the manual force applied by the operator in the direction away from the planned trajectory.
19. The method of claim 18 , wherein the processor controls one or more of the plurality of actuators in the robotic arm to guide the robotic arm toward the planned trajectory with a force determined by a product of i) the component of the manual force applied by the operator in the direction away from the planned trajectory and ii) a predetermined scalar value.
20. The method of claim 14 , wherein the one or more sensors are part of a camera on the arm, or part of a magnetic sensing system.