System and method of activating manual manipulation using linkage interaction sensing
Robotic medical systems capable of manual manipulation are described. A robotic medical system can include a robotic arm and a sensor architecture. The sensor architecture can include one or more non-joint based sensors that are positioned to detect a first force exerted on the robotic arm. The robotic medical system can be configured to determine whether sensor data received from the sensor architecture meets first criteria. For example, the first criteria can be met in accordance with a determination that the first force exceeds a first threshold force. The robotic medical system can be configured to, in accordance with a determination that the first criteria are met, transition the robotic arm from a position control mode to a manual manipulation mode.
1 . A robotic system, comprising:
a robotic arm, the robotic arm including:
a structural link, and
a shell, the shell surrounding the structural link;
a sensor architecture, including one or more non-joint-based sensors that are positioned to detect a first force exerted on the robotic arm, at least one of the one or more non-joint-based sensors being positioned and configured to detect the first force exerted on the robotic arm by detecting relative movement between the shell and the structural link;
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the processors to:
determine whether sensor data received from the sensor architecture meets first criteria, wherein the first criteria are met in accordance with a determination that the first force exceeds a first threshold force and a determination that the robotic arm is in an undocked configuration in which the robotic arm is not coupled with a cannula; and
in accordance with a determination that the first criteria are met, including a determination that the first force exceeds the first threshold force and a determination that the robotic arm is in the undocked configuration, transition the robotic arm from a position control mode to a manual manipulation mode.
2 . The robotic system of claim 1 , wherein the one or more non-joint-based sensors include a combined force and moment sensor.
3 . The robotic system of claim 1 , wherein the one or more non-joint-based sensors include at least one sensor that is located between a pair of joints of the robotic arm.
4 . The robotic system of claim 1 , wherein:
the one or more non-joint-based sensors include at least a first sensor that is located in a distal portion of the robotic arm, and
the robotic system further comprises a tool driver that is mounted on the first sensor such that the first sensor detects force exerted by the tool driver.
5 . The robotic system of claim 4 , wherein the first sensor comprises a six-axis load cell.
6 . The robotic system of claim 1 , wherein the one or more non-joint-based sensors include one or more contact sensors located on one or more links of the robotic arm.
7 . The robotic system of claim 1 , wherein:
the sensor architecture further includes one or more joint-based sensors that are positioned to detect a second force exerted on the robotic arm,
the first criteria are met in accordance with a determination that the first force detected by the non-joint-based sensors and the second force detected by the joint-based sensors meet a preset combination of requirements on the first force and the second force, and
the memory further includes instructions that, when executed by the one or more processors, cause the processors to:
in accordance with a determination that the first criteria are met, including a determination that the first force and the second force meet a preset combination of requirements on the first force and the second force, transition the robotic arm from the position control mode to the manual manipulation mode.
8 . The robotic system of claim 1 , wherein the memory further stores instructions that, when executed by the one or more processors, cause the processors to:
during the manual manipulation mode, generate output to assist with movement of the robotic arm in accordance with physical manipulation of the robotic arm by an operator.
9 . The robotic system of claim 1 , wherein the memory further stores instructions that, when executed by the one or more processors, cause the processors to:
monitor movement of the robotic arm during the manual manipulation mode; and
in accordance with a determination that the movement of the robotic arm during the manual manipulation mode meets second criteria, wherein the second criteria are met in accordance with a determination that the movement of the robotic arm during the manual manipulation mode is below a threshold level of movement, transition the robotic arm from the manual manipulation mode to the position control mode.
10 . The robotic system of claim 1 , further comprising an input interface that, when activated by a preset input, cause the one or more processors to transition the robotic arm from the position control mode to the manual manipulation mode.
11 . The robotic system of claim 1 , further comprising:
one or more additional robotic arms; and
an input interface that remotely activates impedance control of the robotic arm and/or at least one of the one or more additional robotic arms.
12 . A robotic system, comprising:
a robotic arm, the robotic arm including:
a structural link, and
a shell, the shell surrounding the structural link;
a sensor architecture, including:
one or more sensors that are positioned to detect force and/or moment exerted on the robotic arm, the one or more sensors including at least one sensor positioned and configured to detect force and/or moment exerted on the robotic arm by detecting relative movement between the shell and the structural link;
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the processors to:
determine whether sensor data received from the sensor architecture meets first criteria, wherein the first criteria are met in accordance with a determination that a force detected by the one or more sensors exceeds a first threshold force or in accordance with a determination that a moment detected by the one or more sensors exceeds a first threshold moment, wherein the first criteria include a requirement that the robotic arm is in an undocked configuration in which the robotic arm is not coupled with a cannula in order for the first criteria to be met; and
in accordance with a determination that the first criteria are met, transition the robotic arm from a position control mode to a manual manipulation mode.
13 . The robotic system of claim 12 , wherein the one or more sensors comprise a six-axis load cell.
14 . The robotic system of claim 12 , wherein the robotic arm includes an outer surface; and the one or more sensors comprise a plurality of contact sensors that engage with the shell.
15 . The robotic system of claim 12 , wherein the one or more sensors include at least one of: a non-joint-based sensor that is positioned away from a joint of the robotic arm; or a joint-based sensor that is positioned on a joint of the robotic arm.
16 . The robotic system of claim 12 , wherein the manual manipulation mode includes an impedance mode.
17 . The robotic system of claim 12 , wherein the memory further stores instructions that, when executed by the one or more processors, cause the processors to:
during the manual manipulation mode, generate output to assist with movement of the robotic arm in accordance with physical manipulation of the robotic arm by an operator.
18 . The robotic system of claim 12 , wherein the memory further stores instructions that, when executed by the one or more processors, cause the processors to:
monitor movement of the robotic arm during the manual manipulation mode; and
in accordance with a determination that the movement of the robotic arm during the manual manipulation mode meets second criteria, wherein the second criteria are met in accordance with a determination that the movement of the robotic arm during the manual manipulation mode is below a threshold level of movement, transition the robotic arm from the manual manipulation mode to the position control mode.
19 . A robotic system, comprising:
a robotic arm, the robotic arm being operable to transition between an undocked configuration, in which a cannula or instrument is not coupled with the robotic arm, and a docked configuration, in which a cannula or instrument is coupled with the robotic arm;
a sensor architecture, including one or more non-joint-based sensors that are positioned to detect a first force exerted on the robotic arm;
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the processors to:
determine whether sensor data received from the sensor architecture meets first criteria, wherein the first criteria are met in accordance with a determination that the first force exceeds a first threshold force, wherein the first criteria include a requirement that the robotic arm is in an undocked configuration in order for the first criteria to be met; and
in accordance with a determination that the first criteria are met, including a determination that the first force exceeds the first threshold force, transition the robotic arm from a position control mode to a manual manipulation mode.