Detection of misalignment of robotic arms
Certain aspects relate to systems and techniques for detection of undesirable forces on one or more surgical robotic arms. In one aspect, there is provided a system including a robotic arm, including: two linkages, a joint, a torque sensor, and an instrument device manipulator (IDM). The system may further include a processor configured to measure a first torque value at the joint based on an output of the torque sensor and determine a second torque value at the joint based on a position of the robotic arm. The second torque value may be indicative of a gravitational component of the torque between the two linkages. The processor may be further configured to determine a force at the IDM based a difference between the first and second torque values and determine whether the robotic arm has collided with an object or misaligned based on the force at the IDM.
1. A system for detecting misalignment of robotic arms, comprising:
a first robotic arm comprising a first instrument device manipulator (IDM) connected to a distal end of the first robotic arm;
a second robotic arm comprising a second IDM connected to a distal end of the second robotic arm;
a first medical instrument comprising a working channel; and
a second medical instrument, the first robotic arm configured to drive the first medical instrument along a first axis, and the second robotic arm configured to drive the second medical instrument through the working channel of the first medical instrument;
a processor; and
a memory storing computer-executable instructions to cause the processor to:
determine a first force at the first IDM,
determine a second force at the second IDM,
determine that both of the first and second forces are greater than a threshold force, and
determine that the first and second robotic arms are misaligned in response to the processor determining that both of the first and second forces are greater than the threshold force.
2. The system of claim 1 , wherein the memory further stores computer-executable instructions to cause the processor to:
determine based on insertion data that the second medical instrument was being driven through the first medical instrument at the time that the second force was detected,
wherein the determination that the first and second robotic arms are misaligned is further in response to the processor determining that the second medical instrument was being driven through the first medical instrument.
3. The system of claim 2 , wherein the memory further stores computer-executable instructions to cause the processor to:
determine based on the insertion data that the first medical instrument was being driven at the time that the first and second IDMs experienced the first and second forces, respectively,
determine that the first force is greater than the threshold value, and
determine that the first robotic arm is misaligned with a patient introducer configured to guide the first medical instrument into a patient, in response to the processor determining that the first medical instrument was being driven at the time that the first and second IDMs experienced the first and second forces and determining that the first force is greater than the first threshold value.
4. The system of claim 2 , wherein each of the first and second medical instruments comprises one of: a sheath, a leader, a needle, forceps, and a brush.
5. The system of claim 1 , wherein the memory further stores computer-executable instructions to cause the processor to:
determine that the first and second forces are in opposing directions, and
determine that a difference between the magnitudes of the first and second forces is less than a threshold difference,
wherein the determination that the first and second robotic arms are misaligned is further in response to the processor determining that the first and second forces are in opposing directions and that the difference between the magnitudes of the first and second forces is less than the threshold difference.
6. The system of claim 1 , wherein each of the first and second robotic arms comprises:
at least two linkages,
at least one joint connecting the at least two linkages, and
at least one torque sensor configured to detect torque between the at least two linkages.
7. The system of claim 6 , wherein the memory further stores computer-executable instructions to cause the processor to:
measure a first torque value at the at least one joint of the first robotic arm based on an output of the torque sensor,
determine a second torque value at the at least one joint of the first robotic arm based on a position of the first robotic arm, the second torque value indicative of a gravitational component of the torque between the at least two linkages,
determine a first force at the first IDM based on a difference between the first and second torque values, and
determine, based on the first force at the first IDM, whether a collision has occurred between the first robotic arm and an object.
8. The system of claim 7 , wherein the memory further stores computer-executable instructions to cause the processor to:
encode an indication of the collision between the first robotic arm and the object, and
provide the encoded indication of the collision to a display configured to render encoded data.
9. The system of claim 7 , wherein the memory further stores computer-executable instructions to cause the processor to:
determine a first component of the first force applied to the first IDM along a second axis perpendicular to the first axis, and
determine that the first component of the first force is greater than a first threshold value,
wherein the determining of the collision is further based on the processor determining that the first component of the first force is greater than the first threshold value.
10. The system of claim 9 , wherein the memory further stores computer-executable instructions to cause the processor to:
determine a second component of the first force applied to the IDM along the first axis, and
determine that the second component of the first force is greater than a second threshold value,
wherein the determining of the collision is further based on the processor determining that the second component of the first force is greater than the second threshold value, the second threshold value greater than an expected force of insertion of the first medical instrument.
11. A non-transitory computer readable storage medium having stored thereon instructions that, when executed, cause at least one computing device to:
determine a first force at a first IDM connected to a distal end a first robotic arm;
determine a second force at a second IDM connected to a distal end a second robotic arm, the first robotic arm configured to drive a first medical instrument comprising a working channel along a first axis, and the second robotic arm configured to drive a second medical instrument through the working channel of the first medical instrument;
determine that both of the first and second forces are greater than a threshold force; and
determine that the first and second robotic arms are misaligned in response to the determination that both of the first and second forces are greater than the threshold force.
12. The non-transitory computer readable storage medium of claim 11 , further having stored thereon instructions that, when executed, cause at least one computing device to:
determine based on insertion data that the second medical instrument was being driven through the first medical instrument at the time that the second force was detected,
wherein the determination that the first and second robotic arms are misaligned is further in response to the determination that the second medical instrument was being driven through the first medical instrument.
13. The non-transitory computer readable storage medium of claim 12 , further having stored thereon instructions that, when executed, cause at least one computing device to:
determine based on the insertion data that the first medical instrument was being driven at the time that the first and second IDMs experienced the first and second forces, respectively;
determine that the first force is greater than the threshold value; and
determine that the first robotic arm is misaligned with a patient introducer configured to guide the first medical instrument into a patient in response to the determination that the first medical instrument was being driven at the time that the first and second IDMs experienced the first and second forces and determining that the first force is greater than the first threshold value.
14. The non-transitory computer readable storage medium of claim 12 , wherein each of the first and second medical instruments comprise one of: a sheath, a leader, a needle, forceps, and a brush.
15. The non-transitory computer readable storage medium of claim 11 , further having stored thereon instructions that, when executed, cause at least one computing device to:
determine that the first and second forces are in opposing directions; and
determine that a difference between the magnitudes of the first and second forces is less than a threshold difference,
wherein the determination that the first and second robotic arms are misaligned is further in response to the determination that the first and second forces are in opposing directions and that the difference between the magnitudes of the first and second forces is less than the threshold difference.
16. The non-transitory computer readable storage medium of claim 11 , wherein each of the first and second robotic arms comprises:
at least two linkages,
at least one joint connecting the at least two linkages, and
at least one torque sensor configured to detect torque between the at least two linkages.
17. The non-transitory computer readable storage medium of claim 16 , further having stored thereon instructions that, when executed, cause at least one computing device to:
measure a first torque value at the at least one joint of the first robotic arm based on an output of the torque sensor;
determine a second torque value at the at least one joint of the first robotic arm based on a position of the first robotic arm, the second torque value indicative of a gravitational component of the torque between the at least two linkages;
determine a first force at the first IDM based on a difference between the first and second torque values; and
determine, based on the first force at the first IDM, whether a collision has occurred between the first robotic arm and an object.
18. The non-transitory computer readable storage medium of claim 17 , further having stored thereon instructions that, when executed, cause at least one computing device to:
encode an indication of the collision between the first robotic arm and the object; and
provide the encoded indication of the collision to a display configured to render encoded data.
19. The non-transitory computer readable storage medium of claim 17 , further having stored thereon instructions that, when executed, cause at least one computing device to:
determine a first component of the first force applied to the first IDM along a second axis perpendicular to the first axis; and
determine that the first component of the first force is greater than a first threshold value,
wherein the determining of the collision is further based on determining that the first component of the first force is greater than the first threshold value.
20. The non-transitory computer readable storage medium of claim 19 , further having stored thereon instructions that, when executed, cause at least one computing device to:
determine a second component of the first force applied to the IDM along the first axis; and
determine that the second component of the first force is greater than a second threshold value,
wherein the determining of the collision is further based on determining that the second component of the first force is greater than the second threshold value, the second threshold value greater than an expected force of insertion of the first medical instrument.
21. A method of positioning a first robotic arm, comprising:
determining a first force at a first IDM connected to a distal end of a first robotic arm;
determining a second force at a second IDM connected to a distal end of a second robotic arm, the first robotic arm configured to drive a first medical instrument comprising a working channel along a first axis, and the second robotic arm configured to drive a second medical instrument through the working channel of the first medical instrument;
determining that both of the first and second forces are greater than a threshold force; and
determining that the first and second robotic arms are misaligned in response to the determination that both of the first and second forces are greater than the threshold force.
22. The method of claim 21 , further comprising:
determining, based on insertion data, that the second medical instrument was being driven through the first medical instrument at the time that the second force was detected,
wherein the determination that the first and second robotic arms are misaligned is further in response to the determination that the second medical instrument was being driven through the first medical instrument.
23. The method of claim 22 , further comprising:
determining, based on the insertion data, that the first medical instrument was being driven at the time that the first and second IDMs experienced the first and second forces, respectively;
determining that the first force is greater than the threshold value; and
determining that the first robotic arm is misaligned with a patient introducer configured to guide the first medical instrument into a patient, in response to the determination that the first medical instrument was being driven at the time that the first and second IDMs experienced the first and second forces and that the first force is greater than the first threshold value.
24. The method of claim 22 , wherein each of the first and second medical instruments comprise one of: a sheath, a leader, a needle, forceps, and a brush.
25. The method of claim 21 , further comprising:
determining that the first and second forces are in opposing directions; and
determining that a difference between the magnitudes of the first and second forces is less than a threshold difference,
wherein the determination that the first and second robotic arms are misaligned is further in response to the determination that the first and second forces are in opposing directions and that the difference between the magnitudes of the first and second forces is less than the threshold difference.
26. The method of claim 21 , wherein each of the first and second robotic arms comprises:
at least two linkages,
at least one joint connecting the at least two linkages, and
at least one torque sensor configured to detect torque between the at least two linkages.
27. The method of claim 26 , further comprising:
measuring a first torque value at the at least one joint of the first robotic arm based on an output of the torque sensor;
determining a second torque value at the at least one joint of the first robotic arm based on a position of the first robotic arm, the second torque value indicative of a gravitational component of the torque between the at least two linkages;
determining a first force at the first IDM based on a difference between the first and second torque values; and
determining, based on the first force at the first IDM, whether a collision has occurred between the first robotic arm and an object.
28. The method of claim 27 , further comprising:
encoding an indication of the collision between the first robotic arm and the object; and
providing the encoded indication of the collision to a display configured to render encoded data.
29. The method of claim 26 , further comprising:
determining a first component of the first force applied to the first IDM along a second axis perpendicular to the first axis; and
determining that the first component of the first force is greater than a first threshold value,
wherein the determining of the collision is further based on determining that the first component of the first force is greater than the first threshold value.
30. The method of claim 29 , further comprising:
determining a second component of the first force applied to the IDM along the first axis; and
determining that the second component of the first force is greater than a second threshold value,
wherein the determining of the collision is further based on determining that the second component of the first force is greater than the second threshold value, the second threshold value greater than an expected force of insertion of the first medical instrument.