Combining strain-based shape sensing with catheter control
Provided are robotic systems and methods for navigation of luminal network that can improve strain-based shape sensing. In one aspect, the system can compare strain-based shape data to shape data determined based on robotic data (e.g., kinematic model data, torque measurements, mechanical model data, command data, etc.) and adjust the strain-based shape data as necessary. Any portion of the strain-based shape data can be adjusted, weighted differently, or discarded based on the comparison. For example, data from trustworthy sources may indicate that the shape of an instrument exhibits or should exhibit one or more characteristics. If the system determines that any portion of the strain-based shape data is not in agreement with such characteristics, the system may adjust the portion of the strain-based shape data such that the adjusted strain-based shape data is in agreement with the characteristics of the instrument.
1. A method of controlling an instrument within an interior region of a body, the method comprising:
accessing robotic command data configured to instruct positioning of the instrument;
accessing strain data from an optical fiber positioned within the instrument that is indicative of a strain on a portion of the instrument positioned within the interior region of the body;
determining shape data based on the strain data;
determining that the shape data indicates a curvature value that exceeds a curvature value indicated by the robotic command data;
based on the curvature value exceeding the curvature value indicated by the robotic command data, determining adjusted shape data;
determining an estimated state of the instrument based on the adjusted shape data; and
outputting the estimated state of the instrument.
2. The method of claim 1 , further comprising:
accessing electromagnetic (EM) data captured using (i) an EM sensor located proximal to a tip of the instrument and (ii) at least one external EM sensor or EM field generator located external to the body; and
comparing the EM data and the shape data;
wherein the adjusted shape data is based on the comparison of the EM data and the shape data.
3. The method of claim 1 , further comprising:
accessing image data captured by an imaging device located proximal to a tip of the instrument; and
comparing the image data and the shape data;
wherein the adjusted shape data is based on the comparison of the image data and the shape data.
4. The method of claim 1 , wherein:
said adjusting the shape data involves discarding the shape data that is based on the strain data; and
determining the adjusted shape data is based on the robotic command data.
5. The method of claim 1 , further comprising:
based on the estimated state of the instrument, determining that a damage to the instrument is imminent; and
controlling the instrument such that the damage is avoided.
6. The method of claim 1 , wherein the shape data comprises time history data of the portion of the instrument.
7. The method of claim 1 , further comprising, based on a determination that a first portion of the instrument comprises a distal end of the instrument, assigning a first confidence value to a portion of the robotic command data corresponding to the first portion that is higher than a second confidence value assigned to a portion of the shape data corresponding to the first portion.
8. A non-transitory computer readable storage medium having stored thereon instructions that, when executed, cause a processor of a device to at least:
access robotic command data configured to instruct positioning of a medical instrument;
access strain data from an optical fiber positioned within the medical instrument that is indicative of a strain on a portion of the medical instrument positioned within an interior region of a patient's body;
determine shape data based on the strain data;
determine that the shape data indicates a speed of movement of the medical instrument that exceeds a speed of movement indicated by the robotic command data;
based on the speed of movement exceeding the speed of movement indicated by the robotic command data, determining adjusted shape data;
determine an estimated state of the medical instrument based on the adjusted shape data; and
output the estimated state of the medical instrument.
9. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, further cause the processor to:
access electromagnetic (EM) data captured using (i) an EM sensor located proximal to a tip of the medical instrument and (ii) at least one external EM sensor or EM field generator located external to the body; and
compare the EM data and the shape data;
wherein the adjusted shape data is based on the comparison of the EM data and the shape data.
10. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, further cause the processor to:
access image data captured by an imaging device located proximal to a tip of the medical instrument; and
compare the image data and the shape data;
wherein the adjusted shape data is based on the comparison of the image data and the shape data.
11. The non-transitory computer readable storage medium of claim 8 , wherein:
said adjusting the shape data involves discarding the shape data that is based on the strain data; and
determining the adjusted shape data is based on the robotic command data.
12. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, further cause the processor to:
based on the estimated state of the medical instrument, determine that a damage to the medical instrument is imminent; and
control the medical instrument such that the damage is avoided.
13. The non-transitory computer readable storage medium of claim 8 , wherein the shape data comprises one of a curvature value of the portion of the medical instrument or time history data of the portion of the instrument.
14. The non-transitory computer readable storage medium of claim 8 , wherein the instructions, when executed, further cause the processor to, based on a determination that a first portion of the medical instrument comprises a distal end of the medical instrument, assign a first confidence value to a portion of the robotic command data corresponding to the first portion that is higher than a second confidence value assigned to a portion of the shape data corresponding to the first portion.
15. A medical robotic system for controlling an instrument within an interior region of a body, the system comprising:
an instrument having an optical fiber, the optical fiber positioned within the instrument;
a sensor configured to generate strain data that is indicative of a strain on a portion of the instrument positioned within the interior region of the body;
an instrument positioning device attached to the instrument and configured to move the instrument;
at least one computer-readable memory having stored thereon executable instructions; and
one or more processors in communication with the at least one computer-readable memory and configured to execute the instructions to cause the system to at least:
access robotic data regarding the instrument;
access the strain data;
determine shape data based on the strain data;
determine that the shape data indicates a curvature value that exceeds a curvature value indicated by the robotic data;
based on the curvature value exceeding the curvature value indicated by the robotic data, determine adjusted shape data;
determine an estimated state of the instrument based on the adjusted shape data; and
output the estimated state of the instrument.
16. The medical robotic system of claim 15 , wherein the instructions, when executed, further cause the system to, based on a determination that a first portion of the instrument comprises a distal end of the instrument, assign a first confidence value to a portion of the robotic data corresponding to the first portion that is higher than a second confidence value assigned to a portion of the shape data corresponding to the first portion.
17. The medical robotic system of claim 15 , wherein the instructions, when executed, further cause the system to:
access electromagnetic (EM) data captured using (i) an EM sensor located proximal to a tip of the instrument and (ii) at least one external EM sensor or EM field generator located external to the body; and
compare the EM data and the shape data;
wherein the adjusted shape data is based on the comparison of the EM data and the shape data.
18. The medical robotic system of claim 15 , wherein the instructions, when executed, further cause the system to:
access image data captured by an imaging device located proximal to a tip of the instrument; and
compare the image data and the shape data;
wherein the adjusted shape data is based on the comparison of the image data and the shape data.
19. The medical robotic system of claim 15 , wherein the instructions, when executed, further cause the system to:
based on the estimated state of the instrument, determine that a damage to the instrument is imminent; and
control the instrument such that the damage is avoided.
20. The medical robotic system of claim 15 , wherein said determining the adjusted shape data involves adjusting a confidence value associated with the shape data, such that the adjusted shape data comprises the shape data associated with the adjusted confidence value.