Robotic systems providing co-registration using natural fiducials and related methods
A method may be provided to operate a medical system. First data may be provided for a first 3-dimensional (3D) image scan of an anatomical volume, with the first data identifying a blood vessel node in a first coordinate system for the first 3D image scan. Second data may be provided for a second 3D image scan of the anatomical volume, with the second data identifying the blood vessel node in a second coordinate system for the second 3D image scan. The first and second coordinate systems for the first and second 3D image scans of the anatomical volume may be co-registered using the blood vessel node identified in the first data and in the second data as a fiducial.
1. A method of performing cranial surgery comprising the steps of:
providing a robotic system having a robotic arm configured to position a surgical end effector with respect to an anatomical volume of a patient;
providing a controller coupled with the robotic arm;
providing first data for a first 3-dimensional (3D) image scan of the anatomical volume, wherein the first data identifies a blood vessel node in a first coordinate system for the first 3D image scan;
providing second data for a second 3D image scan of the anatomical volume, wherein the second data identifies the blood vessel node in a second coordinate system for the second 3D image scan, wherein the controller derives the second data by processing the second 3D image scan, which includes traversing a blood vessel in an upstream direction to find the largest blood vessel and then mapping each downstream blood vessel node by its 3D location;
performing co-registering of the first and second coordinate systems for the first and second 3D image scans of the anatomical volume using the blood vessel node identified in the first data and in the second data as a fiducial;
co-registering the second coordinate system for the second 3D image scan and a third coordinate system for the robotic actuator using an artificial fiducial from the second 3D image scan; and
controlling the robotic arm to move the end-effector to a target trajectory relative to the anatomical volume based on the co-registration of the first and second coordinate systems for the first and second 3D image scans using the blood vessel node and based on the co-registration of the second coordinate system for the second 3D image scan and the third coordinate system for the robotic actuator.
2. The method of claim 1 ,
wherein the blood vessel node is a first blood vessel node,
wherein the first data identifies the first blood vessel node, a second blood vessel node, and a third blood vessel node in the first coordinate system,
wherein the second data identifies the first blood vessel node, the second blood vessel node, and the third blood vessel node in the second coordinate system, and
wherein co-registering comprises co-registering the first and second coordinate systems for the first and second 3D image scans of the anatomical volume using the first, second, and third blood vessel nodes identified in the first data and in the second data as first, second, and third fiducials.
3. The method of claim 1 , wherein the first data identifies a target location in the anatomical volume, wherein the second data identifies the artificial fiducial outside the anatomical volume, wherein
controlling the robotic actuator comprises controlling the robotic actuator to move the end-effector to the target trajectory based on the first data identifying the target location and based on co-registering the second and third coordinate systems.
4. The method of claim 3 , wherein the blood vessel node is a first blood vessel node, wherein the first data identifies the first blood vessel node, a second blood vessel node, and a third blood vessel node in the first coordinate system, wherein the second data identifies the first blood vessel node, the second blood vessel node, and the third blood vessel node in the second coordinate system, and wherein co-registering comprises co-registering the first and second coordinate systems for the first and second 3D image scans of the anatomical volume using the first, second, and third blood vessel nodes identified in the first data and in the second data as first, second, and third fiducials, wherein the controller is further configured to,
provide the target location in at least one of the second and third coordinate systems using a transformation based on the first, second, and third blood vessel nodes in the first and second coordinate systems;
wherein controlling the robotic arm further comprises controlling the robotic actuator to move the end-effector to the target trajectory based on providing the target location in one of the second and third coordinate systems using the transformation.
5. The method of claim 4 , wherein the transformation comprises an affine transformation.
6. The method of claim 3 , wherein co-registering the second and third coordinate systems comprises co-registering the second and third coordinate systems using optical information from tracking cameras to locate the artificial fiducial in the third coordinate system for the robotic actuator.
7. The method of claim 1 , wherein the blood vessel node comprises a branch of one trunk blood vessel into at least first and second branch blood vessels, wherein a size of the trunk blood vessel is greater than a size of the first branch blood vessel and a size of the second branch blood vessel.
8. The method of claim 7 , wherein the first data for the first 3D image scan identifies a number of the at least first and second branch blood vessels of the blood vessel node, and wherein providing the second data comprises identifying the blood vessel node in the second 3D image scan based on the number of the at least first and second branch blood vessels of the blood vessel node.
9. The method of claim 7 , wherein the first data for the first 3D image scan identifies a length of the trunk blood vessel between the blood vessel node and a previous blood vessel node, and wherein providing the second data comprises identifying the blood vessel node in the second 3D image scan based on the length of the trunk blood vessel between the blood vessel node and the previous blood vessel node.
10. The method of claim 7 , wherein the first data for the first 3D image scan identifies an angle between the first and second branch blood vessels, and wherein providing the second data comprises identifying the blood vessel node in the second 3D image scan based on the angle between the first and second branch blood vessels.
11. The method of claim 7 , wherein the first data for the first 3D image scan identifies a shape of at least one of the trunk blood vessel, the first branch blood vessel, and/or the second branch blood vessel, and wherein providing the second data comprises identifying the blood vessel node in the second 3D image scan based on the shape of the at least one of the trunk blood vessel, the first branch blood vessel, and/or the second branch blood vessel.
12. A method of operating a medical system, the method comprising:
providing a robotic system configured to operate a robotic actuator to position an end effector with respect to an anatomical volume of a patient;
providing first data for a first 3-dimensional (3D) image scan of an anatomical volume, wherein the first data identifies a blood vessel node in a first coordinate system for the first 3D image scan;
providing second data for a second 3D image scan of the anatomical volume, wherein the second data identifies the blood vessel node in a second coordinate system for the second 3D image scan, wherein the second data is derived by processing the second 3D image scan, which includes traversing a blood vessel in an upstream direction to find the largest blood vessel and then mapping each downstream blood vessel node by its 3D location;
co-registering the first and second coordinate systems for the first and second 3D image scans of the anatomical volume using the blood vessel node identified in the first data and in the second data as a fiducial;
co-registering the second coordinate system for the second 3D image scan and a third coordinate system for the robotic actuator using an artificial fiducial from the second 3D image scan; and
controlling the robotic actuator to move the end-effector to a target trajectory relative to the anatomical volume based on the co-registering of the first and second coordinate systems for the first and second 3D image scans using the blood vessel node and based on the co-registration of the second coordinate system for the second 3D image scan and the third coordinate system for the robotic actuator.
13. The method of claim 12 ,
wherein the blood vessel node is a first blood vessel node,
wherein the first data identifies the first blood vessel node, a second blood vessel node, and a third blood vessel node in the first coordinate system,
wherein the second data identifies the first blood vessel node, the second blood vessel node, and the third blood vessel node in the second coordinate system, and
wherein co-registering comprises co-registering the first and second coordinate systems for the first and second 3D image scans of the anatomical volume using the first, second, and third blood vessel nodes identified in the first data and in the second data as first, second, and third fiducials.
14. The method of claim 12 , wherein the medical system comprises a robotic medical system including a robotic actuator configured to position an end-effector with respect to an anatomical volume of a patient, the method further comprising:
controlling the robotic actuator to move the end-effector to a target trajectory relative to the anatomical volume based on co-registering the first and second coordinate systems for the first and second 3D image scans using the first, second, and third blood vessel nodes.
15. The method of claim 12 , wherein the blood vessel node is a first blood vessel node, wherein the first data identifies the first blood vessel node, a second blood vessel node, and a third blood vessel node in the first coordinate system, wherein the second data identifies the first blood vessel node, the second blood vessel node, and the third blood vessel node in the second coordinate system, and wherein co-registering comprises co-registering the first and second coordinate systems for the first and second 3D image scans of the anatomical volume using the first, second, and third blood vessel nodes identified in the first data and in the second data as first, second, and third fiducials, the method further comprising:
providing the target location in one of the second and third coordinate systems using a transformation based on the first, second, and third blood vessel nodes in the first and second coordinate systems;
wherein controlling the robotic actuator further comprises controlling the robotic actuator to move the end-effector to the target trajectory based on providing the target location in one of the second and third coordinate systems using the transformation.
16. The method of claim 15 , wherein the transformation comprises an affine transformation.
17. The method of claim 12 , wherein co-registering the second and third coordinate systems comprises co-registering the second and third coordinate systems using optical information from tracking cameras to locate the artificial fiducial in the third coordinate system for the robotic actuator.
18. The method of claim 12 , wherein the blood vessel node comprises a branch of one trunk blood vessel into at least first and second branch blood vessels, wherein a size of the trunk blood vessel is greater than a size of the first branch blood vessel and a size of the second branch blood vessel.
19. The method of claim 18 , wherein the first data for the first 3D image scan identifies a number of the at least first and second branch blood vessels of the blood vessel node, and wherein providing the second data comprises identifying the blood vessel node in the second 3D image scan based on the number of the at least first and second branch blood vessels of the blood vessel node.