Ultrasonic robotic surgical navigation
Surgical robot systems, anatomical structure tracker apparatuses, and US transducer apparatuses are disclosed. A surgical robot system includes a robot, a US transducer, and at least one processor. The robot includes a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm. The end-effector is configured to guide movement of a surgical instrument. The US transducer is coupled to the end-effector and operative to output US imaging data of anatomical structure proximately located to the end-effector. The least one processor is operative to obtain an image volume for the patient and to track pose of the end-effector relative to anatomical structure captured in the image volume based on the US imaging data.
1. A surgical robot system comprising:
a robot having a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector configured to guide movement of a surgical instrument;
an array of ultrasound (US) transducers coupled to the end-effector and adapted to be in physical contact with a patient body, the array of US transducers operative to transmit a plurality of US signals into the patient body and output, from reflected US signals, US imaging data of anatomical structure of the patient proximately located to the end-effector; and
a processor operative to obtain a computerized 3D image volume for the patient which has been derived from a medical imaging device and to track pose of the end-effector relative to anatomical structure in the 3D image volume based on the US imaging data.
2. The surgical robot system of claim 1 , wherein the processor is operative to:
match the anatomical structure captured in the US images to the anatomical structure in the 3D image volume; and
determine the pose of the end-effector relative to the anatomical structure captured in the image volume based on the match.
3. The surgical robot system of claim 1 , wherein the end-effector includes a guide tube configured to receive the surgical instrument, and the array of US transducer are uniformly spaced apart at a bottom of the guide tube.
4. The surgical robot system of claim 3 , wherein the US transducers are spaced apart to form a ring shape.
5. The surgical robot system of claim 1 , wherein the array of US transducers comprise a planar array of US transducers connected by a mounting arm to the end-effector.
6. The surgical robot system of claim 1 , wherein the processor is further operative to:
identify in the US imaging data locations of discrete features which are spaced apart along the surgical instrument; and
determine longitudinal and rotational positions of the surgical instrument relative to the end-effector based on the identified locations of the discrete features in the US imaging data.
7. The surgical robot system of claim 6 , further comprising the surgical instrument having a shaft with the discrete features configured as indentations, protrusions, slots, or holes spaced apart along a shaft of the surgical instrument.
8. The surgical robot system of claim 6 , wherein the processor is operative to:
determine a depth of the surgical instrument relative to the end-effector based on counting a number of the discrete features identified in the US imaging data; and
determine rotation of the surgical instrument relative to the end-effector based on identifying rotation of the discrete features identified in the US imaging data between adjacent US transducers in the array.
9. The surgical robot system of claim 6 , wherein to determine pose of the surgical instrument relative to the end-effector based on the locations of the discrete features identified in the US imaging data, the processor is operative to:
match a spatial pattern of the locations of the discrete features identified in the US imaging data to content of a template for the surgical instrument which defines a pattern of the discrete features arranged around the surface of the surgical instrument shaft as a function of locations along a length of the surgical instrument.
10. The surgical robot system of claim 1 , wherein the processor is further operative to:
identify in the US imaging data locations of layers of materials of the surgical instrument, wherein adjacent layers of the materials have different reflectivity to ultrasound; and
determine pose of the surgical instrument relative to the end-effector based on the locations of the layers of materials of the surgical instrument identified in the US imaging data.
11. The surgical robot system of claim 10 , further comprising the surgical instrument having a shaft with layers of materials stacked along a primary axis of the shaft, wherein adjacent layers of the materials have different reflectivity to US.
12. The surgical robot system of claim 10 , further comprising the surgical instrument having a shaft with layers of materials forming helical stripes spiraling about a primary axis of the shaft, wherein adjacent layers of the materials have different reflectivity to US.
13. The surgical robot system of claim 10 , further comprising the surgical instrument having a shaft with layers of materials forming stripes extending parallel to a primary axis of the shaft, wherein adjacent layers of the materials have different reflectivity to US.
14. A surgical robot system comprising:
a robot having a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector configured to guide movement of a surgical instrument;
an array of ultrasound (US) transducer coupled to the end-effector and adapted to be in physical contact with a patient body, the array of US transducers operative to transmit a plurality of US signals into the patient body and output, from reflected US signals, US imaging data of anatomical structure proximately located to the end-effector; and
a processor operative to obtain a computerized 3D image volume for the patient which has been derived from a medical imaging device and to track pose of the end-effector relative to anatomical structure in the 3D image volume based on the US imaging data, the processor further operative to:
store a target pose for the surgical instrument based on a surgical plan defining where a surgical procedure is to be performed using the surgical instrument on the computerized 3D image volume; and
generate steering information based on the stored target pose for the surgical instrument and a present tracked pose of the end-effector relative to the anatomical structure captured in the image volume, the steering information indicating where the surgical instrument and/or the end-effector need to be moved.
15. The surgical robot system of claim 14 , further comprising at least one motor operatively connected to move the robot arm relative to the robot base, and wherein the processor is operative to:
control movement of the at least one motor based on the steering information to guide movement of the end-effector to place the surgical instrument in the target pose.
16. The surgical robot system of claim 1 , further comprising kinematic sensors connected to the robot arm and operative to output kinematic movement data indicating change in pose of the robot arm relative to the robot base, and wherein the processor is operative to:
after tracking pose of the end-effector relative to the anatomical structure in the 3D image volume based on the US imaging data for a period of time and responsive to the US transducers ceasing to output US imaging data of the anatomical structure, trigger continued tracking of the pose of the end-effector relative to the anatomical structure based on the kinematic movement data; and
responsive to the US transducers resuming output of US imaging data of the anatomical structure, trigger continued tracking of the pose of the end-effector relative to the anatomical structure in the 3D image volume based on the US imaging data.
17. The surgical robot system of claim 16 , wherein to trigger continued tracking of the pose of the end-effector relative to the anatomical structure based on the US imaging data, the processor is operative to:
generate US images of the anatomical structure based on the US imaging data;
select a portion of the 3D image volume based on a present pose of the end-effector as tracked relative to the anatomical structure in the 3D image volume based on the kinematic movement data;
match structure of the anatomical structure captured in one of the US images to structure of the anatomical structure in the selected portion of the 3D image volume; and
determine the pose of the end-effector relative to the anatomical structure in the selected portion of the 3D image volume based on the matching.
18. The surgical robot system of claim 16 , wherein the processor is further operative to:
display a graphical representation of the end-effector with the determined pose relative to a graphical representation of the anatomy in the 3D image volume; and
use a different color and/or shading to display the graphical representation of the end-effector relative to the graphical representation of the anatomy in the 3D image volume to visually indicate to a user when the pose of the end-effector relative to the anatomical structure is being tracked based on the US imaging data distinguishable by the user from when the pose of the end-effector relative to the anatomical structure in the 3D image volume is being tracked based on the kinematic movement data.
19. The surgical robot system of claim 1 , further comprising a tracking camera operative to track pose of optical markers on the robot arm or the end-effector, and wherein the processor is operative to:
after tracking pose of the end-effector relative to the anatomical structure in the 3D image volume based on the US imaging data for a period of time and responsive to the US transducers ceasing to output US imaging data of the anatomical structure proximately located to the end-effector, trigger continued tracking of the pose of the end-effector relative to the anatomical structure based on output of the tracking camera; and
responsive to the US transducers resuming output of US imaging data of the anatomical structure proximately located to the end-effector, trigger continued tracking of the pose of the end-effector relative to the anatomical structure based on the US imaging data.
20. A surgical robot system comprising:
a robot having a robot base, a robot arm coupled to the robot base, and an end-effector coupled to the robot arm, the end-effector configured to guide movement of a surgical instrument;
an array of ultrasound (US) transducer coupled to the end-effector and adapted to be in physical contact with a patient body, the array operative to output US imaging data of anatomical structure proximately located to the end-effector; and
at least one processor operative to obtain a computerized 3D image volume for the patient which has been derived from a medical imaging device and to track pose of the end-effector relative to anatomical structure in the 3D image volume based on the US imaging data;
a tracking camera operative to capture location of optical markers on the robot armor the end-effector, wherein the at least one processor is operative to:
track pose of the optical markers;
after tracking pose of the end-effector relative to the anatomical structure in the 3D image volume based on the US imaging data for a period of time and responsive to the US transducers ceasing to output US imaging data of the anatomical structure proximately located to the end-effector, trigger continued tracking of the pose of the end-effector relative to the anatomical structure based on output of the tracking camera; and
responsive to the US transducer resuming output of US imaging data of the anatomical structure proximately located to the end-effector, trigger continued tracking of the pose of the end-effector relative to the anatomical structure in the 3D image volume based on the US imaging data.