Methods and systems for tracking and guiding sensors and instruments
A shared-housing ultrasound transducer and machine-vision camera system is disclosed for registering the transducer's x, y, z position in space and pitch, yaw, and roll orientation with respect to an object, such as a patient's body. The position and orientation are correlated with transducer scan data, and scans of the same region of the object are compared in order to reduce ultrasound artifacts and speckles. The system can be extended to interoperative gamma probes or other non-contact sensor probes and medical instruments. Methods are disclosed for computer or remote guiding of a sensor probe or instrument with respect to saved positions and orientations of the sensor probe.
1. A spatial registration apparatus comprising:
a gamma ray detector;
a ranging sensor rigidly connected with the gamma ray detector, wherein the ranging sensor is selected from a group consisting of an optical camera, a stereoscopic imaging camera, an infrared camera, a scanning laser camera, a flash laser camera, a time-of-flight camera, a structured light camera, and an electromagnetic sensor; and
at least one processor operatively coupled with a memory, the memory having instructions for execution by the at least one processor, wherein the memory stores a relative location and orientation between the gamma ray detector and the rigidly connected ranging sensor, wherein the instructions, when executed by the at least one processor, cause the at least one processor to capture distance values to selected points on a surface of an object scanned by the ranging sensor, create a three-dimensional (3D) model of the surface using the distance values, determine a pose of the ranging sensor with respect to the 3D model of the surface of the object, and then transform the pose, using the stored relative location and orientation between the gamma ray detector and the rigidly connected ranging sensor, to determine a first spatial position and orientation of the gamma ray detector with respect to the 3D model of the surface of the object, the at least one processor associating scanning data from the gamma ray detector with the first spatial position and orientation of the gamma ray detector to create a first spatially registered scan, the scanning data from the gamma ray detector being time synchronized with the first spatial position and orientation of the gamma ray detector.
2. The apparatus of claim 1 , wherein the gamma ray detector includes a Compton imager or a collimator based imager.
3. The apparatus of claim 1 , wherein the gamma ray detector includes a gamma ray probe that includes a semiconductor detector or a scintillator.
4. The apparatus of claim 1 , wherein the instructions for execution by the at least one processor further cause the processor to construct a two-dimensional (2D) or a 3D model of a radioactive tracer with respect to the object using the first spatially registered scan.
5. The apparatus of claim 4 , wherein the instructions for execution by the at least one processor further cause the processor to render, on a display, the 2D or 3D model of the radioactive tracer.
6. The apparatus of claim 1 , wherein
the object includes a body of a patient,
the instructions for execution by the at least one processor further cause the processor to guide a human or robotic operator to move a medical instrument to a particular point on or within the patient's body using the 3D model of the surface of the object.
7. A spatial registration apparatus comprising:
a gamma ray detector;
a ranging sensor rigidly connected with the gamma ray detector, wherein the ranging sensor is selected from a group consisting of an optical camera, a stereoscopic imaging camera, an infrared camera, a scanning laser camera, a flash laser camera, a time-of-flight camera, a structured light camera, and an electromagnetic sensor; and
at least one processor operatively coupled with a memory, the memory having instructions for execution by the at least one processor, wherein the memory stores a relative location and orientation between the gamma ray detector and the rigidly connected ranging sensor, wherein the instructions, when executed by the at least one processor, cause the at least one processor to capture distance values to selected points on a surface of an object scanned by the ranging sensor, determine a pose of the ranging sensor with respect to selected points on the surface of the object, and then transform the pose, using the stored relative location and orientation between the gamma ray detector and the rigidly connected ranging sensor, to determine a first spatial position and orientation of the gamma ray detector with respect to the selected points on the surface of the object, the at least one processor associating scanning data from the gamma ray detector with the first spatial position and orientation of the gamma ray detector to create a first spatially registered scan, the scanning data from the gamma ray detector being time synchronized with the first spatial position and orientation of the gamma ray detector.
8. The apparatus of claim 7 , wherein the gamma ray detector includes a Compton imager or a collimator based imager.
9. The apparatus of claim 7 , wherein the gamma ray detector includes a gamma ray probe that includes a semiconductor detector or a scintillator.
10. The apparatus of claim 7 , wherein the instructions for execution by the at least one processor further cause the processor to construct a two-dimensional (2D) or a three-dimensional (3D) model of a radioactive tracer with respect to the object using the first spatially registered scan.
11. The apparatus of claim 10 , wherein the instructions for execution by the at least one processor further cause the processor to render, on a display, the 2D or 3D model of the radioactive tracer.
12. A spatial registration apparatus comprising:
a gamma ray detector;
a camera rigidly connected with the gamma ray detector, wherein the camera is selected from a group consisting of an optical camera, a stereoscopic imaging camera, an infrared camera, a scanning laser camera, a flash laser camera, a time-of-flight camera, and a structured light camera; and
at least one processor operatively coupled with a memory, the memory having instructions for execution by the at least one processor, wherein the memory stores a relative location and orientation between the gamma ray detector and the rigidly connected camera, wherein the instructions, when executed by the at least one processor, cause the at least one processor to create a three-dimensional (3D) model of a surface of an object scanned by the camera by using at least two camera frames taken with the camera at different locations, determine a pose of the camera with respect to the 3D model of the surface of the object, and then transform the pose, using the stored relative location and orientation between the gamma ray detector and the rigidly connected camera, to determine a first spatial position and orientation of the gamma ray detector with respect to the 3D model of the surface of the object, the at least one processor associating scanning data from the gamma ray detector with the first spatial position and orientation of the gamma ray detector to create a first spatially registered scan, the scanning data from the gamma ray detector being time synchronized with the first spatial position and orientation of the gamma ray detector.
13. The apparatus of claim 12 , wherein the instructions for execution by the at least one processor further cause the processor to construct a two-dimensional (2D) or a 3D model of a radioactive tracer with respect to the object using the first spatially registered scan.
14. The apparatus of claim 13 , wherein the instructions for execution by the at least one processor further cause the processor to render, on a display, the 2D or 3D model of the radioactive tracer.
15. The apparatus of claim 12 , wherein
the object includes a body of a patient,
the instructions for execution by the at least one processor further cause the processor to guide a human or robotic operator to move a medical instrument to a particular point on or within the patient's body using the 3D model of the surface of the object.
16. A method for viewing a radioactive tracer within tissue of a subject, the method comprising:
placing a gamma ray detector and a ranging sensor over a subject, the ranging sensor rigidly connected with the gamma ray detector, wherein the ranging sensor is selected from a group consisting of an optical camera, a stereoscopic imaging camera, an infrared camera, a scanning laser camera, a flash laser camera, a time-of-flight camera, a structured light camera, and an electromagnetic sensor;
acquiring scanning data of a radioactive tracer within the subject from the gamma ray detector;
scanning the subject with the ranging sensor while acquiring the scanning data;
determining a pose of the ranging sensor with respect to the subject;
obtaining a stored relative location and orientation between the gamma ray detector and the rigidly connected ranging sensor;
transforming the pose using the relative location and orientation to determine a first spatial position and orientation of the gamma ray detector with respect to the subject;
associating the first spatial position and orientation of the gamma ray detector with the scanning data from the gamma ray detector to create a first spatially registered scan, the scanning data from the gamma ray detector being time synchronized with the first spatial position and orientation of the gamma ray detector;
building a two-dimensional (2D) or a three-dimensional (3D) model of the radioactive tracer using the first spatially registered scan; and
deriving visualization data from the 2D or 3D model.
17. The method of claim 16 , further comprising displaying the 2D or 3D model of the radioactive tracer with respect to an outline of a body of the subject.
18. The apparatus of claim 12 , wherein causing the at least one processor to create a 3D model of the surface of the object scanned by the camera comprises causing the at least one processor to create a 3D model of a surface of a body of a patient scanned by the camera.