Device and method for tracking the position of an endoscope within a patient's body
Systems and methods of tracking the position of an endoscope within a patient's body during an endoscopic procedure is disclosed. The devices and methods include determining a position of the endoscope within the patient in the endoscope's coordinate system, capturing in an image fiducial markers attached to the endoscope by an external optical tracker, transforming the captured fiducial markers from the endoscope's coordinate system to the optical tracker's coordinate system, projecting a virtual image of the endoscope on a model of the patient's organ, and projecting or displaying the combined image.
1. A method of tracking a position of an endoscope, wherein the endoscope includes an endoscope handle and an endoscope body adapted to be inserted into a patient, the method comprising:
receiving first orientation data from a plurality of first sensors positioned at different locations longitudinally along the endoscope body;
receiving second orientation data from one or more cameras positioned external to the patient, wherein the one or more cameras are adapted to (i) detect one or more of a plurality of orientation markers positioned on the endoscope handle and (ii) generate the second orientation data using data associated with the detected one or more of the plurality of orientation markers;
generating, using the first orientation data and the second orientation data, a virtual model of the endoscope body in a coordinate system of the endoscope and the patient showing a position of the endoscope within the patient; and
sending data indicative of the virtual model to a projector, wherein the projector is configured to project the virtual model in a coordinate system of the endoscope body and the patient showing a position of the endoscope body within the patient.
2. The method of claim 1 , wherein the first sensors are pressure sensors.
3. The method of claim 1 , wherein at least one electromagnetic coil is wound around one or more portions of the endoscope body, wherein the electromagnetic coil is configured to emit an electromagnetic signal.
4. The method of claim 1 , wherein the one or more cameras include two stereo-calibrated cameras adapted to generate, by triangulation, at least a portion of the second orientation data comprising three-dimensional locations of fiducials in a coordinate system of the camera.
5. The method of claim 1 , wherein the virtual model is a holographic virtual model.
6. The method of claim 1 , further comprising receiving a measurement of bending or twisting of the endoscope body via one or more of an accelerometer, a gyroscope, a magnetometer, and a stripe.
7. The method of claim 1 , wherein the plurality of orientation markers comprise spheres placed on the endoscope handle, each sphere having a diameter ranging from 0.5 to 2 cm.
8. The method of claim 1 , wherein the virtual model includes a portion of the patient's colon.
9. The method of claim 1 , wherein the projector is configured to project the virtual model onto the patient to show the position of the endoscope body relative to the patient.
10. A method of tracking a position of medical device, wherein the medical device includes a handle and a tubular body adapted to be inserted into a patient, the method comprising:
receiving first orientation data from a plurality of first sensors positioned at different locations longitudinally along the tubular body;
receiving second orientation data from one or more cameras positioned external to the patient, wherein the one or more cameras are adapted to (i) detect one or more of a plurality of orientation markers positioned on the handle and (ii) generate the second orientation data using data associated with the detected one or more of the plurality of orientation markers;
generating, using the first orientation data and the second orientation data, a virtual model of the tubular body in a coordinate system of the medical device and the patient showing a position of the tubular body within the patient; and
sending data indicative of the virtual model to a display, wherein the display is configured to project the virtual model in a coordinate system of the tubular body and the patient showing a position of the tubular body within the patient.
11. The method of claim 10 , wherein the first sensors are pressure sensors.
12. The method of claim 11 , further comprising receiving a measurement of bending or twisting of the tubular body via one or more of an accelerometer, a gyroscope, a magnetometer, and a stripe.
13. The method of claim 11 , wherein the plurality of orientation markers comprise spheres placed on the handle, each sphere having a diameter ranging from 0.5 to 2 cm.
14. The method of claim 11 , wherein the virtual model includes a portion of the patient's colon.
15. The method of claim 11 , wherein the display is configured to project the virtual model onto the patient to show the position of the tubular body relative to the patient.
16. The method of claim 10 , wherein at least one electromagnetic coil is wound around one or more portions of the tubular body, wherein the electromagnetic coil is configured to emit an electromagnetic signal.
17. The method of claim 10 , wherein the one or more cameras include two stereo-calibrated cameras adapted to generate, by triangulation, at least a portion of the second orientation data comprising three-dimensional locations of fiducials in a coordinate system of the camera.
18. The method of claim 10 , wherein the virtual model is a holographic virtual model.
19. A method of tracking a position of an endoscope, wherein the endoscope includes an endoscope handle and an endoscope body adapted to be inserted into a patient, the method comprising:
determining a reference position of the endoscope body within the patient;
capturing at least one of a plurality of fiducial markers via an optical tracker;
transforming data from the captured fiducial markers from the endoscope's co-ordinates of the endoscope to co-ordinates of a camera;
and
displaying, onto the patient's body, a virtual image of an internal organ with the fiducial markers together with an image of the endoscope with the fiducial markers.
20. The method of claim 19 , wherein displaying a virtual image of an internal organ with the fiducial markers together with an image of the endoscope with the fiducial markers includes displaying a determined position of the endoscope within the internal organ.