Systems and methods for performing intraoperative guidance
Systems and methods are provided in which an intraoperative video feed is augmented with one or more virtual display features based on a detected orientation and position of the tracked medical instrument. In some example embodiments, the virtual display features may be employed to represent, in an augmented video feed, information associated with a previously-detected intraoperative position and orientation of the tracked medical instrument. The virtual display element may be employed, for example, to facilitate the alignment of an untracked medical instrument with a previously determined intraoperative position and orientation of the tracked medical instrument. In other example embodiments, the virtual display element may be dynamically displayed in a fixed spatial relationship relative to the tracked medical instrument.
1. A method of aligning an untrackable medical instrument during a medical procedure, the method comprising:
employing a tracking system to detect signals from fiducial markers associated with a trackable medical instrument;
processing the signals to determine, in a frame of reference associated with the tracking system, an intraoperative orientation and position of the trackable medical instrument;
employing a camera to obtain an intraoperative video feed;
displaying the intraoperative video feed;
during a subsequent phase of the medical procedure involving the untrackable medical instrument, employing a coordinate transformation between a frame of reference associated with the camera and the frame of reference associated with the tracking system to augment the intraoperative video feed with a virtual display feature identifying the previously determined intraoperative orientation and position of the trackable medical instrument; and
employing the virtual display feature within the augmented intraoperative video feed to align the untrackable medical instrument relative to the previously determined intraoperative orientation and position of the trackable medical instrument;
wherein the untrackable medical instrument is untrackable by the tracking system.
2. The method according to claim 1 wherein the tracking system comprises a first camera and a second camera defining a stereo camera pair, the method further comprising:
in the event that an accuracy of achieving visual alignment of the untracked medical instrument relative to the intraoperative orientation and position of the trackable medical instrument based on the displayed virtual display element is deemed to be impaired due to an alignment degeneracy, providing an indication to an operator, the indication instructing the operator to move and/or rotate the tracking system.
3. The method according to claim 1 wherein the virtual display feature comprises a virtual display of the trackable medical instrument.
4. The method according to claim 1 wherein the virtual display feature comprises a virtual display of the untrackable medical instrument.
5. The method according to claim 1 wherein the virtual display feature comprises a virtual display of a surgical implant.
6. The method according to claim 1 further comprising:
determining, based on the intraoperative orientation and position of the trackable medical instrument, a distal location corresponding to a distal end of the trackable medical instrument; and
rendering the virtual display feature such that at least a portion of the virtual display feature is indicative of the distal location.
7. The method according to claim 1 wherein the intraoperative orientation and position is determined at a time at which input is received from an operator.
8. The method according to claim 1 further comprising processing the intraoperative orientation and position of the trackable medical instrument to determine an intraoperative axis associated with the intraoperative orientation of the trackable medical instrument based on a model of the trackable medical instrument.
9. The method according to claim 8 wherein the intraoperative axis is determined according to a longitudinal axis of an elongate portion of the trackable medical instrument defined by the model.
10. The method according to claim 8 wherein the tracking system comprises a first camera and a second camera defining a stereo camera pair, the method further comprising:
determining whether or not the intraoperative axis lies within a plane that includes directional axes respectively associated with the first camera and the second camera; and
in the event that the intraoperative axis lies within a plane that includes directional axes respectively associated with the first camera and the second camera, providing an indication to an operator instructing the operator to move and/or rotate the tracking system to remove a degeneracy in determining the intraoperative axis.
11. The method according to claim 8 wherein the virtual display feature is a linear annotation indicating a position and orientation of the intraoperative axis.
12. The method according to claim 11 further wherein the linear annotation comprises a directional marker indicating a direction associated with a distal end of the trackable medical instrument.
13. The method according to claim 11 further comprising:
determining, based on the intraoperative orientation and position of the trackable medical instrument, a distal location corresponding to a distal end of the trackable medical instrument; and
rendering the virtual display feature such that the linear annotation overlaps with the distal location or extends from a position adjacent to the distal location.
14. The method according to claim 1 wherein the camera is a component of a surface detection system, and wherein the coordinate transformation is obtained according to a calibration between the surface detection system and the tracking system.
15. The method according to claim 14 the surface detection system is a structured light surface detection system.
16. A method of aligning an untrackable medical instrument during a medical procedure, the method comprising:
employing a surface detection system to detect signals from one or more surface fiducial features associated with a trackable medical instrument;
processing the signals to determine an intraoperative orientation and position of the trackable medical instrument;
employing a camera of the surface detection system to obtain an intraoperative video feed;
displaying the intraoperative video feed;
during a subsequent phase of the medical procedure involving the untrackable medical instrument, augmenting the intraoperative video feed with a virtual display feature associated with the previously determined intraoperative orientation and position of the trackable medical instrument; and
employing the virtual display feature within the augmented intraoperative video feed to align the untrackable medical instrument relative to the previously determined intraoperative orientation and position of the trackable medical instrument;
wherein the untrackable medical instrument is untrackable by the tracking system.
17. A method of aligning an untrackable medical instrument during a medical procedure, the method comprising:
employing a tracking system to detect signals from fiducial markers associated with a trackable medical instrument;
processing the signals to determine an intraoperative orientation and position of the trackable medical instrument;
employing a camera of the tracking system to obtain an intraoperative video feed;
displaying the intraoperative video feed;
during a subsequent phase of the medical procedure involving the untrackable medical instrument, augmenting the intraoperative video feed with a virtual display feature associated with the previously determined intraoperative orientation and position of the trackable medical instrument;
employing the virtual display feature within the augmented intraoperative video feed to align the untrackable medical instrument relative to the previously determined intraoperative orientation and position of the trackable medical instrument;
wherein the untrackable medical instrument is untrackable by the tracking system.
18. The method according to claim 17 wherein the tracking system includes a single camera.