Surgical systems and methods for positioning objects using augmented reality navigation
Surgical systems and methods are provided that utilize augmented reality navigation and visualization techniques for transferring aspects of a preoperative surgical plan to an actual surgical site. The surgical systems and methods may be utilized to achieve accurate alignment of a surgical positioning object, such as a guide pin for guiding surgical reaming procedures, between the preoperative surgical plan and the intraoperative anatomy associated with the actual surgical site. Augmented reality may be utilized to achieve visualization of both an entry point and a drilling trajectory of the surgical positioning object in a manner that avoids occluding the intraoperative anatomy during the procedure.
1 . An augmented reality system for a surgical system, comprising:
an augmented reality visualization device; and
a processor programmed to control the augmented reality visualization device to:
provide an augmented reality environment relative to a patient's anatomy;
allow a user to interface with the augmented reality environment for intraoperatively achieving a desired entry point and a desired trajectory of a surgical positioning object relative to the patient's anatomy;
virtually indicate the desired trajectory within the augmented reality environment with a virtual trajectory indicator; and
virtually indicate a difference between the desired trajectory and an actual trajectory of the surgical positioning object within the augmented reality environment with a directional indicator or an angular difference indicator,
wherein the virtual trajectory indicator and at least one of the directional indicator or the angular difference indicator are overlaid onto a trajectory marker that is connected to the surgical positioning object, the trajectory marker being a physical object that is separate from the patient's anatomy.
2 . The augmented reality system as recited in claim 1 , wherein the processor is further programmed to control the augmented reality visualization device to virtually indicate the desired entry point with a virtual object.
3 . The augmented reality system as recited in claim 2 , wherein the virtual object includes a virtual crosshair.
4 . The augmented reality system as recited in claim 1 , wherein the processor is further programmed to control the augmented reality visualization device to visually indicate an accuracy between the actual trajectory and the desired trajectory of the surgical positioning object within the augmented reality environment.
5 . The augmented reality system as recited in claim 4 , wherein the processor is further programmed to control the augmented reality visualization device to visually indicate the accuracy by altering a color of a virtual indicator presented within the augmented reality environment.
6 . The augmented reality system as recited in claim 1 , wherein the surgical positioning object is a surgical guide pin.
7 . The augmented reality system as recited in claim 1 , wherein the trajectory marker includes a self-calibrated slide-on component that includes an inner diameter that is larger than an outer diameter of the surgical positioning object.
8 . The augmented reality system as recited in claim 7 , wherein the self-calibrated slide-on component is a disk.
9 . The augmented reality system as recited in claim 1 , wherein the directional indicator visually depicts a direction the surgical positioning object needs to move toward to achieve the desired trajectory.
10 . The augmented reality system as recited in claim 1 , wherein the trajectory marker is slidable along a portion of the surgical positioning object that protrudes rearwardly from a surgical drill.
11 . The augmented reality system as recited in claim 10 , wherein the surgical positioning object extends entirely through a housing of the surgical drill.
12 . A surgical method, comprising:
intraoperatively demarcating a desired entry point and a desired trajectory of a surgical positioning object within an augmented reality environment produced by an augmented reality system, wherein both the desired entry point and the desired trajectory are derived from a preoperative surgical plan that is specific to a patient's anatomy; and
providing a visual indication of an accuracy between an actual trajectory and the desired trajectory of the surgical positioning object within the augmented reality environment,
wherein providing the visual indication includes virtually overlaying the visual indication of the accuracy onto a trajectory marker that is connected to the surgical positioning object, the trajectory marker being a physical object that is separate from the patient's anatomy.
13 . The surgical method as recited in claim 12 , wherein intraoperatively demarcating the desired entry point includes presenting a virtual crosshair within the augmented reality environment.
14 . The surgical method as recited in claim 12 , wherein intraoperatively demarcating the desired trajectory includes presenting a virtual trajectory within the augmented reality environment.
15 . The surgical method as recited in claim 12 , wherein providing the visual indication of the accuracy includes presenting a directional indicator within the augmented reality environment.
16 . The surgical method as recited in claim 12 , wherein providing the visual indication of the accuracy includes presenting an angular difference indicator within the augmented reality environment.
17 . The surgical method as recited in claim 12 , wherein the trajectory marker is configured to digitize the actual trajectory of the surgical positioning object.
18 . The surgical method as recited in claim 12 , comprising, prior to intraoperatively demarcating the desired entry point and the desired trajectory, registering a virtual bone model to the patient's anatomy within the augmented reality environment.
19 . The surgical method as recited in claim 12 , wherein the surgical positioning object is a surgical guide pin.
20 . A surgical method, comprising:
positioning a tip of a surgical guide pin at a location of a bone surface of an anatomy,
wherein the location is indicated by a virtual crosshair within an augmented reality environment;
preparing an indentation at the location;
pivoting the surgical guide pin about a pivot point established by the indentation;
aligning an actual trajectory of the surgical guide pin to a virtual trajectory of the surgical guide pin within the augmented reality environment; and
after preparing the indentation, pivoting the surgical guide pin, and aligning the actual trajectory to the virtual trajectory of the surgical guide pin, drilling the surgical guide pin into the anatomy.
21 . The surgical method as recited in claim 20 , wherein the pivot point is located on the bone surface.
22 . An augmented reality system for a surgical system, comprising:
an augmented reality visualization device; and
a processor programmed to control the augmented reality visualization device to:
provide an augmented reality environment relative to a patient's anatomy; and
allow a user to interface with the augmented reality environment for intraoperatively achieving a desired entry point and a desired trajectory of a surgical positioning object relative to the patient's anatomy,
wherein the processor is further programmed to control the augmented reality visualization device to perform a registration process without using fiducial markers for registering a virtual bone model to the patient's anatomy within the augmented reality environment,
wherein the processor is further configured to control the augmented reality visualization device to present a plurality of registration reference points within the augmented reality environment, and further wherein each of the plurality of registration reference points visually indicates a location where the user should physically touch the patient's anatomy in order to initialize an approximation of the virtual bone model to the patient's anatomy.