Surgical systems and methods for facilitating ad-hoc intraoperative planning of surgical procedures
A surgical system and method for facilitating ad-hoc intraoperative planning of a surgical step to be performed at a target site, the system comprising a digitization device, a navigation system, and a computing device. The digitization device intraoperatively facilitates establishment of one or more local virtual references relative to the target site. The navigation system tracks states of the digitization device. The computing device is coupled to the navigation system and comprises one or more processors and a non-transitory storage medium having stored thereon a computer-aided design (CAD) program. When executed by the one or more processors, the CAD program is configured to generate a virtual reference frame, register the one or more local virtual references within the virtual reference frame, and enable arrangement of different geometrical design objects within the virtual reference frame relative to one or more registered local virtual references to intraoperatively plan the surgical step.
1. A surgical system for facilitating ad-hoc intraoperative planning of a surgical step to be performed at a target site, the surgical system comprising:
a digitization device comprising a pointer tip and one or more control inputs and the digitization device being configured to intraoperatively facilitate establishment of one or more local virtual references relative to the target site, wherein the one or more local virtual references are established relative to the pointer tip in response to actuation of the one or more control inputs;
a navigation system configured to track states of the digitization device; and
a computing device coupled to the navigation system and comprising one or more processors and a non-transitory storage medium having stored thereon a computer-aided design (CAD) program that when executed by the one or more processors is configured to:
generate a virtual reference frame;
receive the tracked states of the digitization device from the navigation system;
register the one or more local virtual references within the virtual reference frame;
render, within the virtual reference frame, a virtual representation of the pointer tip of the digitization device having a position and orientation of the pointer tip derived from the tracked states of the digitization device; and
enable arrangement of different types of geometrical design objects within the virtual reference frame relative to one or more registered local virtual references to intraoperatively plan the surgical step, and wherein to enable arrangement of different types of geometrical design objects, the CAD program is further configured to:
enable one or more of the geometrical design objects to be selected and temporarily fixed to the virtual representation of the pointer tip within the virtual reference frame such that the one or more geometrical design objects that are temporarily fixed correspondingly follow changes in position and orientation of the virtual representation of the pointer tip within the virtual reference frame; and
in response to actuation of the one or more control inputs of the digitization device, enable the one or more geometrical design objects to become unfixed from the virtual representation of the pointer tip and placed in the virtual reference frame relative to the one or more local virtual references.
2. The surgical system as set forth in claim 1 , wherein the CAD program is further configured to enable arrangement of the different types of geometrical design objects within the virtual reference frame by:
constructing a new geometrical design object from registered local virtual references sequentially-established with the digitization device;
constructing a new geometrical design object from a previously-constructed geometrical design object arranged within the virtual reference frame; and/or
adjusting a previously-constructed geometrical design object arranged within the virtual reference frame.
3. The surgical system as set forth in claim 1 , wherein the different types of geometrical design objects comprise:
a first type of the geometrical design object comprising one of: a point, a line, a plane, or a volume; and
a second type of geometrical design object comprising a different one of: a point, a line, a plane, or a volume.
4. The surgical system as set forth in claim 1 , wherein the CAD program is further configured to enable arrangement of the different types of geometrical design objects within the virtual reference frame based on geometric relationships with respect to one or more of:
a registered local virtual reference, and/or
a calculated virtual reference derived from one or more registered local virtual references.
5. The surgical system as set forth in claim 1 , wherein the CAD program is further configured to enable construction of a compound object from one or more geometrical design objects arranged within the virtual reference frame.
6. The surgical system as set forth in claim 1 , further comprising a patient tracker adapted for attachment relative to the target site;
wherein the navigation system is configured to track states of the patient tracker;
wherein the CAD program is further configured to render, within the virtual reference frame, a virtual representation of the patient tracker having a position and/or orientation derived from the tracked states of the patient tracker; and
fix one or more registered local virtual references to the virtual representation of the patient tracker within the virtual reference frame.
7. The surgical system as set forth in claim 1 , further comprising a surgical tool;
wherein the navigation system is configured to track states of the surgical tool; and
wherein the CAD program is further configured to render, within the virtual reference frame, a virtual representation of the surgical tool having a position and/or orientation derived from the tracked states of the surgical tool.
8. The surgical system as set forth in claim 7 , wherein the CAD program is further configured to facilitate establishing a virtual boundary with one or more geometrical design objects arranged within the virtual reference frame to control movement and/or operation of the surgical tool relative to the target site.
9. The surgical system as set forth in claim 1 , wherein the CAD program is further configured to enable construction of a virtual implant model from one or more geometrical design objects arranged within the virtual reference frame.
10. The surgical system as set forth in claim 9 , further comprising an implant manufacturing device coupled to the computing device and configured to intraoperatively generate an implant based on the virtual implant model using an additive manufacturing technique.
11. The surgical system as set forth in claim 1 , further comprising a head-mountable display unit in communication with the computing device and being configured to:
receive data generated with the CAD program; and
based on the received data, render a visualization of the virtual reference frame, the one or more registered local virtual references, and/or the different types of geometrical design objects arranged within the virtual reference frame.
12. The surgical system as set forth in claim 11 , further comprising:
a patient tracker adapted for attachment relative to the target site; and
a display unit tracker coupled to the head-mountable display unit;
wherein the navigation system is configured to:
track states of the display unit tracker;
track states of the patient tracker; and
register the visualization to the target site; and
wherein the head-mountable display unit is configured to render the registered visualization in augmented reality and/or mixed reality such that the virtual reference frame, the one or more registered local virtual references, and the different types of geometrical design objects are visible relative to the target site for any given state of the display unit tracker.
13. A computer-assisted method for facilitating ad-hoc intraoperative planning of a surgical step to be performed at a target site using a surgical system comprising a digitization device comprising a pointer tip and one or more control inputs, a navigation system, and a computing device coupled to the navigation system and comprising one or more processors and a non-transitory storage medium having stored thereon a computer-aided design (CAD) program being executable by the one or more processors, the method comprising:
tracking states of the digitization device with the navigation system;
intraoperatively establishing one or more local virtual references relative to the target site with the digitization device, wherein the one or more local virtual references are established relative to the pointer tip in response to actuation of the one or more control inputs;
generating a virtual reference frame with the CAD program;
registering the one or more local virtual references within the virtual reference frame with the CAD program;
rendering, within the virtual reference frame, a virtual representation of the pointer tip of the digitization device having a position and orientation of the pointer tip derived from the tracked states of the digitization device; and
arranging different types of geometrical design objects within the virtual reference frame relative to one or more registered local virtual references with the CAD program to intraoperatively plan the surgical step by:
selecting and temporarily fixing one or more of the geometrical design objects to the virtual representation of the pointer tip within the virtual reference frame such that the one or more geometrical design objects that are temporarily fixed correspondingly follow changes in position and orientation of the virtual representation of the pointer tip within the virtual reference frame; and
in response to actuation of the one or more control inputs of the digitization device, unfixing the one or more geometrical design objects from the virtual representation of the pointer tip and placing the one or more geometrical design objects in the virtual reference frame relative to the one or more local virtual references.
14. The method as set forth in claim 13 , wherein arranging different types of geometrical design objects within the virtual reference frame with the CAD program further comprises:
constructing a new geometrical design object from registered local virtual references sequentially-established with the digitization device;
constructing a new geometrical design object from a previously-constructed geometrical design object arranged within the virtual reference frame; and/or
adjusting a previously-constructed geometrical design object arranged within the virtual reference frame.
15. The method as set forth in claim 13 , further comprising:
deriving, with the CAD program, one or more calculated virtual references from one or more registered local virtual references; and
arranging, with the CAD program, the different types of geometrical design objects within the virtual reference frame based on geometric relationships with respect to one or more registered local virtual references and/or calculated virtual references.
16. The method as set forth in claim 13 , further comprising constructing, with the CAD program, a compound object from one or more geometrical design objects arranged within the virtual reference frame.
17. The method as set forth in claim 13 , wherein the surgical system further comprises a patient tracker adapted for attachment relative to the target site, wherein the navigation system is configured to track states of the patient tracker, and wherein the method further comprises:
rendering, with the CAD program, a virtual representation of the patient tracker within the virtual reference frame having a position and/or orientation derived from the tracked states of the patient tracker; and
fixing, with the CAD program, one or more registered local virtual references to the virtual representation of the patient tracker within the virtual reference frame.
18. The method as set forth in claim 13 , wherein the surgical system further comprises a surgical tool, wherein the navigation system is configured to track states of the surgical tool, and wherein the method further comprises rendering, with the CAD program, a virtual representation of the surgical tool within the virtual reference frame having a position and/or orientation derived from the tracked states of the surgical tool.
19. The method as set forth in claim 18 , further comprising establishing, with the CAD program, a virtual boundary with one or more geometrical design objects arranged within the virtual reference frame to control movement and/or operation of the surgical tool relative to the target site.
20. The method as set forth in claim 13 , further comprising constructing, with the CAD program, a virtual implant model from one or more geometrical design objects arranged within the virtual reference frame.
21. The method as set forth in claim 13 , wherein the surgical system further comprises a head-mountable display unit in communication with the computing device and wherein the method further comprises:
receiving, with the head-mountable display unit, data generated by the CAD program; and
rendering, with the head-mountable display unit and based on the received data, a visualization of the virtual reference frame, the one or more registered local virtual references, and/or the different types of geometrical design objects arranged within the virtual reference frame.
22. The method as set forth in claim 21 , wherein the surgical system further comprises a patient tracker adapted for attachment relative to the target site and a display unit tracker coupled to the head-mountable display unit, wherein the navigation system is configured to track states of the display unit tracker and to track states of the patient tracker and to register the visualization to the target site, and wherein the method further comprises rendering, with the head-mountable display unit, the registered visualization in augmented reality and/or mixed reality such that the virtual reference frame, the one or more registered local virtual references, and the different types of geometrical design objects are visible relative to the target site for any given state of the display unit tracker.
23. A non-transitory storage medium having stored thereon a computer-aided design (CAD) program being configured to facilitate ad-hoc intraoperative planning of a surgical step to be performed at a target site, the CAD program being utilized with a surgical system comprising a digitization device including a pointer tip and one or more control inputs and the digitization device being configured to intraoperatively facilitate establishment of one or more local virtual references relative to the target site, wherein the one or more local virtual references are established relative to the pointer tip in response to actuation of the one or more control inputs, and a navigation system configured to track states of the digitization device, the CAD program when executed by one or more processors is configured to:
generate a virtual reference frame;
receive tracked states of the digitization device from a navigation system;
register the one or more local virtual references established relative to the target site within the virtual reference frame;
render, within the virtual reference frame, a virtual representation of the pointer tip of the digitization device having a position and orientation of the pointer tip derived from the tracked states of the digitization device;
enable arrangement of different types of geometrical design objects within the virtual reference frame relative to one or more registered local virtual references to intraoperatively plan the surgical step, and wherein to enable arrangement of different types of geometrical design objects, the CAD program is further configured to;
enable one or more of the geometrical design objects to be selected and temporarily fixed to the virtual representation of the pointer tip within the virtual reference frame such that the one or more geometrical design objects that are temporarily fixed correspondingly follow changes in position and orientation of the virtual representation of the pointer tip within the virtual reference frame; and
in response to actuation of the one or more control inputs of the digitization device, enable the one or more geometrical design objects to become unfixed from the virtual representation of the pointer tip and placed in the virtual reference frame relative to the one or more local virtual references.
24. The non-transitory storage medium as set forth in claim 23 , wherein the CAD program is further configured to enable arrangement of the different types of geometrical design objects within the virtual reference frame by:
constructing a new geometrical design object from sequentially-established registered local virtual references;
constructing a new geometrical design object from a previously-constructed geometrical design object arranged within the virtual reference frame; and/or
adjusting a previously-constructed geometrical design object arranged within the virtual reference frame.
25. The non-transitory storage medium as set forth in claim 23 , wherein the different types of geometrical design objects comprise:
a first type of the geometrical design object comprising one of: a point, a line, a plane, or a volume; and
a second type of geometrical design object comprising a different one of: a point, a line, a plane, or a volume.
26. The non-transitory storage medium as set forth in claim 23 , wherein the CAD program is further configured to enable arrangement of the different types of geometrical design objects within the reference frame based on geometric relationships with respect to one or more of:
a registered local virtual reference, and/or
a calculated virtual reference derived from one or more registered local virtual references.
27. The non-transitory storage medium as set forth in claim 23 , wherein the CAD program is further configured to enable construction of a compound object from one or more geometrical design objects arranged within the virtual reference frame.
28. The non-transitory storage medium as set forth in claim 23 , wherein the CAD program is further configured to enable construction of a virtual implant model from one or more geometrical design objects arranged within the virtual reference frame.