Virtual guidance for orthopedic surgical procedures
An example method includes displaying, via a visualization device and overlaid on a portion of an anatomy of a patient viewable via the visualization device, a virtual model of the portion of the anatomy obtained from a virtual surgical plan for an orthopedic joint repair surgical procedure to attach a prosthetic to the anatomy; and displaying, via the visualization device and overlaid on the portion of the anatomy, a virtual guide that guides at least one of preparation of the anatomy for attachment of the prosthetic or attachment of the prosthetic to the anatomy.
1. A method comprising:
displaying, via a Mixed Reality (MR) visualization device and overlaid on a portion of an anatomy of a patient viewable via the MR visualization device, a virtual model of the portion of the anatomy obtained from a virtual surgical plan for an orthopedic joint repair surgical procedure, wherein the MR visualization device is worn by an orthopedic surgeon, the virtual surgical plan includes information defining steps of the orthopedic joint repair surgical procedure, and the steps of the orthopedic joint repair surgical procedure include at least one of the preparation of the anatomy of the patient for attachment of a prosthetic to the anatomy of the patient or attachment of the prosthetic to the anatomy of the patient;
displaying, via the MR visualization device and overlaid on the portion of the anatomy of the patient, a virtual guide that guides at least one of preparation of the anatomy of the patient for attachment of the prosthetic to the anatomy of the patient or attachment of the prosthetic to the anatomy of the patient;
displaying, via the MR visualization device, a MR visualization for display, the MR visualization including a first virtual checklist item in a checklist of the steps of the orthopedic joint repair surgical procedure, the first virtual checklist item comprising text describing a first step of the orthopedic joint repair surgical procedure;
detecting a command to mark the first step of the orthopedic joint repair surgical procedure complete; and
based on the command:
storing data indicating that the first step is complete; and
updating, by the MR visualization device, the MR visualization to include a second virtual checklist item in the checklist, the second virtual checklist item comprising text describing a next step of the orthopedic joint repair surgical procedure.
2. The method of claim 1 , wherein the command is a first command and the method further comprises:
prior to detecting the first command, detecting a second command to select the first virtual checklist item; and
in response to detecting the second command, updating, by the MR visualization device, the MR visualization to include additional information regarding the first step of the orthopedic joint repair surgical procedure.
3. The method of claim 1 , wherein the method further comprises:
selecting a surgical item of a plurality of physical surgical items based on the virtual surgical plan containing information that specifies that the surgical item is to be used in the next step of the orthopedic joint repair surgical procedure as defined by the virtual surgical plan; and
presenting, via the MR visualization device, virtual information that identifies the selected surgical item among the plurality of physical surgical items, wherein the virtual information is presented on or adjacent a position of the selected surgical item visible via the MR visualization device.
4. The method of claim 3 , wherein the virtual information includes virtual elements that identify two or more different surgical items with different colors.
5. The method of claim 3 , wherein the virtual information is first virtual information and the method further comprising:
selecting, based on a detected change in the surgical procedure, a next surgical item; and
presenting, by the MR visualization device, second virtual information that identifies the next surgical item.
6. The method of claim 1 , wherein:
each surgical item in a plurality of surgical items includes a light source, and
the method further comprises communicating, by a processing device external to each surgical item in the plurality of surgical items, with the plurality of surgical items to control the light source in each of the surgical items based on the orthopedic joint repair surgical procedure.
7. The method of claim 1 , wherein the orthopedic joint repair surgical procedure is one of an anatomic total shoulder arthroplasty or a reverse shoulder arthroplasty.
8. The method of claim 1 , wherein displaying the virtual guide comprises projecting the virtual guide via a see-through lens through which the orthopedic surgeon is able to view the anatomy of the patient.
9. The method of claim 1 , wherein the portion of the anatomy of the patient is viewable via one or more see-through lenses of the MR visualization device, the method further comprising displaying the virtual model and displaying the virtual guide via the see-through lenses.
10. The method of claim 1 , wherein the anatomy of the patient comprises a glenoid of a scapula of the patient.
11. The method of claim 10 , wherein displaying the virtual guide comprises at least one of:
displaying a virtual reaming axis having first parameters obtained from the virtual surgical plan, the virtual reaming axis configured to guide reaming of the glenoid,
displaying a virtual drilling axis having second parameters obtained from the virtual surgical plan, the virtual drilling axis configured to guide drilling of one or more holes in the glenoid or drilling of a pilot hole for a screw to be inserted into the glenoid, or
displaying a virtual screw axis having third parameters obtained from the virtual surgical plan, the virtual screw axis configured to guide insertion of the screw into the glenoid.
12. The method of claim 1 , further comprising:
obtaining, via one or more sensors or the MR visualization device, one or more dimensions of a glenoid of a scapula of the patient after the glenoid has been prepared for attachment of the prosthetic;
obtaining, via the virtual surgical plan, one or more dimensions of the prosthetic;
comparing the dimensions of the prepared glenoid with the dimensions of the prosthetic to determine whether the glenoid has been properly prepared to receive the prosthetic; and
outputting, via the MR visualization device, an indication of whether the glenoid has been properly prepared to receive the prosthetic.
13. The method of claim 1 , wherein the anatomy of the patient comprises a humerus of the patient.
14. The method of claim 13 , wherein the anatomy of the patient comprises a humeral head of the patient and displaying the virtual guide comprises at least one of:
displaying a virtual reaming axis having parameters obtained from the virtual surgical plan, the virtual reaming axis configured to guide attachment of a guide pin to the humerus, wherein the guide pin is configured to guide reaming of a graft in a humeral head of the humerus of the patient,
displaying a virtual cutting plane having parameters obtained from the virtual surgical plan, the virtual cutting plane configured to guide cutting of the graft from the humeral head of the humerus of the patient, or
displaying a virtual reaming axis having parameters obtained from the virtual surgical plan, the virtual reaming axis configured to guide reaming of the graft in the humeral head of the humerus of the patient or reaming of the humeral head of the humerus of the patient.
15. The method of claim 1 , wherein displaying the virtual guide comprises at least one of:
displaying a virtual cutting surface having first parameters obtained from the virtual surgical plan, the virtual cutting surface configured to guide resection of a portion of a head of a humerus of the patient,
displaying a virtual drilling axis having second parameters obtained from the virtual surgical plan, the virtual drilling axis configured to guide attachment of a guide pin to the humerus, wherein the guide pin is configured to guide attachment of a resection guide to the humerus,
displaying virtual guidance to guide one or more of: sounding the humerus, punching the humerus, or compacting the humerus, or
displaying a virtual axis having third parameters obtained from the virtual surgical plan, the virtual axis configured to guide creation of a pilot hole in the humerus after the head of the humerus has been resected.
16. The method of claim 1 , wherein displaying the virtual model of the portion of the anatomy of the patient comprises:
displaying, via the MR visualization device and overlaid on the portion of the anatomy of the patient, at least some of the virtual model such that a location on the anatomy of the patient indicated by the virtual guide is not completely obscured by the displayed virtual model.
17. A mixed reality system comprising:
a memory that stores at least a portion of a virtual surgical plan that includes information defining steps of an orthopedic joint repair surgical procedure, wherein the steps of the orthopedic joint repair surgical procedure include at least one of preparation of an anatomy of a patient for attachment of a prosthetic to the anatomy of the patient or attachment of the prosthetic to the anatomy of the patient; and
a Mixed Reality (MR) visualization device for wear by an orthopedic surgeon, the MR visualization device comprising one or more processors configured to:
display, overlaid on a portion of the anatomy of the patient viewable via the MR visualization device, a virtual model of the portion of the anatomy of the patient obtained from the virtual surgical plan;
display, overlaid on the portion of the anatomy of the patient, a virtual guide that guides at least one of preparation of the anatomy of the patient for attachment of the prosthetic to the anatomy of the patient or attachment of the prosthetic to the anatomy of the patient;
display an MR visualization that includes a first virtual checklist item in a checklist of the steps of the orthopedic joint repair surgical procedure, the first virtual checklist item comprising text describing a first step of the orthopedic joint repair surgical procedure; and
based on detection of a command to mark the first step of the orthopedic joint repair surgical procedure complete;
store data indicating that the first step is complete; and
update the MR visualization to include a second virtual checklist item in the checklist, the second virtual checklist item comprising text describing a next step of the orthopedic joint repair surgical procedure.
18. A computer-readable storage medium storing instructions that, when executed, cause one or more processors of a mixed reality (MR) system to:
display, via a MR visualization device of the MR system and overlaid on a portion of an anatomy of a patient viewable via the MR visualization device, a virtual model of the portion of the anatomy of the patient obtained from the virtual surgical plan for an orthopedic joint repair surgical procedure, wherein the MR visualization device is worn by an orthopedic surgeon, the virtual surgical plan includes information defining steps of the orthopedic joint repair surgical procedure, and the steps of the orthopedic joint repair surgical procedure include at least one of the preparation of the anatomy of the patient for attachment of a prosthetic to the anatomy of the patient or attachment of the prosthetic to the anatomy of the patient;
display, via the MR visualization device and overlaid on the portion of the anatomy of the patient, a virtual guide that guides at least one of preparation of the anatomy of the patient for attachment of the prosthetic to the anatomy of the patient or attachment of the prosthetic to the anatomy of the patient;
display, via the MR visualization device, a MR visualization that includes a first virtual checklist item in a checklist of the steps of the orthopedic joint repair surgical procedure, the first virtual checklist item comprising text describing a first step of the orthopedic joint repair surgical procedure;
detect a command to mark the first step of the orthopedic joint repair surgical procedure complete; and
based on the command:
store data indicating that the first step is complete; and
update the MR visualization to include a second virtual checklist item in the checklist, the second virtual checklist item comprising text describing a next step of the orthopedic joint repair surgical procedure.
19. The method of claim 1 , wherein the command is one of: a voice command or a hand gesture.
20. The method of claim 1 , wherein detecting the command to mark the first step of the orthopedic joint repair surgical procedure complete comprises detecting the command from a person other than the orthopedic surgeon to mark the first step of the orthopedic joint repair surgical procedure complete.
21. The mixed reality system of claim 17 , wherein the one or more processors of the MR visualization device are further configured to:
select a surgical item of a plurality of physical surgical items based on the surgical plan containing information that specifies that the surgical item is to be used in the next step of the orthopedic joint repair surgical procedure as defined by the virtual surgical plan; and
present virtual information that identifies the selected surgical item among the plurality of surgical items, wherein the virtual information is presented on or adjacent a position of the selected surgical item visible via the MR visualization device.
22. The mixed reality system of claim 17 , wherein the mixed reality system includes a computing device configured to detect the command from a person other than the orthopedic surgeon to mark the first step of the orthopedic joint repair surgical procedure complete.
23. The mixed reality system of claim 17 , wherein the mixed reality system comprises a computing device configured to detect, prior to detecting the first command, a second command to select the first virtual checklist item; and
the one or more processors of the MR visualization device are further configured to, based on the second command, update the MR visualization to include additional information regarding the first step of the orthopedic joint repair surgical procedure.
24. The computer-readable storage medium of claim 18 , wherein the one or more processors are configured to:
select a surgical item of a plurality of physical surgical items based on the surgical plan containing information that specifies that the surgical item is to be used in the next step of the orthopedic joint repair surgical procedure as defined by the virtual surgical plan; and
present virtual information that identifies the selected surgical item among the plurality of surgical items, wherein the virtual information is presented on or adjacent a position of the selected surgical item visible via the MR visualization device.
25. The computer-readable storage medium of claim 18 , wherein the instructions, when executed, cause one or more processors of a computing device to detect the command from a person other than the orthopedic surgeon to mark the first step of the orthopedic joint repair surgical procedure complete.