Systems and methods for augmented reality-aided implant placement
A system calculates a difference in position and orientation between a first physical marker attached to an implant and a second physical marker attached to a calibration rig comprising a physical replica of an anatomical portion of a patient where the implant is to be placed. The system generates, for display using the AR device, a three-dimensional representation of medical imaging data overlaid on the anatomical portion of the patient. The system determines, based on the difference, a target virtual position and target orientation on the three-dimensional representation where the first physical marker of the implant should be guided to ensure the implant is placed in the anatomical portion. The system generates, for display using the AR device, a first virtual marker at the target virtual position in the target orientation.
1 . A method for implant placement using an augmented reality (AR) device, the method comprising:
calculating a difference in position and orientation between a first physical marker attached to an implant and a second physical marker attached to a calibration rig representing an anatomical portion of a patient where the implant is to be placed;
generating, for display using the AR device, a three-dimensional representation of medical imaging data overlaid on the anatomical portion of the patient;
determining, based on the difference, a target virtual position and target orientation on the three-dimensional representation where the first physical marker of the implant should be guided to ensure the implant is placed in the anatomical portion; and
generating, for display using the AR device, a first virtual marker at the target virtual position in the target orientation, wherein the first virtual marker matches a visual appearance of the first physical marker.
2 . The method of claim 1 , wherein an alignment of the first virtual marker and the first physical marker is indicative of proper placement of the implant in the anatomical portion.
3 . The method of claim 2 , further comprising outputting an alert indicative of the proper placement in response to detecting that the first physical marker aligns with the first virtual marker.
4 . The method of claim 3 , wherein the alert is one or more of: a visual indication, an audio indication, and a haptic indication.
5 . The method of claim 1 , the first physical marker is attached to a surgical instrument temporarily connected to the implant.
6 . The method of claim 5 , further comprising:
determining an offset between the implant and a point of connection of the first physical marker on the surgical instrument; and
adjusting the target virtual position and the target orientation based on the offset.
7 . The method of claim 6 , wherein the offset is determined from a label packaged with the implant.
8 . The method of claim 1 , wherein the first physical marker is one or a combination of: an optical code, an infrared retroreflective sphere, and an electromagnetic tracker.
9 . The method of claim 1 , wherein the three-dimensional representation of the medical imaging data is generated using a plurality of individual medical images of at least the anatomical portion.
10 . The method of claim 1 , wherein generating the three-dimensional representation of the medical imaging data comprises registering the three-dimensional representation over the anatomical portion.
11 . The method of claim 1 , wherein the calibration rig comprises a physical replica of the anatomical portion.
12 . A system for implant placement, comprising:
an augmented reality (AR) device;
at least one memory; and
at least one hardware processor coupled with the at least one memory and configured, individually or in combination, to:
calculate a difference in position and orientation between a first physical marker attached to an implant and a second physical marker attached to a calibration rig representing an anatomical portion of a patient where the implant is to be placed;
generate, for display using the AR device, a three-dimensional representation of medical imaging data overlaid on the anatomical portion of the patient;
determine, based on the difference, a target virtual position and target orientation on the three-dimensional representation where the first physical marker of the implant should be guided to ensure the implant is placed in the anatomical portion; and
generate, for display using the AR device, a first virtual marker at the target virtual position in the target orientation, wherein the first virtual marker matches a visual appearance of the first physical marker.
13 . The system of claim 12 , wherein an alignment of the first virtual marker and the first physical marker is indicative of proper placement of the implant in the anatomical portion.
14 . The system of claim 13 , wherein the at least one hardware processor is further configured to output an alert indicative of the proper placement in response to detecting that the first physical marker aligns with the first virtual marker.
15 . The system of claim 14 , wherein the alert is one or more of: a visual indication, an audio indication, and a haptic indication.
16 . The system of claim 12 , wherein the first physical marker is attached to a surgical instrument temporarily connected to the implant.
17 . The system of claim 12 , wherein the at least one hardware processor is further configured to:
determine an offset between the implant and a point of connection of the first physical marker on the surgical instrument; and
adjust the target virtual position and the target orientation based on the offset.
18 . A non-transitory computer readable medium storing thereon computer executable instructions for implant placement using an augmented reality (AR) device, including instructions for:
calculating a difference in position and orientation between a first physical marker attached to an implant and a second physical marker attached to a calibration rig representing an anatomical portion of a patient where the implant is to be placed;
generating, for display using the AR device, a three-dimensional representation of medical imaging data overlaid on the anatomical portion of the patient;
determining, based on the difference, a target virtual position and target orientation on the three-dimensional representation where the first physical marker of the implant should be guided to ensure the implant is placed in the anatomical portion; and
generating, for display using the AR device, a first virtual marker at the target virtual position in the target orientation, wherein the first virtual marker matches a visual appearance of the first physical marker.