Bone wall tracking and guidance for orthopedic implant placement
An example method includes registering a virtual model of a portion of a bone of a patient with a corresponding observed portion of the bone, the virtual model including a representation of a wall of the bone; registering a virtual model of an implant component with a corresponding observed implant component; and indicating, based on the registered virtual model of the portion of the bone and the registered virtual model of the implant component, a position of at least a portion of the implant component relative to a position of the wall of the bone.
1 . A method comprising:
registering, by processing circuitry, based on data from one or more sensors of a virtual surgical system identifying one or more positions of one or more corresponding physical markers, a bone virtual model with a corresponding portion of a bone of a patient, the bone virtual model including a three-dimensional (3D) mesh of points that correspond to a wall of the bone;
registering, by the processing circuitry, an implant virtual model with an implant component that corresponds to the implant virtual model, the implant virtual model comprising a 3D mesh of points that correspond to an outer surface of the implant component;
estimating, by the processing circuitry, an estimated distance between a portion of the implant component and a position of the wall of the bone, wherein estimating the estimated distance comprises:
determining, in real time and based on sensor data from the one or more sensors, respective distances between respective pairs of points of the 3D mesh of points that correspond to the wall of the bone and the 3D mesh of points that correspond to the outer surface of the implant component; and
for each of the respective pairs of points, identifying a minimum of the determined respective distances as the estimated distance; and
intraoperatively indicating, by the processing circuitry, in real time and based on the bone virtual model and the implant virtual model and via a mixed reality (MR) visualization device of the virtual surgical system worn by a surgeon while the surgeon inserts the implant component into the bone, a position of the portion of the implant component relative to the position of the wall of the bone, wherein indicating the position of the portion of the implant component relative to the position of the wall of the bone comprises:
continuously displaying, via the MR visualization device, a graphical representation of the bone virtual model relative to the implant virtual model, and a representation indicative of the estimated distance between the the portion of the implant component and the position of the wall of the bone.
2 . The method of claim 1 , wherein the wall of the bone comprises an outer cortical wall, and wherein the 3D mesh of points that correspond to the wall of the bone further comprises points that correspond to an inner cortical wall of the bone.
3 . The method of claim 1 , wherein the wall of the bone comprises an inner cortical wall, and wherein the 3D mesh of points that correspond to the wall of the bone comprises points that correspond to an outer cortical wall of the bone.
4 . The method of claim 1 , further comprising:
responsive to determining that the minimum of the determined respective distances is less than a threshold distance, outputting, by the processing circuitry, a warning.
5 . The method of claim 4 , wherein outputting the warning comprises outputting the warning using one or more of haptic output, audio output, graphical output, or textual output.
6 . The method of claim 1 , wherein displaying the graphical representation of the bone virtual model relative to the implant virtual model comprises:
displaying, via the MR visualization device and overlaid on the portion of the bone, the bone virtual model; and
displaying, via the MR visualization device and overlaid on the portion of the bone, the implant virtual model.
7 . The method of claim 1 , wherein intraoperatively indicating the position of the portion of the implant component relative to the position of the wall of the bone further comprises displaying a numerical value of the estimated distance.
8 . The method of claim 1 , wherein the bone is a humerus, and wherein the implant component comprises a stem of a humeral implant.
9 . The method of claim 1 , wherein the implant component comprises an implant tool.
10 . The method of claim 1 , wherein the implant virtual model includes a representation of the outer surface of the implant component.
11 . The method of claim 1 , further comprising:
outputting virtual guidance to guide use of the implant component.
12 . The method of claim 1 , wherein the one or more sensors comprise one or more sensors of the MR visualization device.
13 . The method of claim 1 further comprising placing the one or more corresponding physical markers on the bone.
14 . The method of claim 1 , wherein the the portion of the implant component comprises a humeral stem, the bone comprises a humerus, and wherein the wall of the bone comprises a cortical bone wall around a humeral canal of the humerus.
15 . A virtual surgical system comprising:
one or more memories;
one or more sensors; and
processing circuitry configured to:
register, using data from the one or more sensors identifying one or more positions of one or more corresponding physical markers, a bone virtual model with a corresponding portion of a bone of a patient, the bone virtual model including a three-dimensional (3D) mesh of points that correspond to a wall of the bone;
register, using the one or more sensors, an implant virtual model with an implant component corresponding to the implant virtual model, the implant virtual model comprising a second 3D mesh of points that correspond to an outer surface of the implant component;
estimate an estimated distance between a portion of the implant component and a position of the wall of the bone, wherein to estimate the estimated distance, the processing circuitry is configured to:
determine, in real time and based on sensor data from the one or more sensors, respective distances between respective pairs of points of the 3D mesh of points that correspond to the wall of the bone and the 3D mesh of points that correspond to the outer surface of the implant component; and
for each of the respective pairs of points, identify a minimum of the determined respective distances as the estimated distance; and
intraoperatively indicate, in real time and based on the bone virtual model and the implant virtual model and via a mixed reality (MR) visualization device of the virtual surgical system worn by a surgeon while the surgeon inserts the implant component into the bone, a position of the portion of the implant component relative to the position of the wall of the bone, wherein to indicate the position of the portion of the implant component relative to the position of the wall of the bone in real time, the processing circuitry is configured to:
continuously display, via the MR visualization device, a graphical representation of the bone virtual model relative to the implant virtual model, and a representation indicative of estimated distance between the the portion of the implant component and the position of the wall of the bone.
16 . The virtual surgical system of claim 15 , wherein the wall of the bone comprises an outer cortical wall, and wherein the 3D mesh of points that correspond to the wall of the bone further comprises points that correspond to an inner cortical wall of the bone.
17 . The virtual surgical system of claim 15 , wherein the wall of the bone comprises an inner cortical wall, and wherein the 3D mesh of points that correspond to the wall of the bone further comprises points that correspond to an outer cortical wall of the bone.
18 . The virtual surgical system of claim 15 , wherein the processing circuitry is further configured to:
responsive to determining that the minimum of the determined respective distances is less than a threshold distance, output a warning.
19 . The virtual surgical system of claim 18 , wherein, to output the warning, the processing circuitry is configured to output the warning using one or more of haptic output, audio output, graphical output, or textual output.
20 . The virtual surgical system of claim 15 , wherein to display the graphical representation of the bone virtual model relative to the implant virtual model, the processing circuitry is configured to cause the MR visualization device to:
display, via the MR visualization device and overlaid on the portion of the bone, the bone virtual model; and
display, via the MR visualization device and overlaid on the portion of the bone, the implant virtual model.
21 . The virtual surgical system of claim 15 , wherein, to indicate the position of the portion of the implant component relative to the position of the wall of the bone, the processing circuitry is configured to display a numerical value of the estimated distance.
22 . The virtual surgical system of claim 15 , wherein the bone is a humerus, and wherein the implant component comprises a stem of a humeral implant.
23 . The virtual surgical system of claim 15 , wherein the implant component comprises an implant tool.
24 . The virtual surgical system of claim 15 , wherein the implant virtual model includes a representation of the outer surface of the implant component.
25 . The virtual surgical system of claim 15 , wherein the processing circuitry is further configured to: output virtual guidance to guide use of the implant component.
26 . One or more non-transitory computer-readable storage media storing instructions that, when executed by one or more processors, cause the one or more processors to:
register, based on data from one or more sensors of a virtual surgical system identifying one or more positions of one or more corresponding physical markers, a bone virtual model with a corresponding portion of a bone of a patient, the bone virtual model including a three-dimensional (3D) mesh of points that correspond to a wall of the bone;
register an implant virtual model with an implant component that corresponds to the implant virtual model, the implant virtual model comprising a 3D mesh of points that correspond to an outer surface of the implant component;
estimate an estimated distance between a portion f the implant component and a position of the wall of the bone, wherein estimating the estimated distance comprises:
determine, in real time and based on sensor data from the one or more sensors, respective distances between respective pairs of points of the 3D mesh of points that correspond to the wall of the bone and the 3D mesh of points that correspond to the outer surface of the implant component; and
for each of the respective pairs of points, identifying a minimum of the determined respective distances as the estimated distance; and
intraoperatively indicate, in real time and based on the bone virtual model and the implant virtual model and via a mixed reality (MR) visualization device of the virtual surgical system worn by a surgeon while the surgeon inserts the implant component into the bone, a position of the portion of the implant component relative to the position of the wall of the bone, wherein to indicate the position of the portion of the implant component relative to the position of the wall of the bone, the one or more processors are configured to:
continuously display, via the MR visualization device, a graphical representation of the bone virtual model relative to the implant virtual model, and a representation indicative of the estimated distance between the the portion of the implant component and the position of the wall of the bone.