Systems and methods for augmented reality assisted trauma fixation

1 . An augmented reality assisted trauma fixation method comprising:

obtaining, using a processor, a three-dimensional model of a bone;

obtaining, using the processor, a location of a fixation plate relative to the bone;

obtaining, using the processor, a location of a previously placed anchor device relative to the bone;

determining, using the processor, based on the location of the fixation plate, the location of the previously placed anchor device, the three-dimensional model of the bone, and a property of one or more anchor devices, a preferred pose of the one or more anchor devices that prevents the one or more anchor devices from intersecting with the previously placed anchor device;

determining, in conjunction with the preferred pose, a preferred location of the one or more anchor devices based on a potential bending load applied by the bone on the one or more anchor devices;

displaying, on a mixed reality display, one or more visual indicators associated with the preferred pose and the preferred location of the one or more anchor devices, wherein the preferred pose and the preferred location of the one or more anchor devices promote healing of the bone;

generating, using the processor, a time-sequenced preview of future surgical states and implant-anatomy interactions by executing a machine learning model trained to translate a current surgical state at a first time period to a future surgical state at a second time period, wherein the machine learning model is trained on a dataset comprising sampled surgical states over a plurality of time periods, and wherein the time-sequenced preview comprises a series of images that incrementally display surgical states based on an insertion of the one or more anchor devices over a period of time;

displaying, on the mixed reality display, the time-sequenced preview;

tracking, using the processor, a pose of a guide device utilized for placing the one or more anchor devices; and

generating, using the processor, a notification corresponding to whether the pose of the guide device aligns with the preferred pose of the one or more anchor devices at the preferred location.

2 . The augmented reality assisted trauma fixation method of claim 1 , further comprising:

determining, based on the location of the fixation plate, a preferred placement of the guide device;

wherein the one or more visual indicators comprise a ghost image of the guide device indicating the preferred placement.

3 . The augmented reality assisted trauma fixation method of claim 1 , wherein the location of the fixation plate is obtained from a tracking system.

4 . The augmented reality assisted trauma fixation method of claim 3 , wherein the tracking system uses at least one of: optical tracking, electromagnetic tracking, fiber optic tracking, or image-based tracking.

5 . The augmented reality assisted trauma fixation method of claim 1 , wherein the obtaining the location of the previously placed anchor device comprises:

obtaining image data comprising a portion of the previously placed anchor device and a portion of a patient anatomy; and

determining, based on the image data, the location of the previously placed anchor device.

6 . The augmented reality assisted trauma fixation method of claim 1 , wherein the one or more visual indicators comprise at least one of:

a ghost image of the fixation plate;

a ghost image of the one or more anchor devices; or

one or more target shapes configured to visually represent the preferred location of the one or more anchor devices.

7 . The augmented reality assisted trauma fixation method of claim 1 , wherein the property of the one or more anchor devices is selected from the group consisting of a length, a width, a diameter, a thread pattern, a material strength, and any combination thereof.

8 . The method of claim 1 , wherein the preferred location is further determined by:

identifying an initial location to place the one or more anchor devices;

identifying a bending point of the one or more anchor devices based on the property of the one or more anchor devices;

determining the potential bending load applied by the bone on the one or more anchor devices based on the bending point and a bone density of the bone;

calculating a potential deflection of the one or more anchor devices based on the potential bending load; and

adjusting the initial location to the preferred location based on the potential deflection.

9 . An augmented reality assisted trauma fixation system comprising:

a processor;

a mixed reality display;

an image capture device;

a tracking system; and

a non-transitory, processor-readable storage medium that stores instructions executable by the processor to:

obtain a three-dimensional model of a bone;

obtain a location of a fixation plate relative to the bone;

obtain a location of a previously placed anchor device relative to the bone;

determine, based on the location of the fixation plate, the location of the previously placed anchor device, the three-dimensional model of the bone, and a property of one or more anchor devices, a preferred pose of the one or more anchor devices that prevents the one or more anchor devices from intersecting with the previously placed anchor device

determine, in conjunction with the preferred pose, a preferred location of the one or more anchor devices based on a potential bending load applied by the bone on the one or more anchor devices;

display, on the mixed reality display, one or more visual indicators associated with the preferred pose and the preferred location of the one or more anchor devices, wherein the preferred pose and the preferred location of the one or more anchor devices promote healing of the bone;

generate a time-sequenced preview of future surgical states and implant-anatomy interactions by executing a machine learning model trained to translate a current surgical state at a first time period to a future surgical state at a second time period, wherein the machine learning model is trained on a dataset comprising sampled surgical states over a plurality of time periods, and wherein the time-sequenced preview comprises a series of images that incrementally display surgical states based on an insertion of the one or more anchor devices over a period of time;

display, on the mixed reality display, the time-sequenced preview;

track, using the tracking system, a pose of a guide device utilized for placing the one or more anchor devices; and

generate a notification corresponding to whether the pose of the guide device aligns with the preferred pose of the one or more anchor devices at the preferred location.

10 . The augmented reality assisted trauma fixation system of claim 9 , further comprising one or more guide devices, wherein the instructions are further executable by the processor to:

determine, based on the location of the fixation plate, a preferred placement of the guide device;

wherein the one or more visual indicators comprise a ghost image of the guide device indicating the preferred placement.

11 . The augmented reality assisted trauma fixation system of claim 9 , wherein the property of the one or more anchor devices is selected from the group consisting of a length, a width, a diameter, a thread pattern, a material strength, and any combination thereof.

12 . A mixed reality display device configured to be communicably coupled to a tracking system, the mixed reality display device comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to:

obtain a three-dimensional model of a bone;

obtain a location of a fixation plate relative to the bone;

obtain a location of a previously placed anchor device relative to the bone;

determine, based on the location of the fixation plate, the location of the previously placed anchor device, the three-dimensional model of the bone, and a property of one or more anchor devices, a preferred pose of the one or more anchor devices that prevents the one or more anchor devices from intersecting with the previously placed anchor device;

determine, in conjunction with the preferred pose, a preferred location of the one or more anchor devices based on a potential bending load applied by the bone on the one or more anchor devices;

display one or more visual indicators associated with the preferred location and the preferred pose of the one or more anchor devices, wherein the preferred pose and the preferred location of the one or more anchor devices promote healing of the bone;

generate and display a time-sequenced preview of future surgical states and implant-anatomy interactions by executing a machine learning model trained to translate a current surgical state at a first time period to a future surgical state at a second time period, wherein the machine learning model is trained on a dataset comprising sampled surgical states over a plurality of time periods, and wherein the time-sequenced preview comprises a series of images that incrementally display surgical states based on an insertion of the one or more anchor devices over a period of time;

track a pose of a guide device utilized for placing the one or more anchor devices; and

generate a notification corresponding to whether the pose of the guide device aligns with the preferred pose of the one or more anchor devices at the preferred location.

13 . The mixed reality display device of claim 12 , wherein the property of the one or more anchor devices is selected from the group consisting of a length, a width, a diameter, a thread pattern, a material strength, and any combination thereof.