Methods for augmenting a surgical field with virtual guidance and tracking and adapting to deviation from a surgical plan
One variation of a method includes: accessing a virtual patient model defining a target resected contour of a hard tissue of interest; after resection of the hard tissue of interest during a surgical operation, accessing an optical scan recorded by an optical sensor facing a surgical field occupied by a patient, detecting a set of features representing the patient in the optical scan, registering the virtual patient model to the hard tissue of interest in the surgical field based on the set of features, and detecting an actual resected contour of the hard tissue of interest in the optical scan; and calculating a spatial difference between the actual resected contour of the hard tissue of interest and the target resected contour of the hard tissue of interest represented in the virtual patient model registered to the hard tissue of interest in the surgical field.
1. A method for registering features of a patient in a surgical field during a surgical operation comprising:
accessing a virtual patient model representing a hard tissue of interest of the patient, the virtual patient model generated from a pre-operative scan of the hard tissue of interest of the patient;
accessing a definition of a target resection of the hard tissue of interest of the patient;
registering a constellation of virtual hard tissue features defined in the virtual patient model to a first contour of the hard tissue of interest of a set of first and second contours of the hard tissue of interest detected in a second sequence of optical scans in a set of first, second, and third sequence of optical scans;
calculating an actual resection of the hard tissue of interest of the patient based on a second contour of the hard tissue of interest of the set of first and second contours of the hard tissue of interest detected in a third sequence of optical scans in the set of first, second, and third sequence of optical scans;
calculating a first spatial difference between the actual resection of the hard tissue of interest and the target resection of the hard tissue of interest;
rendering the first spatial difference on a display present proximal the surgical field;
serving a prompt to a surgeon present proximal the surgical field to provide a reason for the first spatial difference;
labeling the first spatial difference as an intentional deviation from a surgical plan associated with the target resection of the hard tissue of interest based on the reason for the first spatial difference provided by the surgeon; and
recording the first spatial difference and the reason provided by the surgeon in a database and in association with the surgical operation.
2. The method of claim 1 , during a first time period within the surgical operation and preceding incision of the patient proximal the hard tissue of interest, further comprising:
accessing a first sequence of optical scans captured by an optical sensor facing the surgical field occupied by the patient; and
detecting a constellation of visible soft tissue features on the patient proximal the hard tissue of interest.
3. The method of claim 2 , further comprising:
during a second time period succeeding incision of the patient proximal the hard tissue of interest and prior to resection of the hard tissue of interest:
accessing the second sequence of optical scans captured by the optical sensor;
detecting the first contour of the hard tissue of interest in the second sequence of optical scans; and
detecting the constellation of visible soft tissue features in the second sequence of optical scans; and
deriving a second set of spatial relationships between the constellation of virtual hard tissue features and the constellation of visible soft tissue features.
4. The method of claim 3 , during a third time period succeeding the second time period and proximal resection of the hard tissue of interest, further comprising:
accessing the third sequence of optical scans captured by the optical sensor;
detecting the constellation of visible soft tissue features in the third sequence of optical scans; and
detecting the second contour of the hard tissue of interest in the third sequence of optical scans.
5. The method of claim 4 , further comprising generating a soft tissue field model representing:
a first set of spatial relationships between visible soft tissue features in the constellation of visible soft tissue features;
a set of motional relationships between visible soft tissue features in the constellation of visible soft tissue features; and
a soft tissue gravity model characterizing deformation of the constellation of visible soft tissue features based on orientation of the hard tissue of interest.
6. The method of claim 5 , further comprising:
aligning the virtual patient model to the constellation of visible soft tissue features detected in the third sequence of optical scans based on the soft tissue field model and the second set of spatial relationships; and
based on alignment of the virtual patient model to the constellation of visible soft tissue features detected in the third sequence of optical scans according to the soft tissue field model and the second set of spatial relationships, detecting a second spatial difference between the constellation of virtual hard tissue features, defined in the virtual patient model, and the second contour of the hard tissue of interest detected in the third sequence of optical scans.
7. The method of claim 5 , further comprising:
accessing a definition of a target position of a surgical implant relative to the hard tissue of interest of the patient; and
during a fourth time period succeeding the third time period:
accessing a fourth sequence of optical scans captured by the optical sensor;
detecting the constellation of visible soft tissue features in the fourth sequence of optical scans;
aligning the virtual patient model to the constellation of visible soft tissue features detected in the fourth sequence of optical scans based on the soft tissue field model and the second set of spatial relationships;
detecting the surgical implant in the fourth sequence of optical scans;
calculating an actual position of the surgical implant relative to virtual hard tissue features defined in the virtual patient model, aligned to the constellation of visible soft tissue features detected in the fourth sequence of optical scans according to the soft tissue field model and the second set of spatial relationships; and
calculating a third spatial difference between the actual position of the surgical implant and the target position of the surgical implant defined relative to the hard tissue of interest of the patient.
8. The method of claim 7 , further comprising rendering the third spatial difference on a display present proximal the surgical field.
9. The method of claim 1 , further comprising:
rendering a virtual representation of the target resection within the virtual patient model on a display present proximal the surgical field; and
serving a prompt to a surgeon present proximal to the surgical field to toggle the rendering of the target resection on or off during a surgical procedure to provide the surgeon a virtual reference of the target resection.
10. The method of claim 1 , further comprising:
rendering a virtual representation of the first contour of the hard tissue of interest within the virtual patient model on a display present proximal the surgical field; and
serving a prompt to a surgeon present proximal the surgical field to toggle the rendering of the virtual representation of the first contour of the hard tissue of interest on or off during a surgical procedure to provide the surgeon a virtual reference of the first contour of the hard tissue of interest to aid in accurate reconstruction of the joint.
11. The method of claim 1 , further comprising:
calculating a first tolerance based on the first spatial difference between the actual resection and the target resection, and the reason for the first spatial difference provided by the surgeon; and
prompting the surgeon with a modified target resection to compensate for the first spatial difference based on the first tolerance.
12. The method of claim 11 , further comprising:
calculating a fourth spatial difference between the actual resection of the hard tissue of interest and the modified target resection of the hard tissue of interest;
rendering the fourth spatial difference on a display present proximal the surgical field;
serving a prompt to a surgeon present proximal the surgical field to provide a reason for the fourth spatial difference;
labeling the fourth spatial difference as an intentional deviation from a surgical plan associated with the target resection of the hard tissue of interest based on the reason for the fourth spatial difference presented by the surgeon; and
recording the fourth spatial difference and the reason provided by the surgeon in a database and in association with the surgical operation.
13. The method of claim 12 , further comprising:
calculating a second tolerance based on the fourth spatial difference between the actual resection and the modified target resection, and the reason for the fourth spatial difference provided by the surgeon;
calculating a tolerance stackup from the first tolerance and the second tolerance; and
serving a prompt to the surgeon present proximal the surgical field wherein the prompt comprises at least one recommended action to compensate for the deviation from the surgical plan resulting from the first spatial difference and the fourth spatial difference based on the tolerance stackup.
14. The method of claim 13 , further comprising:
predicting an additional tolerance for a future surgical step in the surgical plan based on the tolerance stackup to produce a predicted deviation from the surgical plan; and
prompting the surgeon with a modification to the surgical procedure to compensate for the predicted deviation.
15. The method of claim 1 , wherein serving a prompt to a surgeon present proximal the surgical field further comprises:
accessing a database containing data relevant to the surgical operation; and
wherein the prompt comprises at least one recommended action to assist the surgeon in making real-time decisions during the surgical operation.
16. The method of claim 1 , further comprising:
accessing a database containing patient outcome data following surgical operations;
registering patient outcome data to the reason provided by the surgeon in the database and in association with the surgical operation; and
correlating positive or negative patient outcomes to the reason provided by the surgeon in the database and in association with the surgical operation.
17. The method of claim 16 , prior to a subsequent surgical operation following the surgical operation, further comprising:
accessing the database containing patient outcome data; and
providing correlated positive or negative patient outcomes and reasons provided by the surgeon to a surgical team while creating a surgical plan for the subsequent surgical operation.