Visualization of intraoperatively modified surgical plans
A computing system obtains an information model specifying a first surgical plan for an orthopedic surgery to be performed on a patient. Additionally, the computing system modifies the first surgical plan during an intraoperative phase of the orthopedic surgery to generate a second surgical plan. During the intraoperative phase of the orthopedic surgery, a visualization device may present a visualization for display that is based on the second surgical plan.
1. A method comprising:
obtaining, by a computing system, an information model specifying a first surgical plan for an orthopedic surgery to be performed on a patient, wherein the first surgical plan specifies use of a first humeral implant;
modifying, by the computing system, the first surgical plan during an intraoperative phase of the orthopedic surgery to generate a second surgical plan, wherein the orthopedic surgery includes a step of severing a humeral head with an oscillating saw tool, and modifying the first surgical plan to generate the second surgical plan comprises:
determining, by the computing system, based on a realized cut plane along which the oscillating saw tool actually cut the humeral head during performance of the step of severing the humeral head, a first range of motion that would result from using the first humeral implant;
determining, by the computing system, that use of a second humeral implant would result in a second range of motion instead of the first range of motion given the realized cut plane, the second humeral implant being different from the first humeral implant; and
generating, by the computing system, the second surgical plan such that the second surgical plan specifies use of the second humeral implant instead of the first humeral implant; and
outputting, by the computing system, for presentation by a visualization device, during the intraoperative phase of the orthopedic surgery, a visualization for display that is based on the second surgical plan.
2. The method of claim 1 , wherein:
the first surgical plan specifies use of a first surgical item, and
modifying the first surgical plan comprises modifying, by the computing system, the first surgical plan such that the second surgical plan specifies use of a second surgical item instead of the first surgical item, the second surgical item being different from the first surgical item, wherein the first surgical item and the second surgical item are different surgical tools.
3. The method of claim 1 , wherein:
the first surgical plan specifies performance of a first type of surgery, and
modifying the first surgical plan comprises modifying, by the computing system, the first surgical plan such that the second surgical plan specifies a second type of surgery that is different from the first type of surgery.
4. The method of claim 1 , wherein at least one of:
the first surgical plan specifies a first reaming axis on a glenoid of the patient, and the second surgical plan specifies a second reaming axis on the glenoid of the patient different from the first reaming axis,
the first surgical plan specifies a first reaming depth on a glenoid of the patient, and the second surgical plan specifies a second reaming depth on the glenoid of the patient different from the first reaming depth, or
the first surgical plan specifies a first implant position, and the second surgical plan specifies a second implant position different from the first implant position.
5. The method of claim 1 ,
wherein the method further comprises:
generating, by the computing system, based on the first surgical plan, a planned depth map that represents a 3-dimensional shape that a surface of a bone of the patient will have after performance of a step of the orthopedic surgery if the step of the orthopedic surgery is performed according to the first surgical plan;
generating, by the computing system, a realized depth map that represents a 3-dimensional shape of the surface of the bone of the patient after a surgeon has actually performed the step of the orthopedic surgery; and
determining, by the computing system, differences between the realized depth map and the planned depth map, and
wherein modifying the first surgical plan comprises generating, by the computing system, the second surgical plan based on the determined differences between the realized depth map and the planned depth map.
6. The method of claim 1 ,
wherein a planned cut plane is a plane along which the oscillating saw tool will cut the humeral head if the step of the step of severing the humeral head is performed according to the first surgical plan,
wherein the method further comprises determining, by the computing system, differences between the planned cut plane and the realized cut plane, and
wherein modifying the first surgical plan comprises generating, by the computing system, the second surgical plan based on the determined differences between the realized cut plane and the planned cut plane.
7. The method of claim 6 , wherein the method further comprises:
generating, by the computing system, a depth map that represents 3-dimensional shapes within a scene that includes the humeral head and the oscillating saw tool; and
determining, by the computing system, the realized cut plane based on the depth map.
8. The method of claim 6 ,
wherein a marker is fixed to the oscillating saw tool,
wherein the method further comprises determining, by the computing system, the realized cut plane based on video images of the marker captured during performance of the step of severing the humeral head.
9. The method of claim 1 ,
wherein the orthopedic surgery includes a step of reaming a glenoid of the patient with a reaming tool, a planned reaming depth is a depth to which the reaming tool will ream the glenoid if the step of reaming the glenoid is performed according to the first surgical plan, and a realized reaming depth is a depth to which the reaming tool actually reamed the glenoid during performance of the step of reaming the glenoid,
wherein the method further comprises determining, by the computing system, differences between the planned reaming depth and the realized reaming depth, and
wherein modifying the first surgical plan comprises generating, by the computing system, the second surgical plan based on the determined differences between the realized reaming depth and the planned reaming depth.
10. The method of claim 9 , wherein the method further comprises:
generating, by the computing system, a depth map that represents 3-dimensional shapes within a scene that includes the glenoid and the reaming tool; and
determining, by the computing system, the realized reaming depth based on the depth map.
11. The method of claim 9 ,
wherein a first marker is fixed to the reaming tool and a second marker is fixed to a scapula that has the glenoid, and
wherein the method further comprises determining, by the computing system, the realized reaming depth based on video images of the first marker and the second marker captured during performance of the step of reaming the glenoid.
12. The method of claim 9 ,
wherein the first surgical plan specifies use of a first glenoid implant,
wherein generating the second surgical plan comprises:
determining, by the computing system, based on the realized reaming depth, a first range of motion that would result from using the first glenoid implant;
determining, by the computing system, that use of a second glenoid implant would result in a second range of motion instead of the first range of motion given the realized reaming depth, the second glenoid implant being different from the first glenoid implant; and
generating, by the computing system, the second surgical plan such that the second surgical plan specifies use of the second glenoid implant instead of the first glenoid implant.