Intraoperative video review
Systems, methods, and computer readable media related to providing intraoperative video review are disclosed. They involve receiving a plurality of video frames from a surgical video of an ongoing surgical procedure. Stored data based on prior surgical procedures may be accessed and at least one expected future event in the ongoing surgical procedure may be predicted based on the plurality of video frames and the stored data. At least one option to review at least one surgical video clip associated with the expected future event in the surgical procedure may be generated. A data structure containing the at least one surgical video clip may be accessed and the at least one surgical video clip associated with the expected future event may be outputted for intra-surgical presentation.
1 . A non-transitory computer readable medium including instructions that, when executed by at least one processor, provide intraoperative video review, the operations comprising:
receiving a plurality of video frames from a surgical video feed of an ongoing surgical procedure;
accessing stored data based on prior surgical procedures;
analyzing the plurality of video frames to identify an entry of a particular surgical tool to a particular region;
predicting, based on the plurality of video frames, the stored data based on the prior surgical procedures, and the identified entry of the particular surgical tool into the particular region, at least one expected future event in the ongoing surgical procedure, the at least one expected future event being associated with at least a first outcome of the ongoing surgical procedure and a second outcome of the ongoing surgical procedure;
generating for intra-surgical presentation, at least one option to review at least one of a plurality of surgical video clips associated with the expected future event in the surgical procedure, wherein the plurality of surgical video clips includes at least a first surgical video clip associated with the first outcome and a second surgical video clip associated with the second outcome;
accessing a data structure containing the at least one of the plurality of surgical video clips; and
outputting for intra-surgical presentation, the at least one of the plurality of surgical video clips associated with the expected future event.
2 . The non-transitory computer readable medium of claim 1 , wherein the at least one of the plurality of surgical video clips includes selected portions of the surgical video feed of the ongoing surgical procedure captured before the generation of the at least one option.
3 . The non-transitory computer readable medium of claim 2 , wherein the operations further comprise selecting the portions of the surgical video feed based on the predicted at least one expected future event in the ongoing surgical procedure.
4 . The non-transitory computer readable medium of claim 2 , wherein the operations further comprise determining at least one prerequisite of the predicted at least one expected future event in the ongoing surgical procedure, and wherein the selected portions of the surgical video feed of the ongoing surgical procedure are configured to enable a surgeon to verify the at least one prerequisite.
5 . The non-transitory computer readable medium of claim 4 , wherein the at least one prerequisite is a plurality of prerequisites, and the operations further comprise:
enabling the surgeon to select a prerequisite of the plurality of prerequisites; and
in response to the selection of the surgeon, causing a presentation of a portion of the surgical video feed of the ongoing surgical procedure captured before the generation of the at least one option and corresponding to the selected prerequisite.
6 . The non-transitory computer readable medium of claim 4 , wherein a first part of the selected portions of the surgical video feed of the ongoing surgical procedure corresponds to a first prerequisite of the predicted at least one expected future event in the ongoing surgical procedure, a second part of the selected portions of the surgical video feed of the ongoing surgical procedure corresponds to a second prerequisite of the predicted at least one expected future event in the ongoing surgical procedure, and the operations further comprise:
causing a presentation of an indication of the first prerequisite in conjunction with the intra-surgical presentation of the first part of the selected portions; and
causing a presentation of an indication of the second prerequisite in conjunction with the intra-surgical presentation of the second part of the selected portions.
7 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
receiving a signal indicative of an entering of a surgeon to the ongoing surgical procedure; and
in response to the signal, outputting for intra-surgical presentation at least part of the surgical video feed of the ongoing surgical procedure.
8 . The non-transitory computer readable medium of claim 7 , wherein the at least part of the surgical video feed of the ongoing surgical procedure is a visual summary of the ongoing surgical procedure before the entering of the surgeon.
9 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
receiving an indication of a user desire to review past occurrences of the ongoing surgical procedure; and
in response to the received indication, outputting for intra-surgical presentation at least part of the surgical video feed of the ongoing surgical procedure.
10 . The non-transitory computer readable medium of claim 9 , wherein the at least part of the surgical video feed of the ongoing surgical procedure is a visual summary of the ongoing surgical procedure before the entering of the user.
11 . The non-transitory computer readable medium of claim 1 , wherein the at least one future expected event is a complication, and wherein outputting the at least one of the plurality of surgical video clips includes presenting at least one complication-avoiding video clip demonstrating a surgical technique to avoid the complication.
12 . The non-transitory computer readable medium of claim 11 , wherein the at least one complication-avoiding video clip includes a plurality of complication-avoiding video clips demonstrating alternative surgical techniques to avoid the complication.
13 . The non-transitory computer readable medium of claim 1 , wherein the at least one future expected event is a complication, and wherein the at least one of the plurality of surgical video clips includes at least one misstep clip demonstrating at least one action giving rise to the complication.
14 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise triggering an intra-surgical warning of a risk in an upcoming portion of the ongoing surgical procedure, describing the risk, and presenting an intra-surgical picklist of risk-reducing video clips for review.
15 . The non-transitory computer readable medium of claim 1 , wherein outputting for intra-surgical presentation includes generating a composite video presentation including clips from a plurality of prior surgical procedures.
16 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise accessing information characterizing a current patient undergoing the surgical procedure and wherein the at least one of the plurality of surgical video clips is selected to reflect a video of at least one prior patient sharing characteristics with the current patient.
17 . The non-transitory computer readable medium of claim 1 , wherein the at least one future expected event is a wound closure, and the at least one of the plurality of surgical video clips is configured to enable a pre-closure surgical review.
18 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise, following outputting for intra-surgical presentation, causing to be presented on a display additional options to review additional surgical video related to the at least one of the plurality of surgical video clips outputted for presentation.
19 . The non-transitory computer readable medium of claim 1 , wherein the prediction is further based on temporal information.
20 . A system for providing intraoperative video review to a surgeon, the system comprising:
at least one processor configured to:
receive a plurality of video frames from a surgical video feed of an ongoing surgical procedure;
access stored data based on prior surgical procedures;
analyze the plurality of video frames to identify an entry of a particular surgical tool to a particular region;
predict, based on the plurality of video frames, the stored data based on the prior surgical procedures, and the identified entry of the particular surgical tool into the particular region, at least one expected future event in the ongoing surgical procedure, the at least one expected future event being associated with at least a first outcome of the ongoing surgical procedure and a second outcome of the ongoing surgical procedure;
generate for intra-surgical presentation, at least one option to review at least one of a plurality of surgical video clips associated with the expected future event in the surgical procedure, wherein the plurality of surgical video clips include at least a first surgical video clip associated with the first outcome and a second surgical video clip associated with the second outcome;
access a data structure containing the at least one of the plurality of surgical video clips; and
output for intra-surgical presentation during the surgical procedure, the at least one of the plurality of surgical video clips associated with the expected future event.
21 . A method of providing intraoperative video review to a surgeon, the method comprising:
receiving a plurality of video frames from a surgical video feed of an ongoing surgical procedure;
accessing stored data based on prior surgical procedures;
analyzing the plurality of video frames to identify an entry of a particular surgical tool to a particular region;
predicting, based on the plurality of video frames, the stored data based on the prior surgical procedures, the identified entry of the particular surgical tool into the particular region, at least one expected future event in the ongoing surgical procedure, the at least one expected future event being associated with at least a first outcome of the ongoing surgical procedure and a second outcome of the ongoing surgical procedure;
generating for intra-surgical presentation, at least one option to review at least one of a plurality of surgical video clips associated with the expected future event in the surgical procedure, wherein the plurality of surgical video clips include at least a first surgical video clip associated with the first outcome and a second surgical video clip associated with the second outcome;
accessing a data structure containing the at least one of the plurality of surgical video clips; and
outputting for intra-surgical presentation, the at least one of the plurality of surgical video clips associated with the expected future event.