Surgical tracking and procedural map analysis tool
In some embodiments, methods and systems are provided for accessing a surgical dataset including surgical data collected during performance of a surgical procedure. The surgical data can include video data of the surgical procedure. Using the surgical data, a plurality of procedural states associated with the surgical procedure can be determined. For a procedural state of the plurality of procedural states, temporal information can be identified that identifies a part of the video data to be associated with the procedural state. For the procedural state of the plurality of procedural states, electronic data can be generated that characterizes the part of the video data and outputting the electronic data associated with the plurality of procedural states.
1. A method comprising:
accessing, by one or more data processors executing instructions stored on a non-transitory computer readable storage medium, surgical data collected during performance of a surgical procedure, the surgical data comprising video data of the surgical procedure;
determining, by the one or more data processors, a procedural state based on at least a portion of the surgical data;
identifying, by the one or more data processors, a portion of the video data that is associated with the procedural state;
associating, by the one or more data processors, temporal information of the portion of the video data with the procedural state;
generating, by the one or more data processors, electronic data to be associated with the procedural state;
continuing to determine, by the one or more data processors, one or more additional procedural states based on one or more other portions of the surgical data, identify one or more other portions of the video data associated with the one or more additional procedural states, associate temporal information of the one or more other portions of the video data with the one or more additional procedural states, and generate the electronic data to be associated with the one or more additional procedural states until the electronic data has been generated for all of the one or more additional procedural states of the surgical procedure;
outputting the video data, wherein the electronic data is associated with the portion of the video data and the one or more other portions of the video data;
parsing, by the one or more data processors, the video data to identify a predefined number of images associated with the procedural state and the one or more additional procedural states; and
generating, by the one or more data processors, a document comprising the identified images and text based on the electronic data that describes one or more actions depicted in the identified images.
2. The method of claim 1 , wherein the surgical data is received incrementally, and determining the procedural state comprises:
aggregating the surgical data; and
dividing the aggregated surgical data into separate chunks representative of distinct procedural states comprising the procedural state and the one or more additional procedural states.
3. The method of claim 2 , wherein the separate chunks are identified based on a command indicative of a transition between procedural states in the surgical procedure.
4. The method of claim 1 , wherein the electronic data comprises text that is overlaid or presented next to the portion of the video data.
5. The method of claim 1 , wherein the electronic data comprises audio signal that is played back with the portion of the video data.
6. The method of claim 1 , further comprising updating a patient record based on the electronic data.
7. A system comprising:
one or more data processors; and
a non-transitory computer readable storage medium containing instructions which when executed on the one or more data processors, cause the one or more data processors to perform actions including:
accessing surgical data collected during performance of a surgical procedure, the surgical data comprising video data of the surgical procedure;
determining a procedural state based on at least a portion of the surgical data;
identifying a portion of the video data that is associated with the procedural state;
associating temporal information of the portion of the video data with the procedural state;
generating electronic data to be associated with the procedural state;
continuing to determine one or more additional procedural states based on one or more other portions of the surgical data, identify one or more other portions of the video data associated with the one or more additional procedural states, associate temporal information of the one or more other portions of the video data with the one or more additional procedural states, and generate the electronic data to be associated with the one or more additional procedural states until the electronic data has been generated for all of the one or more additional procedural states of the surgical procedure;
outputting the video data, wherein the electronic data is associated with the portion of the video data and the one or more other portions of the video data;
parsing the video data to identify a predefined number of images associated with the procedural state and the one or more additional procedural states; and
generating a document comprising the identified images and text based on the electronic data that describes one or more actions depicted in the identified images.
8. The system of claim 7 , wherein the surgical data is received incrementally, and determining the procedural state comprises:
aggregating the surgical data; and
dividing the aggregated surgical data into separate chunks representative of distinct procedural states comprising the procedural state and the one or more additional procedural states.
9. The system of claim 8 , wherein the separate chunks are identified based on a command indicative of a transition between procedural states in the surgical procedure.
10. The system of claim 7 , wherein the electronic data comprises text that is overlaid or presented next to the portion of the video data.
11. The system of claim 7 , wherein the electronic data comprises audio signal that is played back with the portion of the video data.
12. The system of claim 11 , wherein the one or more data processors update a patient record to include the video data.
13. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions configured to cause one or more data processors to perform actions comprising:
accessing surgical data collected during performance of a surgical procedure, the surgical data comprising video data of the surgical procedure;
determining a procedural state based on at least a portion of the surgical data;
identifying a portion of the video data that is associated with the procedural state;
associating temporal information of the portion of the video data with the procedural state;
generating electronic data to be associated with the procedural state;
continuing to determine one or more additional procedural states based on one or more other portions of the surgical data, identify one or more other portions of the video data associated with the one or more additional procedural states, associate temporal information of the one or more other portions of the video data with the one or more additional procedural states, and generate the electronic data to be associated with the one or more additional procedural states until the electronic data has been generated for all of the one or more additional procedural states of the surgical procedure;
outputting the video data, wherein the electronic data is associated with the portion of the video data and the one or more other portions of the video data;
parsing the video data to identify a predefined number of images associated with the procedural state and the one or more additional procedural states; and
generating a document comprising the identified images and text based on the electronic data that describes one or more actions depicted in the identified images.
14. The computer-program product of claim 13 , wherein the surgical data is received incrementally, and determining the procedural state comprises:
aggregating the surgical data; and
dividing the aggregated surgical data into separate chunks representative of distinct procedural states comprising the procedural state and the one or more additional procedural states.
15. The computer-program product of claim 14 , wherein the separate chunks are identified based on a command indicative of a transition between procedural states in the surgical procedure.
16. The computer-program product of claim 13 , wherein the electronic data comprises text that is overlaid or presented next to the portion of the video data.
17. The computer-program product of claim 13 , wherein the electronic data comprises audio signal that is played back with the portion of the video data.