Utilization of surgical data values and situational awareness to control the overlay in surgical field view
A surgical visualization system is disclosed including an imaging device, a display configured to show a livestream of a surgical field of a surgical procedure, and a control module configured to detect surgical data, assign display priority values to the surgical data, determine a display arrangement of the surgical data based on the display priority values, and present the surgical data on the display in accordance with the display arrangement. The livestream is captured by the imaging device.
1 . A surgical visualization system for use in a surgical procedure, the surgical visualization system comprising:
an imaging device;
a display configured to show a livestream of a surgical field of the surgical procedure, wherein the livestream is captured by the imaging device; and
a control module, configured to:
detect surgical data;
assign display priority values to the surgical data;
generate a visual representation of the surgical data, wherein the visual representation comprises a display element having a characteristic;
determine a display arrangement of the visual representation of the surgical data over the surgical field based on the display priority values;
present the surgical data on the display based on the display arrangement;
determine an update to the surgical data;
generate an updated visual representation of the updated surgical data by changing the characteristic of the display element of the visual representation;
determine an updated display arrangement of the updated visual representation of the updated surgical data over the surgical field based on the display priority values; and
present the updated surgical data on the display based on the updated display arrangement.
2 . The surgical visualization system of claim 1 , wherein the surgical data comprises first surgical data and second surgical data different than the first surgical data, wherein the first surgical data competes for presentation on the display with the second surgical data.
3 . The surgical visualization system of claim 2 , wherein the display arrangement comprises an overlay arrangement of the first surgical data and the second surgical data onto the livestream based on the display priority values.
4 . The surgical visualization system of claim 2 , wherein the display priority values comprise a first display priority value assigned to the first surgical data and a second display priority value less than the first display priority value assigned to the second surgical data, and wherein the display arrangement comprises overlaying the first surgical data onto the livestream but not the second surgical data.
5 . The surgical visualization system of claim 2 , wherein the display priority values comprise a first display priority value assigned to the first surgical data and a second display priority value less than the first display priority value assigned to the second surgical data, and wherein the display arrangement comprises overlaying the first surgical data onto the livestream before the second surgical data.
6 . The surgical visualization system of claim 1 , wherein the control module is further configured to select, for the characteristic of the display element of the visual representation of the surgical data, a color based on the display priority values.
7 . The surgical visualization system of claim 1 , wherein the control module is further configured to select, for the characteristic of the display element of the visual representation of the surgical data, a display time based on the display priority values.
8 . The surgical visualization system of claim 1 , wherein at least one of the display priority values is based on a failure to receive a parameter associated with a setting of a surgical instrument utilized in the surgical procedure.
9 . The surgical visualization system of claim 1 , wherein at least one of the display priority values is based on a detection of an assembly of components of a surgical instrument utilized in the surgical procedure.
10 . The surgical visualization system of claim 1 , wherein at least one of the display priority values is based on a distance in the surgical field between a critical surgical structure and a surgical instrument.
11 . The surgical visualization system of claim 1 , further comprising a situational awareness module configured to generate contextual information based on perioperative data, wherein the display arrangement of the surgical data on the display is further based on the contextual information.
12 . The surgical visualization system of claim 1 , wherein the visualization system comprises a communication interface, and wherein detecting the surgical data comprises receiving the surgical data via the communication interface.
13 . The surgical visualization system of claim 1 , wherein the visualization system comprises a processor, and wherein presenting the surgical data comprises automatically causing, by the processor, visual representations of the surgical data to be displayed onto the livestream of the surgical field.
14 . The surgical visualization system of claim 1 , wherein the visualization system comprises a processor and a memory, and wherein assigning display priority values to the surgical data comprises automatically retrieving, by the processor, the display priority values from the memory.
15 . The surgical visualization system of claim 1 , wherein the visualization system comprises a processor, and wherein the livestream of the surgical field is a first livestream of a first surgical field, and wherein determining the display arrangement comprises automatically selecting, by the processor, to switch from the first livestream to a second livestream of a second surgical field different than the first surgical field.
16 . A surgical visualization system for use in a surgical procedure, the surgical visualization system comprising:
an imaging device;
a display configured to show a livestream of a surgical field of the surgical procedure, wherein the livestream is captured by the imaging device; and
a control module, configured to:
detect first surgical data;
generate a first visual representation of the first surgical data for presenting the first surgical data on the display;
detect second surgical data;
generate a second visual representation of the second surgical data for presenting the second surgical data on the display;
detect a display conflict between the first surgical data and the second surgical data;
determine a resolution of the display conflict in favor of one of the first visual representation and the second visual representation based on a resolution order associated with an order of surgical tasks of the surgical procedure; and
determine a display arrangement of the first visual representation and the second visual representation in accordance with the resolution over the surgical field.
17 . The surgical visualization system of claim 16 , wherein the surgical visualization system comprises a communication interface, and wherein detecting the first surgical data comprises receiving the first surgical data via the communication interface.
18 . The surgical visualization system of claim 16 , wherein the surgical visualization system comprises a processor and a memory, and wherein generating the first visual representation comprises retrieving, by the processor, a template from the memory, and populating the template with at least one value based on the first surgical data.
19 . The surgical visualization system of claim 16 , wherein the surgical visualization system comprises a processor and a memory, and wherein detecting the display conflict comprises retrieving display priority information for the first surgical data and the second surgical data from the memory.
20 . The surgical visualization system of claim 1 , wherein the control module is further configured to select, for one or more display elements of visual representations of the surgical data, a highlighting based on the display priority values.