Surgical procedure labeling and teaching system and method thereof
A surgical procedure labeling and teaching system and a method thereof are disclosed. When one of names of to-be-labeled surgical images on a surgical image selection area of a user interface is selected, the to-be-labeled surgical image corresponding to the selected name is displayed on a surgical image labeling area of the user interface; after one of surgery label blocks on a surgery label selection area of the user interface is selected, a user can circle a surgery labeling area to establish a surgery feature label on the surgical image labeling area. A teaching interface can map the labeled surgical image to the to-be-labeled surgical image, so as to provide a surgical procedure teaching corresponding to the to-be-labeled surgical image. The technical effect of providing surgical procedure teaching by using the labeling-reference surgical image to assist in labeling and selecting of the to-be-labeled surgical image is achieved.
1 . A surgical procedure labeling and teaching system, executed in an electronic device, the electronic device includes a hardware processor is configured to execute following instructions stored in a memory:
displaying a user interface, wherein the user interface comprises a surgical image selection area, a surgical image labeling area, a label record area, a surgery video playback area, an image-labeling reference area and a surgery label selection area;
playing a surgery video on the surgery video playback area;
when one of names of to-be-labelled surgical images on the surgical image selection area is selected, displaying a to-be-labelled surgical image corresponding to the selected name on the surgical image labelling area, and displaying a labelling-reference surgical image corresponding to the selected name on the image-labelling reference area;
when one of names of to-be-labelled surgical images on the surgical image selection area is selected, calculating a period from a video time point minus a preset time length to the video time point plus the preset time length based on the video time point of the selected to-be-labeled surgical image, and capturing a part of the surgery video in the period to generate and play a captured surgery video;
when one of surgery label blocks on the surgery label selection area is selected, receiving multiple connected operating points in the surgical image labelling area to generate a newly added surgery labelling area wherein an edge of the newly added surgery labelling area is formed by the multiple connected operating points, and filling the surgery labeling area with a color corresponding to the selected surgery label block on the surgical image labeling area, wherein all of the surgery label blocks on the surgery label selection area are not permitted to select until the newly added surgery labelling area is generated;
when coordinates of at least one of the operating points are located within a coordinate range of a previously labelled surgery labelling area, a display priority of the newly added surgery labelling area or the previously labelled surgery labelling area which is labelled as surgical instrument or foreign material is higher than the display priority of the newly added surgery labelling area or the previously labelled surgery labelling area which is labelled as organs, the newly added surgery labelling area or the previously labelled surgery labelling area having a high display priority is displayed over the newly added surgery labelling area or the previously labelled surgery labelling area having a low display priority;
establishing and displaying a background label on the label record area, wherein after the newly added surgery labelling area is generated on the surgical image labelling area, establishing a name label on the label record area based on a name corresponding to the selected surgery label block;
storing the labelled to-be-labelled surgical image as a labelled surgical image, wherein the labelled surgical image comprises surgery labeling areas filled with colors; and
displaying a teaching interface comprising a to-be-labeled surgical image area, a labelled surgical image area and a surgery label display area, wherein displaying the to-be-labelled surgical images on the to-be-labelled surgical image area, and displaying the labelled surgical image on the labelled surgical image area, and providing a surgical procedure teaching corresponding to the to-be-labeled surgical image by surgery labelling areas of the labelled surgical image filled with colors and mapped to the to-be-labelled surgical image, and displaying multiple auxiliary content blocks with colors and names corresponding to the surgery labelling areas on the surgery label display area.
2 . The surgical procedure labelling and teaching system according to claim 1 , wherein displaying the name of the surgical image labelled already, the name of the surgical image being labeled, and the name of surgical image not labelled yet, with different background patterns on the surgical image selection area.
3 . The surgical procedure labelling and teaching system according to claim 1 , wherein when one of the surgery label blocks displayed on the surgery label selection area is selected, all of the surgery label blocks on the surgery label selection area are not permitted to select, and all of the surgery label blocks are displayed with the same effect.
4 . A surgical procedure labelling and teaching method, comprising:
displaying a user interface comprising a surgical image selection area, a surgical image labeling area, a label record area, a surgery video playback area, an image-labeling reference area, and a surgery label selection area, by an electronic device;
playing a surgery video on the surgery video playback area, by the electronic device;
when one of names of to-be-labelled surgical images displayed on the surgical image selection area is selected, displaying a to-be-labelled surgical image corresponding to the selected name on the surgical image labelling area, by the electronic device;
when one of the names of the to-be-labelled surgical images displayed on the surgical image selection area is selected, displaying a labelling-reference surgical image corresponding to the selected name on the image-labelling reference area, by the electronic device;
when one of names of to-be-labelled surgical images on the surgical image selection area is selected, calculating a period from a video time point minus a preset time length to the video time point plus the preset time length based on the video time point of the selected to-be-labeled surgical image, and capturing a part of the surgery video in the period to generate and play a captured surgery video, by the electronic device;
establishing and displaying a background label on the label record area, by the electronic device;
when one of surgery label blocks displayed on the surgery label selection area is selected, receiving multiple connected operating points in the surgical image labelling area to generate a newly added surgery labelling area by the electronic device wherein an edge of the newly added surgery labelling area is formed by the multiple connected operating points, wherein all of the surgery label blocks on the surgery label selection area are not permitted to select until the newly added surgery labelling area is generated;
when coordinates of at least one of the operating points are located within a coordinate range of a previously labelled surgery labelling area, a display priority of the newly added surgery labelling area or the previously labelled surgery labelling area which is labelled as surgical instrument or foreign material is higher than the display priority of the newly added surgery labelling area or the previously labelled surgery labelling area which is labelled as organs, the newly added surgery labelling area or a previously labelled surgery labelling area having a high display priority is displayed over the newly added surgery labelling area or a previously labelled surgery labelling area having a low display priority;
filling the surgery labeling area with a color corresponding to the selected surgery label block on the surgical image labeling area, and establishing a name label based on a name corresponding to the selected surgery label block on the label record area, by the electronic device;
storing the to-be-labelled surgical image, which is labeled already, as a labelled surgical image, by the electronic device, wherein the labelled surgical image comprises surgery labeling areas filled with colors;
displaying a teaching interface comprising a to-be-labeled surgical image area, a labelled surgical image area and a surgery label display area, by the electronic device;
displaying the to-be-labelled surgical image on the to-be-labelled surgical image area, and displaying the labelled surgical image on the labelled surgical image area, by the electronic device; and
displaying surgery labelling areas of the labelled surgical image filled with colors and mapped to the to-be-labelled surgical image, and displaying multiple auxiliary content blocks with colors and names corresponding to the surgery labelling areas on the surgery label display area, by the electronic device, so as to provide a surgical procedure teaching corresponding to the to-be-labeled surgical image.
5 . The surgical procedure labelling and teaching method according to claim 4 , further comprising:
displaying the name of the surgical image labelled already, the name of the surgical image being labeled, and the name of surgical image not labelled yet, with different background patterns on the surgical image selection area, by the electronic device.
6 . The surgical procedure labelling and teaching method according to claim 4 , wherein when one of the surgery label blocks displayed on the surgery label selection area is selected by the electronic device, all of the surgery label blocks on the surgery label selection area are not permitted to select, and all of the surgery label blocks are displayed with the same effect.