Method and program for providing feedback on surgical outcome

1. A method for providing a feedback on a surgical outcome by a computer, the method comprising:

capturing, by an image sensor, a surgical image of an actual surgical process;

generating, by the computer, actual surgical data based on the surgical image;

dividing, by the computer, the actual surgical data into a plurality of detailed surgical operations to obtain actual surgical cue sheet data composed of the plurality of detailed surgical operations;

obtaining, by the computer, reference cue sheet data about an actual surgery; and

comparing, by the computer, the actual surgical cue sheet data with the reference cue sheet data, and providing, by the computer, the feedback based on the comparison result,

wherein at least one of a standardized name or standardized code data is assigned to each of the plurality of detailed surgical operations, and

wherein the providing of the feedback includes:

obtaining search information used for searching for at least one of the plurality of detailed surgical operations;

extracting at least one detailed surgical operation corresponding to the search information based on the standardized name or the standardized code data; and

providing a feedback on the extracted at least one detailed surgical operation.

2. The method of claim 1 , wherein the actual surgical data is divided into the plurality of detailed surgical operations, based on at least one of a surgery target portion, a type of surgical tool, a number of surgical tools, a position of the surgical tool, an orientation of the surgical tool, and movement of the surgical tool included in the actual surgical data.

3. The method of claim 1 , wherein the reference cue sheet data includes optimized cue sheet data about the actual surgery or referenced virtual surgical cue sheet data.

4. The method of claim 1 , wherein the providing of the feedback includes:

comparing the plurality of detailed surgical operations included in the actual surgical cue sheet data with a plurality of detailed surgical operations included in the reference cue sheet data; and

determining, based on the comparison result, whether an unnecessary detailed surgical operation, a missing detailed surgical operation, or an incorrect detailed surgical operation is present in the actual surgical cue sheet data.

5. The method of claim 4 , wherein the determining of whether the incorrect detailed surgical operation is present in the actual surgical cue sheet data includes:

comparing movement of surgical tool corresponding to a detailed surgical operation included in the reference cue sheet data with movement of surgical tool corresponding to a detailed surgical operation included in the actual surgical cue sheet data; and

determining, based on the comparison result, whether the detailed surgical operation included in the actual surgical cue sheet data is incorrect.

6. The method of claim 1 , wherein the method further comprises:

adding the actual surgical cue sheet data to to-be-learned cue sheet data;

obtaining a model for obtaining optimized cue sheet data using the to-be-learned cue sheet data having the actual surgical cue sheet data added thereto; and

performing reinforcement learning on the obtained model.

7. The method of claim 1 , wherein the method further comprises:

detecting at least one surgical error situation from the obtained surgical information; and

providing a feedback on the detected surgical error situation.

8. The method of claim 1 , wherein the method further comprises:

obtaining information about prognosis corresponding to each of one or more actual surgical cue sheet data including the actual surgical cue sheet data;

performing reinforcement learning based on the one or more actual surgical cue sheet data and the prognosis information thereof; and

determining a correlation between at least one detailed surgical operation included in the one or more actual surgical cue sheet data and the prognosis, based on the reinforcement learning result.

9. A non-transitory computer-readable storage medium having stored therein computer-executable instructions which, when executed by a computer hardware, perform the method of claim 1 .

10. The method of claim 1 , wherein the providing the feedback on the extracted at least one detailed surgical operation comprises:

extracting, by the computer, an image of the extracted at least one detailed surgical operation; and

displaying, by a display, the extracted image.