Method for generating surgical simulation information and program
A method for creating surgical simulation information by a computer includes creating a virtual body model corresponding to a body state of a patient for surgery, simulating a specific surgical process on the virtual body model to obtain virtual surgical data, dividing the virtual surgical data into minimum surgical operation units, each unit representing one specific operation, and creating cue sheet data composed of the minimum surgical operation units, wherein the cue sheet data represents the specific surgical process.
1 . A device for providing a surgical simulation based on a virtual reality, comprising:
a memory for storing one or more instructions; and
a processor configured to perform an operation for providing the surgical simulation by executing the one or more instructions,
wherein the processor is further configured to:
acquire body surface data by imaging abdominal surfaces deformed by injecting carbon dioxide before surgeries are performed;
learn the acquired body surface data, and create a correction algorithm to transform a 3-dimensional (3D) virtual body model in a normal state into a 3D virtual body model in a pneumoperitoneum state;
obtain medical image data of a patient;
create a 3D virtual body model of the patient, in the normal state;
transform the created 3D virtual body model of the patient, in the normal state, to the 3D virtual body model of the patient, in the pneumoperitoneum state, by using the correction algorithm;
output the 3D virtual body model of the patient, in the pneumoperitoneum state, based on the virtual reality;
create virtual surgical data based on a virtual surgical operation performed using the 3D virtual body model of the patient, in the pneumoperitoneum state, in the virtual reality; and
provide the virtual surgical data as surgical guide information when performing an actual surgery on the patient.
2 . The device of claim 1 , wherein the processor is further configured to divide the virtual surgical data into a plurality of detailed surgical operations based on a specific criteria.
3 . The device of claim 2 , wherein the specific criteria includes at least one of a surgery target position, a type of a surgical tool, a number of the surgical tool, a position of the surgical tool, an orientation of the surgical tool, or a movement of the surgical tool, and
wherein the plurality of detailed surgical operations are a minimum operation unit constituting a surgical process, and are sequentially applied to the virtual body model of the patient, in the pneumoperitoneum state, so that a virtual surgery is reproduced.
4 . The device of claim 2 , wherein the specific criteria is calculated through learning of big data constructed by actual surgical data, and
wherein the processor is further configured to divide the virtual surgical data into the plurality of detailed surgical operations according to a detailed category included in the specific criteria.
5 . The device of claim 1 , wherein the processor is further configured to output the 3D virtual body model of the patient, in the pneumoperitoneum state, through an external device connected to the device.
6 . The device of claim 5 , wherein the processor is further configured to:
create the 3D virtual body model of the patient, in the normal state, by obtaining an image of a region including at least one of blood vessels and organs from a Computed Tomography (CT) image of the patient,
obtain a movement of a user's hand corresponding to a motion for a virtual surgery simulation of the user or a motion for a virtual surgery plan of the user with respect to the 3D virtual body model of the patient, in the normal state, through a controller connected to the device, and
create the virtual surgical data based on the movement of the user's hand.
7 . The device of claim 2 , wherein the processor is further configured to create cue sheet data including the plurality of detailed surgical operations using the virtual surgical data.
8 . The device of claim 7 , wherein the cue sheet data includes data in which the plurality of detailed surgical operations are sequentially arranged.
9 . The device of claim 8 , wherein the cue sheet data includes data in which standardized codes for the plurality of detailed surgical operations are sequentially arranged.
10 . The device of claim 9 , wherein the standardized codes include codes in which character strings corresponding to each category to which the plurality of detailed surgical operations belong are sequentially arranged from a higher category.
11 . The device of claim 7 , wherein the processor is further configured to:
determine whether the created cue sheet data is optimized, and
provide the surgical guide information based on the cue sheet data determined to be optimized.
12 . The device of claim 11 , wherein the processor is further configured to:
obtain optimized cue sheet data, and
determine whether the created cue sheet data is optimized by comparing the created cue sheet data with the optimized cue sheet data.
13 . The device of claim 12 , wherein the processor is further configured to determine whether the created cue sheet data is optimized based on whether an unnecessary detailed surgical operation that delays a surgery time is included in the created cue sheet data.
14 . The device of claim 12 , wherein the processor is further configured to determine whether the created cue sheet data is optimized based on whether a detailed surgical operation that must be contained before or after a specific detailed surgical operation when performing a specific detailed surgical operation is absent in the created cue sheet data.
15 . The device of claim 12 , wherein the processor is further configured to:
obtain one or more to-be-learned cue sheet data,
perform reinforcement learning using the one or more to-be-learned cue sheet data, and
obtain the optimized cue sheet data based on the reinforcement learning result.
16 . A method for providing a surgical simulation based on a virtual reality, performed by a processor of a device, the method comprising:
acquiring, by the processor, body surface data by imaging abdominal surfaces deformed by injecting carbon dioxide before surgeries are performed;
learning, by the processor, the acquired body surface data, and creating, by the processor, a correction algorithm to transform a 3-dimensional (3D) virtual body model in a normal state into a 3D virtual body model in a pneumoperitoneum state;
obtaining, by the processor, medical image data of a patient;
creating, by the processor, a 3D virtual body model of the patient, in the normal state;
transforming, by the processor, the created 3D virtual body model of the patient, in the normal state, to the 3D virtual body model of the patient, in the pneumoperitoneum state, by using the correction algorithm;
outputting, by the processor, the 3D virtual body model of the patient, in the pneumoperitoneum state, based on the virtual reality;
creating, by the processor, virtual surgical data based on a virtual surgical operation performed using the 3D virtual body model of the patient, in the pneumoperitoneum state, in the virtual reality; and
providing, by the processor, the virtual surgical data as surgical guide information when performing an actual surgery on the patient.