Method and apparatus for surgical procedure simulation based on virtual reality
View Patent ↗A method and apparatus for a surgical procedure simulation based on virtual reality (VR) are provided. The method includes generating a virtual three-dimensional (3D) body model corresponding to a body part of a subject of a surgical procedure based on a computed tomography (CT) image and providing a surgical procedure simulation for spinal cord stimulation based on the virtual 3D body model. The providing of the surgical procedure simulation for spinal cord stimulation includes outputting a virtual screen including the virtual 3D body model and a virtual C-arm apparatus, providing a surgical procedure simulation of loss of resistance (LOR) according to a selection of a user wearing the surgical procedure simulation apparatus within the virtual screen, and providing, when the surgical procedure simulation of LOR is completed, a surgical procedure simulation for lead insertion into a virtual spinal cord part included in the virtual 3D body model.
1. A method for a surgical procedure simulation based on virtual reality (VR), the method being performed by a surgical procedure simulation apparatus and comprising:
receiving a computed tomography (CT) image of a body part of a subject of a surgical procedure;
placing the CT image of the body part in a 2D form into a virtual surgical space:
generating a stereoscopic image from the CT image of the body part;
generating a virtual three-dimensional (3D) body model corresponding to the body part from the stereoscopic image based on portions of the CT image having a Hounsfield unit (HU) value within a predetermined range; and
providing a surgical procedure simulation for spinal cord stimulation based on the virtual 3D body model,
wherein the providing of the surgical procedure simulation for spinal cord stimulation comprises:
outputting a virtual screen comprising the virtual 3D body model and a virtual C-arm apparatus;
virtually radiating virtual x-rays generated with a virtual x-ray generator at the virtual 3D body model configured as a set of data slices of the CT image virtually disposed between the virtual x-ray generator and a virtual x-ray sensor;
detecting at least one point in the 3D body model at which the virtual x-rays from the virtual x-ray generator meets a portion of the 3D body model based on sensing of the virtual x-rays by the virtual x-ray sensor;
generating a virtual X-ray image of the body part based on the detecting the at least one point:
outputting the virtual X-ray image to a virtual monitor included in the virtual C-arm apparatus;
providing a surgical procedure simulation of loss of resistance (LOR) using a syringe according to a selection of a user wearing the surgical procedure simulation apparatus within the virtual screen; and
providing, when the surgical procedure simulation of LOR is completed, a surgical procedure simulation for lead insertion into a virtual spinal cord part included in the virtual 3D body model.
2. The method of claim 1 , wherein the providing of the surgical procedure simulation of LOR comprises:
providing an interface for adjusting an insertion direction of the syringe.
3. The method of claim 1 , wherein the providing of the surgical procedure simulation for lead insertion comprises:
generating a virtual X-ray image indicating a degree to which a lead is inserted into the virtual spinal cord part; and
outputting the virtual X-ray image to a virtual monitor included in the virtual C-arm apparatus.
4. The method of claim 1 , wherein the providing of the surgical procedure simulation for lead insertion comprises:
providing an interface for adjusting a direction of the lead insertion.
5. The method of claim 1 , further comprising:
outputting an interface for adjusting a C-arm based on a hand motion of the user.
6. The method of claim 1 , further comprising:
providing an interface configured to output a gradient value and a rotation angle value of a C-arm.
7. The method of claim 1 , further comprising:
outputting, when the surgical procedure simulation for lead insertion is completed, a virtual screen comprising result data of the surgical procedure simulation for spinal cord stimulation.
8. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 1 .
9. A surgical procedure simulation apparatus comprising:
a memory comprising instructions; and
a processor connected to the memory and configured to execute the instructions,
wherein, when the instructions are executed by the processor, the processor is configured to:
receive a computed tomography (CT) image of a body part of a subject of a surgical procedure;
place the CT image of the body part in a 2D form into a virtual surgical space;
generate a stereoscopic image from the CT image of the body part;
generating a virtual three-dimensional (3D) body model corresponding to the body part from the stereoscopic image based on portions of the CT image having a Hounsfield unit (HU) value within a predetermined range;
provide a surgical procedure simulation for spinal cord stimulation based on the virtual 3D body model;
output a virtual screen comprising the virtual 3D body model and a virtual C-arm apparatus;
virtually radiate virtual x-rays generated with a virtual x-ray generator at the virtual 3D body model configured as a set of data slices of the CT image virtually disposed between the virtual x-ray generator and a virtual x-ray sensor;
detect at least one point in the 3D body model at which the virtual x-rays from the virtual x-ray generator meets a portion of the 3D body model based on sensing of the virtual x-rays by the virtual x-ray sensor;
generate a virtual X-ray image of the body part based on the detecting the at least one point;
output the virtual X-ray image to a virtual monitor included in the virtual C-arm apparatus;
provide a surgical procedure simulation of loss of resistance (LOR) using a syringe according to a selection of a user wearing the surgical procedure simulation apparatus within the virtual screen, and
provide, when the surgical procedure simulation of LOR is completed, a surgical procedure simulation for lead insertion into a virtual spinal cord part included in the virtual 3D body model.
10. The apparatus of claim 9 , wherein the processor is configured to:
provide an interface for adjusting an insertion direction of the syringe.
11. The apparatus of claim 9 , wherein the processor is configured to:
generate a virtual X-ray image indicating a degree to which a lead is inserted into the virtual spinal cord part; and
output the virtual X-ray image to a virtual monitor included in the virtual C-arm apparatus.
12. The apparatus of claim 9 , wherein the processor is configured to:
provide an interface for adjusting a direction of the lead insertion.
13. The apparatus of claim 9 , wherein the processor is configured to:
output an interface for adjusting a C-arm based on a hand motion of the user.
14. The apparatus of claim 9 , wherein the processor is configured to:
provide an interface configured to output a gradient value and a rotation angle value of a C-arm.
15. The apparatus of claim 9 , wherein the processor is configured to:
output, when the surgical procedure simulation for lead insertion is completed, a virtual screen comprising result data of the surgical procedure simulation for spinal cord stimulation.