Simulator system for medical procedure training
Implementations relate to medical simulations for medical procedure training. In some implementations, a system includes a simulation processing component including at least one processor and which generates a virtual environment using position signals that describe at least one of a position and a configuration of a physical surgical instrument relative to a physical surgical site. The simulation processing component updates the virtual environment according to changes in the position signals and according to control signals corresponding to inputs by a user of the system. The updating includes moving a virtual surgical instrument within the virtual environment, where an interaction of the virtual surgical instrument with a virtual surgical site is defined at least partly by a physical relationship between the physical surgical instrument and the physical surgical site. The simulation processing component outputs a representation of a simulation state signal indicative of a current state of the virtual environment.
1. A system comprising:
a simulation processing component including at least one processor; and
a medical device structure including a manipulator arm and a surgical instrument connected to the manipulator arm, wherein the medical device structure is positioned in a simulation area relative to a physical surgical site,
wherein the simulation processing component is configured to perform operations in a simulated setup procedure, the operations in the simulated setup procedure comprising:
determining a position of the medical device structure relative to the physical surgical site, wherein the position of the medical device structure is provided by a trainee;
comparing the position of the medical device structure to a reference position; and
causing output of setup feedback information by a first output device based on a result of comparing the position of the medical device structure, the setup feedback information indicating an evaluation of the position of the medical device structure,
wherein the simulation processing component is configured to perform operations in a simulated surgical procedure that is performed after the simulated setup procedure is completed and is performed based on a resulting position of the medical device structure resulting from the simulated setup procedure, the operations in the simulated surgical procedure comprising:
reading position signals for the manipulator arm that describe at least one of a position or a configuration of the surgical instrument relative to the physical surgical site, wherein the at least one of the position or the configuration are based on control signals corresponding to control inputs received from a user of the system during the simulated surgical procedure.
2. The system of claim 1 , wherein the operations in the simulated setup procedure include determining whether one or more particular joints of the manipulator arm are incorrectly positioned relative to reference joint positions.
3. The system of claim 1 , wherein the operations in the simulated setup procedure include determining whether the manipulator arm is positioned at a particular position during movement of the medical device structure in the simulation area.
4. The system of claim 1 , wherein the operations in the simulated surgical procedure further comprise:
comparing the at least one of the position or the configuration of the surgical instrument to an instrument reference position or configuration; and
causing output of surgical feedback information by a second output device, wherein the surgical feedback information is based on a result of the comparing the at least one of the position or the configuration of the surgical instrument.
5. The system of claim 1 , wherein the physical surgical site comprises an anatomical model, wherein the anatomical model comprises at least one sensor operative to output sensor signals to the simulation processing component indicative of a position of the surgical instrument relative to the anatomical model.
6. The system of claim 1 , wherein the operations in the simulated surgical procedure further comprise:
determining whether an incorrect setup is present during the simulated surgical procedure based on the position of the medical device structure; and
in response to determining that the incorrect setup is present, causing output of surgical feedback information by the first output device to indicate an effect of the incorrect setup on the simulated surgical procedure.
7. The system of claim 1 , wherein the operations in the simulated surgical procedure further comprise:
generating a virtual environment based on the position signals for the manipulator arm;
updating the virtual environment according to changes in the position signals and according to the control signals, the updating comprising moving a virtual surgical instrument within the virtual environment, wherein an interaction of the virtual surgical instrument with a virtual surgical site of the virtual environment is defined at least partly by a physical relationship between the surgical instrument and the physical surgical site; and
causing output by a second output device of a representation of a current state of the virtual environment.
8. The system of claim 1 , wherein the position of the medical device structure is provided by the trainee during the simulated setup procedure in setup tasks that configure components of the medical device structure, including the manipulator arm, to perform at least one of the operations in the simulated surgical procedure.
9. The system of claim 1 , wherein, in the simulated setup procedure, the manipulator arm is positioned in the simulation area relative to the physical surgical site by manual movement of the manipulator arm by the trainee, and wherein, in the simulated surgical procedure, the surgical instrument or manipulator arm are positioned in the simulation area relative to the physical surgical site based on control of a controller device via the control inputs from the user of the system.
10. The system of claim 1 , wherein the operations in the simulated setup procedure further comprise determining whether the manipulator arm is positioned at a particular position during movement of the medical device structure in the simulation area relative to the physical surgical site, and
wherein causing the output of the setup feedback information by the first output device is based on the result of comparing the position of the medical device structure and is based on a result of determining whether the manipulator arm is positioned at the particular position during the movement of the medical device structure.
11. The system of claim 1 , wherein the setup feedback information includes images displayed by the first output device visually depicting the manipulator arm and, in response to determining that a joint of the manipulator arm is incorrectly positioned based on the comparing, visually indicating the joint of the manipulator arm.
12. A method to provide feedback in a simulated medical procedure, the method comprising:
performing operations in a simulated setup procedure, the operations in the simulated setup procedure comprising:
determining a position of a medical device structure relative to a physical surgical site, wherein the medical device structure includes a manipulator arm and a surgical instrument connected to the manipulator arm, wherein the medical device structure is positioned in a simulation area relative to the physical surgical site and the position of the medical device structure is provided by a trainee;
comparing the position of the medical device structure to a reference position; and
causing output of setup feedback information by a first output device based on a result of comparing the position of the medical device structure, the setup feedback information indicating an evaluation of the position of the medical device structure provided by the trainee; and
performing operations in a simulated surgical procedure that is performed after the simulated setup procedure is completed and is performed based on a resulting position of the medical device structure resulting from the simulated setup procedure, the operations in the simulated surgical procedure comprising:
reading position signals for the manipulator arm that describe at least one of a position or a configuration of the surgical instrument relative to the physical surgical site, wherein the at least one of the position or the configuration are based on control signals based on user input to a control device during the simulated surgical procedure.
13. The method of claim 12 , wherein the operations in the simulated setup procedure include determining whether one or more particular joints of the manipulator arm are incorrectly positioned relative to reference joint positions.
14. The method of claim 12 , wherein the operations in the simulated setup procedure include determining whether the manipulator arm is positioned at a particular position during movement of the medical device structure in the simulation area.
15. The method of claim 12 , wherein the operations in the simulated surgical procedure further comprise:
comparing the at least one of the position or the configuration of the surgical instrument to an instrument reference position or configuration; and
causing output of surgical feedback information by a second output device, wherein the surgical feedback information is based on a result of the comparing the at least one of the position or the configuration of the surgical instrument.
16. The method of claim 12 , wherein the physical surgical site comprises an anatomical model, and further comprising receiving sensor signals from at least one sensor of the anatomical model, the sensor signals indicative of a position of the surgical instrument relative to the anatomical model.
17. The method of claim 12 , wherein the operations in the simulated surgical procedure further comprise:
determining whether an incorrect setup is present during the simulated surgical procedure based on the position of the medical device structure; and
in response to determining that the incorrect setup is present, causing output of surgical feedback information by the first output device to indicate an effect of the incorrect setup on the simulated surgical procedure.
18. The method of claim 12 , wherein the operations in the simulated surgical procedure further comprise:
generating a virtual environment based on the position signals for the manipulator arm;
updating the virtual environment according to changes in the position signals and according to the control signals, the updating comprising moving a virtual surgical instrument within the virtual environment, wherein an interaction of the virtual surgical instrument with a virtual surgical site of the virtual environment is defined at least partly by a physical relationship between the surgical instrument and the physical surgical site; and
causing output by a second output device of a representation of a current state of the virtual environment.
19. The method of claim 12 , wherein the position of the medical device structure is provided by the trainee during the simulated setup procedure in setup tasks that include installing the surgical instrument on the manipulator arm.
20. The method of claim 12 , wherein the operations in the simulated setup procedure further comprise determining whether the manipulator arm is positioned at a particular position during movement of the medical device structure in the simulation area relative to the physical surgical site, and
wherein causing the output of the setup feedback information by the first output device is based on the result of comparing the position of the medical device structure and is based on a result of determining whether the manipulator arm is positioned at the particular position during the movement of the medical device structure.