IP Library Granted Patent US 12,456,392
Granted Patent B2
US 12,456,392 · App. 17/902,678 · Granted Oct 28, 2025

Simulator system for medical procedure training

Inventors: Anthony M. Jarc (Sunnyvale, CA); Joey Chau (Cupertino, CA); Brian E. Miller (Los Gatos, CA)
Assignee: Intuitive Surgical Operations, Inc.
G09B23/28G09B23/285A61B34/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,456,392
App. No.
17/902,678
Granted
Oct 28, 2025
Kind
B2
Abstract

Implementations relate to medical simulations for medical procedure training. In some implementations, a system includes a simulation processing component including at least one processor and which generates a virtual environment using position signals that describe at least one of a position and a configuration of a physical surgical instrument relative to a physical surgical site. The simulation processing component updates the virtual environment according to changes in the position signals and according to control signals corresponding to inputs by a user of the system. The updating includes moving a virtual surgical instrument within the virtual environment, where an interaction of the virtual surgical instrument with a virtual surgical site is defined at least partly by a physical relationship between the physical surgical instrument and the physical surgical site. The simulation processing component outputs a representation of a simulation state signal indicative of a current state of the virtual environment.

Claims (41)

1. A method comprising:

determining a position of a system component relative to a physical surgical site, wherein the system component is positioned relative to the physical surgical site during a setup procedure and wherein the system component is movable independently of the physical surgical site;

determining a position of a teleoperable medical device relative to the physical surgical site, wherein the teleoperable medical device is positioned relative to the physical surgical site during the setup procedure;

storing, by at least one processor, in a storage device, the position of the system component and the position of the teleoperable medical device; and

performing operations in a simulated surgical procedure based on the position of the system component and the position of the teleoperable medical device.

2. The method of claim 1 , further comprising determining, during the setup procedure, whether one or more particular joints of the teleoperable medical device are incorrectly positioned based on a comparison with reference joint positions.

3. The method of claim 1 , wherein the position of the system component is in a simulation area and is provided by a user, and the position of the teleoperable medical device is provided by the user.

4. The method of claim 3 , further comprising causing output of setup feedback information by an output device based on a result of comparing the position of the system component to a reference position, the setup feedback information indicating an evaluation of the position of the system component provided by the user.

5. The method of claim 3 , further comprising causing output of setup feedback information by an output device based on a result of comparing the position of the teleoperable medical device to a reference position, the setup feedback information indicating an evaluation of the position of the teleoperable medical device provided by the user.

6. The method of claim 1 , wherein performing the operations in the simulated surgical procedure includes reading position signals for the teleoperable medical device that describe at least one of a position or a configuration of the teleoperable medical device relative to the physical surgical site, wherein the at least one of the position or the configuration is based on control signals based on user input to a control device during the simulated surgical procedure.

7. The method of claim 1 , wherein performing the operations in the simulated surgical procedure includes:

comparing at least one of: a position of the teleoperable medical device to a reference position or a configuration of the teleoperable medical device to a reference configuration; and

causing output of surgical feedback information by an output device, wherein the surgical feedback information is based on a result of the comparing.

8. The method of claim 1 , wherein performing the operations in the simulated surgical procedure includes:

determining whether an incorrect setup is present during the simulated surgical procedure based on the position of the teleoperable medical device; and

in response to determining that the incorrect setup is present, causing output of surgical feedback information by an output device to indicate an effect of the incorrect setup on the simulated surgical procedure.

9. The method of claim 1 , wherein the physical surgical site comprises an anatomical model, and the method further comprises receiving, by the at least one processor, a sensor signal from at least one sensor of the anatomical model, the sensor signals indicative of a position of the teleoperable medical device relative to the anatomical model.

10. The method of claim 1 , wherein performing the operations in the simulated surgical procedure includes:

generating a virtual environment based at least in part on the position of the teleoperable medical device;

updating the virtual environment according to changes in the position of the teleoperable medical device, the changes based on control signals from a user control device; and

after the updating, causing output by an output device of a representation of a current state of the virtual environment.

11. The method of claim 1 , wherein the system component includes a vision side cart that includes a display device, wherein the vision side cart is moveable in a simulation area independently of the physical surgical site and of the teleoperable medical device.

12. The method of claim 1 , wherein the position of the teleoperable medical device is provided by a user during the setup procedure in setup tasks that include installation of a surgical instrument on a manipulator arm of the teleoperable medical device.

13. A system comprising:

a simulation processing component including at least one processor;

a teleoperable medical device moveable relative to a physical surgical site; and

a system component movable relative to and independently of the physical surgical site,

wherein the simulation processing component is configured to perform operations comprising:

determining a position of the teleoperable medical device relative to the physical surgical site, wherein the teleoperable medical device is positioned relative to the physical surgical site during a setup procedure;

determining a position of the system component relative to the physical surgical site, wherein the system component is positioned relative to the physical surgical site during the setup procedure;

storing, by the at least one processor, in a storage device, the position of the system component and the position of the teleoperable medical device; and

performing surgical procedure operations in a simulated surgical procedure based on the position of the teleoperable medical device and the position of the system component.

14. The system of claim 13 , wherein the simulation processing component is configured to perform further operations comprising:

determining whether an incorrect setup is present during the simulated surgical procedure based on the position of the teleoperable medical device; and

in response to determining that the incorrect setup is present, causing output of surgical feedback information by an output device to indicate an effect of the incorrect setup on the simulated surgical procedure.

15. The system of claim 13 , wherein the position of the system component is in a simulation area and is provided by a user, and the position of the teleoperable medical device is provided by the user.

16. The system of claim 15 , wherein the simulation processing component is configured to perform further operations comprising causing output of setup feedback information by an output device based on a result of comparing the position of the system component and the position of the teleoperable medical device to reference positions, the setup feedback information indicating an evaluation of the position of the system component and the teleoperable medical device provided by the user.

17. The system of claim 13 , wherein the teleoperable medical device includes a manipulator arm and a surgical instrument connected to the manipulator arm, wherein the teleoperable medical device is positioned in a simulation area relative to the physical surgical site.

18. The system of claim 13 , wherein, during the setup procedure, the teleoperable medical device is positioned relative to the physical surgical site by manual movement of the teleoperable medical device by a trainee, and wherein, in the simulated surgical procedure, the teleoperable medical device is positioned relative to the physical surgical site based on control signals based on user manipulation of a control device.

19. The system of claim 13 , wherein performing the surgical procedure operations in the simulated surgical procedure includes reading position signals for the teleoperable medical device that describe at least one of a position or a configuration of the teleoperable medical device relative to the physical surgical site, wherein the at least one of the position or the configuration is based on control signals based on user input to a control device during the simulated surgical procedure.

20. The system of claim 13 , wherein the system component includes a vision side cart that includes a display device, wherein the vision side cart is moveable in a simulation area independently of the physical surgical site and of the teleoperable medical device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2022
From: JARC, ANTHONY M.; CHAU, JOEY; MILLER, BRIAN E.
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 060984/0969 →
Continuity (4)
Continuation 16584564 · Sep 26, 2019
Continuation 15106254
Provisional Application 61919631 · Dec 20, 2013
Related Publication 20220415210A1 · Dec 29, 2022
References Cited (145)
US 4321047A · Landis · 1982 [cited by applicant]
US 5403191A · Tuason · 1995 [cited by applicant]
US 5620326A · Younker · 1997 [cited by applicant]
US 5766016A · Sinclair et al. · 1998 [cited by applicant]
US 5769640A · Jacobus et al. · 1998 [cited by applicant]
US 5800177A · Gillio · 1998 [cited by applicant]
US 5945056A · Day et al. · 1999 [cited by applicant]
US 5951301A · Younker · 1999 [cited by applicant]
US 6024576A · Bevirt et al. · 2000 [cited by applicant]
US 6377011B1 · Ben-Ur · 2002 [cited by applicant]
US 6544041B1 · Damadian · 2003 [cited by applicant]
US 7706000B2 · Cohen et al. · 2010 [cited by applicant]
US 7798815B2 · Ramphal et al. · 2010 [cited by applicant]
US 7866983B2 · Hemphill et al. · 2011 [cited by applicant]
US 8073528B2 · Zhao et al. · 2011 [cited by applicant]
US 8190238B2 · Moll et al. · 2012 [cited by applicant]
US 8469716B2 · Fedotov et al. · 2013 [cited by applicant]
US 8600551B2 · Itkowitz et al. · 2013 [cited by applicant]
US 8786675B2 · Deering · 2014 [cited by applicant]
US 8992230B2 · Tuchschmid · 2015 [cited by examiner]
US 9196176B2 · Hager et al. · 2015 [cited by applicant]
US 9341704B2 · Picard · 2016 [cited by examiner]
US 9812035B2 · Stuart et al. · 2017 [cited by applicant]
US 10510267B2 · Jarc et al. · 2019 [cited by applicant]
US 10580326B2 · Jarc et al. · 2020 [cited by applicant]
US 10648790B2 · Foster et al. · 2020 [cited by applicant]
US 10943508B2 · Jarc et al. · 2021 [cited by applicant]
US 11468791B2 · Jarc et al. · 2022 [cited by applicant]
US 11727827B2 · Jarc et al. · 2023 [cited by applicant]
US 20040045561A1 · Alexander et al. · 2004 [cited by applicant]
US 20040106916A1 · Quaid · 2004 [cited by examiner]
US 20040126746A1 · Toly · 2004 [cited by applicant]
US 20050142525A1 · Cotin et al. · 2005 [cited by applicant]
US 20060019228A1 · Riener et al. · 2006 [cited by applicant]
US 20060073454A1 · Hyltander et al. · 2006 [cited by applicant]
US 20060099557A1 · Hyltander et al. · 2006 [cited by applicant]
US 20070275359A1 · Rotnes et al. · 2007 [cited by applicant]
US 20070292829A1 · King et al. · 2007 [cited by applicant]
US 20070293734A1 · Coste-Maniere et al. · 2007 [cited by applicant]
US 20080187896A1 · Savitsky · 2008 [cited by applicant]
US 20080227073A1 · Bardsley et al. · 2008 [cited by applicant]
US 20090017430A1 · Muller-Daniels · 2009 [cited by examiner]
US 20090088634A1 · Zhao · 2009 [cited by examiner]
US 20090132925A1 · Koehler et al. · 2009 [cited by applicant]
US 20090142739A1 · Wang et al. · 2009 [cited by applicant]
US 20090176196A1 · Niblock et al. · 2009 [cited by applicant]
US 20090248037A1 · Prisco · 2009 [cited by applicant]
US 20090253109A1 · Anvari et al. · 2009 [cited by applicant]
US 20090263775A1 · Ullrich · 2009 [cited by applicant]
US 20090317002A1 · Dein · 2009 [cited by applicant]
US 20090326324A1 · Munoz et al. · 2009 [cited by applicant]
US 20100035223A1 · Shibui et al. · 2010 [cited by applicant]
US 20100086905A1 · Illana et al. · 2010 [cited by applicant]
US 20100099066A1 · Mire et al. · 2010 [cited by applicant]
US 20100167248A1 · Ryan · 2010 [cited by applicant]
US 20100167249A1 · Ryan · 2010 [cited by applicant]
US 20100167250A1 · Ryan et al. · 2010 [cited by applicant]
US 20100167253A1 · Ryan et al. · 2010 [cited by applicant]
US 20100216105A1 · Hammerman · 2010 [cited by applicant]
US 20100285438A1 · Kesavadas et al. · 2010 [cited by applicant]
US 20100311028A1 · Bell, III et al. · 2010 [cited by applicant]
US 20110014596A1 · Kurenov et al. · 2011 [cited by applicant]
US 20110046935A1 · Sugaya · 2011 [cited by applicant]
US 20110086332A1 · Speiser et al. · 2011 [cited by applicant]
US 20110117530A1 · Albocher et al. · 2011 [cited by applicant]
US 20110152882A1 · Wenderow et al. · 2011 [cited by applicant]
US 20110212426A1 · Gloeggler et al. · 2011 [cited by applicant]
US 20110256519A1 · Park et al. · 2011 [cited by applicant]
US 20120045742A1 · Meglan et al. · 2012 [cited by applicant]
US 20120053402A1 · Conlon et al. · 2012 [cited by applicant]
US 20120058457A1 · Savitsky · 2012 [cited by applicant]
US 20120082970A1 · Pravong et al. · 2012 [cited by applicant]
US 20120115118A1 · Marshall · 2012 [cited by applicant]
US 20120135387A1 · Morrow et al. · 2012 [cited by applicant]
US 20120148994A1 · Hori et al. · 2012 [cited by applicant]
US 20120251987A1 · Huang et al. · 2012 [cited by applicant]
US 20120264096A1 · Taylor et al. · 2012 [cited by applicant]
US 20120264097A1 · Newcott et al. · 2012 [cited by applicant]
US 20120282583A1 · Thaler et al. · 2012 [cited by applicant]
US 20130101973A1 · Hoke et al. · 2013 [cited by applicant]
US 20130157240A1 · Hart et al. · 2013 [cited by applicant]
US 20130189663A1 · Tuchschmid et al. · 2013 [cited by applicant]
US 20130192741A1 · Trotta et al. · 2013 [cited by applicant]
US 20130218340A1 · Hager et al. · 2013 [cited by applicant]
US 20130230837A1 · Meglan et al. · 2013 [cited by applicant]
US 20130237811A1 · Mihailescu · 2013 [cited by examiner]
US 20130288217A1 · Hammerman · 2013 [cited by applicant]
US 20130295540A1 · Kesavadas et al. · 2013 [cited by applicant]
US 20140011172A1 · Lowe · 2014 [cited by applicant]
US 20140051049A1 · Jarc et al. · 2014 [cited by applicant]
US 20140057236A1 · Meglan et al. · 2014 [cited by applicant]
US 20140087346A1 · Breslin et al. · 2014 [cited by applicant]
US 20140087347A1 · Tracy et al. · 2014 [cited by applicant]
US 20140087348A1 · Tracy et al. · 2014 [cited by applicant]
US 20140093854A1 · Poulsen et al. · 2014 [cited by applicant]
US 20140106328A1 · Loor · 2014 [cited by applicant]
US 20140272867A1 · Ratcliffe · 2014 [cited by examiner]
US 20140272878A1 · Shim et al. · 2014 [cited by applicant]
US 20140272879A1 · Shim et al. · 2014 [cited by applicant]
US 20140287393A1 · Kumar et al. · 2014 [cited by applicant]
US 20140329217A1 · Barsness et al. · 2014 [cited by applicant]
US 20150037775A1 · Ottensmeyer et al. · 2015 [cited by applicant]
US 20150100066A1 · Kostrzewski et al. · 2015 [cited by applicant]
US 20150132732A1 · Hart et al. · 2015 [cited by applicant]
US 20150262511A1 · Lin et al. · 2015 [cited by applicant]
US 20150325151A1 · Tuchschmid et al. · 2015 [cited by applicant]
US 20150356891A1 · Will · 2015 [cited by applicant]
US 20160098933A1 · Reiley · 2016 [cited by examiner]
US 20160314716A1 · Grubbs · 2016 [cited by applicant]
US 20160379504A1 · Bailey et al. · 2016 [cited by applicant]
US 20200020249A1 · Jarc et al. · 2020 [cited by applicant]
US 20210209966A1 · Jarc et al. · 2021 [cited by applicant]
CN 1488127A · 2004 [cited by applicant]
CN 102254476A · 2011 [cited by applicant]
CN 102362302A · 2012 [cited by applicant]
CN 103077633A · 2013 [cited by applicant]
EP 1909246A1 · 2008 [cited by applicant]
JP 2001150368A · 2001 [cited by applicant]
JP 2006087936A · 2006 [cited by applicant]
JP 2007007041A · 2007 [cited by applicant]
JP 2009529951A · 2009 [cited by applicant]
JP 2009236963A · 2009 [cited by applicant]
JP 2010082189A · 2010 [cited by applicant]
JP 2012005557A · 2012 [cited by applicant]
JP 2012521568A · 2012 [cited by applicant]
KR 20110065388A · 2011 [cited by applicant]
KR 20120122542A · 2012 [cited by applicant]
WO WO9825666A1 · 1998 [cited by applicant]
WO WO9917265A1 · 1999 [cited by applicant]
WO WO9942978A1 · 1999 [cited by applicant]
WO WO0030548A1 · 2000 [cited by applicant]
WO WO02059859A1 · 2002 [cited by applicant]
WO WO2006039092A2 · 2006 [cited by applicant]
WO WO2006060406A1 · 2006 [cited by applicant]
WO WO2009094621A2 · 2009 [cited by applicant]
WO WO2010025338A1 · 2010 [cited by applicant]
WO WO2010105237A2 · 2010 [cited by applicant]
WO WO2010117685A2 · 2010 [cited by applicant]
WO WO2015095715A1 · 2015 [cited by applicant]
Extended European Search Report for Application No. EP22205491.8, mailed on Mar. 7, 2023, 6 pages. [cited by applicant]
Extended European Search Report for Application No. 14871282.1, mailed on Jun. 7, 2017, 7 pages. [cited by applicant]
International Preliminary Report on Patentability for Application No. PCT/US2014/071521, mailed on Jun. 30, 2016, 7 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US14/71521, mailed on Mar. 31, 2015, 11 pages. [cited by applicant]
Office Action mailed Feb. 20, 2019 for Chinese Application No. 201480076076 filed Dec. 19, 2014, 25 pages. [cited by applicant]
Vertut, J, and Coiffet, P., “Robot Technology: Teleoperation and Robotics Evolution and Development,” English translation, Prentice-Hall, Inc., Inglewood Cliffs, NJ, USA 1986, vol. 3A, 332 pages. [cited by applicant]