IP Library › Granted Patent US 12,272,463
Granted Patent B2
US 12,272,463 · App. 17/332,594 · Granted Apr 8, 2025

Methods for surgical simulation

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Charles J. Scheib (Loveland, OH); Jason L. Harris (Lebanon, OH); Kevin M. Fiebig (Cincinnati, OH); Dwight Alan Meglan (Westwood, MA)
Assignee: Cilag GmbH International
G16H50/50A61B18/14A61B34/25A61B34/30A61B34/37A61B90/36G06F30/20G06N20/00G06N20/10G09B9/00G09B19/003G09B23/30G16H15/00G16H20/40G16H30/40G16H40/20G16H40/63G16H40/67G16H50/70G16H70/20A61B2018/1253A61B2018/126A61B34/10A61B2034/101A61B2034/102A61B2034/105A61B2034/107A61B2034/252A61B2034/254A61B2034/256A61B2034/258A61B2090/363A61B2090/365A61B2218/002A61B2218/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,272,463
App. No.
17/332,594
Granted
Apr 8, 2025
Kind
B2
Abstract

An interactive and dynamic surgical simulation system may be used in the context of a computer-implemented interactive surgical system. An operating-room-based surgical data system may aggregate surgical activity data that is indicative of a performance of a live surgical procedure. The surgical simulation device may receive the surgical activity data from the operating-room-based surgical data system. And the surgical simulation device may simulate a surgical task based on surgical activity data. The surgical activity data may be structured by a procedure plan data structure. The procedure plan data structure may be common to the operating-room-based surgical data system and the surgical simulation device. The procedure plan data structure may be configured to covey information indicative of equipment, technique, and surgical steps in a structured format such that the equipment, technique, and surgical steps of the live surgical procedure are reflected in the simulated surgical procedure.

Claims (61)

1. A method for improving surgical outcomes using a surgical simulator, the method comprising:

aggregating, by an operating-room-based surgical data system, surgical activity data indicative of a performance of a live surgical procedure;

communicating the surgical activity data from the operating-room-based surgical data system to a surgical simulation device, in communication with the operating-room-based surgical data system;

simulating a surgical task within a simulation environment based on the surgical activity data;

the operating-room-based surgical data system setting consequence environmental parameters and a triggering event based on the consequence environmental parameters;

the operating-room-based surgical data system sending surgical interaction data comprising a triggering threshold to the surgical simulation device;

the surgical simulation device identifying deviations from a surgical procedure plan from a pre-operative simulation and identifying recovery options;

the surgical simulation device identifying modifications to be made from the surgical procedure;

receiving, from a user of the surgical simulation device, user interaction data based on a user action within the simulation environment, the user interaction data related to a surgeon performing the surgical task and the identified modifications to be made from the surgical procedure;

determining that the user interaction data has crossed the triggering threshold received from the operating-room-based surgical data system;

based on the user interaction data crossing the triggering threshold, modifying the simulation environment by updating one or more values of environmental parameters with one or more values of consequence environmental parameters associated with the triggering event;

notifying the surgeon of the modified simulation environment indicative of the performance of a modified surgical procedure, wherein the notification indicates that the modified simulation environment implements improved surgical techniques; and

displaying the modified simulation environment via a surgical display module in the operating room;

wherein modified simulation environment allows the surgeon to view potential consequences of future actions and make informed decisions and improve surgical outcomes.

2. The method of claim 1 , wherein the operating-room-based surgical data system aggregates the surgical activity data from a plurality of smart surgical instruments.

3. The method of claim 2 , wherein the plurality of smart surgical instruments comprises at least one of a monopolar instrument, a bipolar instrument, an ultrasonic instrument, a smoke evacuation instrument, a suction instrument, an irrigation instrument, an imaging instrument, or a surgical robotic instrument.

4. The method of claim 1 , further comprising a direct communications connection between the surgical simulation device and the operating-room-based surgical data system.

5. The method of claim 1 , further comprising a data network providing connectivity between the operating-room-based surgical data system and a network adapter of the surgical simulation device.

6. The method of claim 1 , wherein the user interaction data is received via a user interface device.

7. The method of claim 6 , wherein the user interface device comprises any of a virtual reality headset or a robotic surgery surgeon's console.

8. The method of claim 1 , wherein the surgical activity data is structured by a procedure plan data structure that is common to the operating-room-based surgical data system and the surgical simulation device, wherein the operating-room-based surgical data system is configured to employ the procedure plan data structure to record discrete elements of the live surgical procedure for structured analysis, and wherein the surgical simulation device is configured to employ the procedure plan data structure to establish a setting and an objective for a simulation session.

9. The method of claim 8 , wherein the procedure plan data structure is configured to covey information indicative of equipment, technique, and surgical steps in a structured format such that the equipment, technique, and surgical steps of the live surgical procedure are reflected in the simulation environment.

10. A system for improving surgical outcomes using a surgical simulator, the system comprising:

an operating-room-based surgical data system, wherein the operating-room based surgical data system aggregates surgical activity data indicative of a performance of a live surgical procedure; and

a surgical simulation device, in communication with the operating-room-based surgical data system, wherein the surgical simulation device is configured to:

receive the surgical activity data from the operating-room-based surgical data system,

simulate a surgical task within a simulation environment based on the surgical activity data,

receive, from the operating-room-based surgical data system, surgical interaction data comprising a trigger threshold, wherein the operating-room-based surgical data system sets consequence environmental parameters and a trigger event based on the consequence environmental parameters,

identify deviations from a surgical procedure plan from a pre-operative simulation and identify recovery options,

identify modifications to be made from the surgical procedure,

receive, from a user of the surgical simulation device, user interaction data based on a user action within the simulation environment, the user interaction data related to a surgeon performing the surgical task and the identified modifications to be made from the surgical procedure,

determine that the user interaction data has crossed the trigger threshold received from the operating-room-based surgical data system,

based on the user interaction data crossing the trigger threshold, modify the simulation environment by updating one or more values of environmental parameters with one or more values of the consequence environmental parameters associated with the trigger event,

notify the surgeon of the modified simulation environment indicative of the performance of a modified surgical procedure, wherein the notification indicates that the modified simulation environment implements improved surgical techniques, and

display the modified simulation environment via a surgical display module in the operating room,

wherein the modified simulation environment allows the surgeon to view potential consequences of future actions and make informed decisions and improve surgical outcomes.

11. The system of claim 10 , further comprising:

aggregating, by the operating-room-based surgical data system, the surgical activity data from a plurality of smart surgical instruments.

12. The system of claim 11 , wherein the plurality of smart surgical instruments comprises at least one of a monopolar instrument, a bipolar instrument, an ultrasonic instrument, a smoke evacuation instrument, a suction instrument, an irrigation instrument, an imaging instrument, or a surgical robotic instrument.

13. The system of claim 10 , wherein said communicating comprises communicating via a direct communications connection between the surgical simulation device and the operating-room-based surgical data system.

14. The system of claim 10 , wherein said communicating comprises communicating via a data network providing connectivity between the operating-room-based surgical data system and a network adapter of the surgical simulation device.

15. The system of claim 10 , wherein the user interaction is received via a user interface device.

16. The system of claim 15 , wherein the user interface device comprises any of a virtual reality headset or a robotic surgery surgeon's console.

17. The system of claim 10 , wherein the surgical activity data is structured by a procedure plan data structure that is common to the operating-room-based surgical data system and the surgical simulation device, further comprising:

employing, by the operating-room-based surgical data system, the procedure plan data structure to record discrete elements of the live surgical procedure for structured analysis; and

employing, by the surgical simulation device, the procedure plan data structure to establish a setting and an objective for a simulation session;

wherein the procedure plan data structure is configured to covey information indicative of equipment, technique, and surgical steps in a structured format such that the equipment, technique, and surgical steps of the live surgical procedure are reflected in the simulation environment.

18. A system for improving surgical outcomes using a surgical simulator, the system comprising:

an operating-room-based surgical data system, wherein the operating-room based surgical data system aggregates surgical activity data indicative of a performance of a live surgical procedure; and

a surgical simulation device, in communication with the operating-room-based surgical data system, wherein the surgical simulation device is configured to:

receive the surgical activity data from the operating-room-based surgical data system,

simulate a surgical task within a simulation environment based on the surgical activity data such that the surgical simulation device enables at least one of dynamic adaptation, rectification of surgical simulation objects enhanced navigation, coordinated surgical imagining, simulated surgical equipment coordination, simulation-based surgical procedure planning, simulation-based directed surgical development, simulation of surgical adverse events, or simulation-based surgical analysis,

receive, from the operating-room-based surgical data system, surgical interaction data comprising a trigger threshold, wherein the operating-room-based surgical data system sets consequence environmental parameters and a trigger event based on the consequence environmental parameters,

identify deviations from a surgical procedure plan from a pre-operative simulation and identify recovery options,

identify modifications to be made from the surgical procedure,

receive, from a user of the surgical simulation device, user interaction data based on a user action within the simulation environment, the user interaction data related to a surgeon performing the surgical task and the identified modifications to be made from the surgical procedure,

determine that the user interaction data has crossed the trigger threshold received from the operating-room-based surgical data system,

based on the user interaction data crossing the trigger threshold, modify the simulation environment by updating one or more values of environmental parameters with one or more values of the consequence environmental parameters associated with the trigger event;

notify the surgeon of the modified simulation environment indicative of the performance of a modified surgical procedure, wherein the notification indicates that the modified simulation environment implements improved surgical techniques, and

display the modified simulation environment via a surgical display module in the operating room;

wherein the modified simulation environment allows the surgeon to view potential consequences of future actions and make informed decisions and improve surgical outcomes.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2021
From: SHELTON, FREDERICK E., IV; SCHEIB, CHARLES J.; HARRIS, JASON L.; FIEBIG, KEVIN; MEGLAN, DWIGHT ALAN
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056616/0339 →
Continuity (2)
Provisional Application 63191681 · May 21, 2021
Related Publication 20220370138A1 · Nov 24, 2022
References Cited (67)
US 8311791B1 · Avisar · 2012 [cited by examiner]
US 9104791B2 · Cohen et al. · 2015 [cited by applicant]
US 9734632B2 · Thomas et al. · 2017 [cited by applicant]
US 9881520B2 · Ullrich et al. · 2018 [cited by applicant]
US 10172676B2 · Ecabert et al. · 2019 [cited by applicant]
US 20080235052A1 · Node-Langlois et al. · 2008 [cited by applicant]
US 20090089092A1 · Johnson et al. · 2009 [cited by applicant]
US 20090177454A1 · Bronstein et al. · 2009 [cited by applicant]
US 20100178644A1 · Meglan et al. · 2010 [cited by applicant]
US 20120016691A1 · Sievenpiper et al. · 2012 [cited by applicant]
US 20120197619A1 · Namer et al. · 2012 [cited by applicant]
US 20140272866A1 · Kim · 2014 [cited by applicant]
US 20150005622A1 · Zhao et al. · 2015 [cited by applicant]
US 20160314710A1 · Jarc et al. · 2016 [cited by applicant]
US 20170148213A1 · Thomas et al. · 2017 [cited by applicant]
US 20170181808A1 · Panescu et al. · 2017 [cited by applicant]
US 20170319283A1 · Suresh et al. · 2017 [cited by applicant]
US 20180060455A1 · Castillo · 2018 [cited by applicant]
US 20180098813A1 · Nesichi · 2018 [cited by examiner]
US 20180247558A1 · Livneh · 2018 [cited by examiner]
US 20180348876A1 · Banerjee et al. · 2018 [cited by applicant]
US 20190000578A1 · Yu · 2019 [cited by examiner]
US 20190059997A1 · Frushour · 2019 [cited by applicant]
US 20190125361A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200844A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201118A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201137A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201140A1 · Yates et al. · 2019 [cited by applicant]
US 20190206564A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206569A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190272917A1 · Couture et al. · 2019 [cited by applicant]
US 20190325574A1 · Jin et al. · 2019 [cited by applicant]
US 20190362651A1 · Barral et al. · 2019 [cited by applicant]
US 20190380792A1 · Poltaretskyi et al. · 2019 [cited by applicant]
US 20200174451A1 · Chanin · 2020 [cited by applicant]
US 20200237452A1 · Wolf et al. · 2020 [cited by applicant]
US 20200242686A1 · García Giraldez et al. · 2020 [cited by applicant]
US 20200275976A1 · Mckinnon et al. · 2020 [cited by applicant]
US 20200405403A1 · Shelton, IV et al. · 2020 [cited by applicant]
US 20220233119A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370131A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370132A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370133A1 · Scheib et al. · 2022 [cited by applicant]
US 20220370134A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370135A1 · Shelton, IV · 2022 [cited by examiner]
US 20220370136A1 · Scheib et al. · 2022 [cited by applicant]
US 20220370137A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220375570A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220375620A1 · Scheib et al. · 2022 [cited by applicant]
US 20220384022A1 · Matsuura et al. · 2022 [cited by applicant]
US 20230293236A1 · Wright et al. · 2023 [cited by applicant]
CN 110638529A · 2020 [cited by examiner]
DE 102015208804A1 · 2016 [cited by applicant]
EP 2269693A1 · 2011 [cited by examiner]
EP 3367387A1 · 2018 [cited by examiner]
EP 3506290A1 · 2019 [cited by applicant]
EP 3649994A1 · 2020 [cited by examiner]
JP 2021509034A · 2021 [cited by examiner]
KR 101940706B1 · 2019 [cited by applicant]
WO 2011108994A1 · 2011 [cited by applicant]
WO WO2020072255A1 · 2020 [cited by examiner]
WO WO2020163358A1 · 2020 [cited by examiner]
Gallagher, A. et al., “Fundamentals of Surgical Simulation”, Gallagher, et al., “Fundamentals of Surgical Simulation, Principles and Practices Improving Medical Outcome- Zero Tolerance”, DOI 10.1007/978-0-85729-763-1_12… [cited by applicant]
Andersen, Daniel et al., “Augmented Visual Instruction for Surgical Practice and Training”, IEEE Workshop on Virtual and Augmented Realities for Good, Reutlingen, Germany, Mar. 18, 2018, 5 pages. [cited by applicant]
Elhelw, Mohamed A. , “Overview of Surgical Simulation”, Center for Informatics Science, Nile University, Giza, Egypt, May 2020, 26 pages. [cited by applicant]
Reiter, Austin et al., “Surgical Structured Light for 3D Minimally Invasive Surgical Imaging”, IEEE/RSJ International Conference on Intelligent Robot and Systems(IROS 2014), Chicago, IL, Sep. 14-18, 2014, pp. 1282-1287. [cited by applicant]
Wang, Yang et al., “High Resolution Acquisition, Learning, and Transfer of Dynamic 3-D Facial Expressions”, Eurographics, vol. 23, No. 3, 2004, pp. 677-686. [cited by applicant]