IP Library › Granted Patent US 12,633,418
Granted Patent B2
US 12,633,418 · App. 17/332,449 · Granted May 19, 2026

Surgical adverse event simulation system

Inventors: Frederick E Shelton, IV (Hillsboro, OH); Charles J. Scheib (Loveland, OH); Kevin M. Fiebig (Cincinnati, OH)
Assignee: Cilag GmbH International
G16H50/50A61B18/14A61B34/25A61B34/30A61B34/37A61B90/36G06F30/20G06N20/00G06N20/10G09B9/00G09B19/003G09B23/30G16H15/00G16H20/40G16H30/40G16H40/20G16H40/63G16H40/67G16H50/70G16H70/20A61B2018/1253A61B2018/126A61B34/10A61B2034/101A61B2034/102A61B2034/105A61B2034/107A61B2034/252A61B2034/254A61B2034/256A61B2034/258A61B2090/363A61B2090/365A61B2218/002A61B2218/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,633,418
App. No.
17/332,449
Filed
May 27, 2021
Granted
May 19, 2026
Kind
B2
Art Unit
3715
USPC
434/PCA.03
Abstract

Systems, methods, and instrumentalities for simulating a surgical task may be provided. In examples, a request for a simulation of the surgical task may be received. For example, the surgical task may comprise a medical procedure and a medical procedure context. Surgical event data associated with the surgical task may be received, for example, responsive to a database query. For example, the surgical event data may comprise historical data associated with the medical procedure and/or context data associated with the medical procedure context. One or more simulation parameter values may be generated, for example, based on the surgical event data. The simulation may be executed based on the simulation parameter values.

Claims (69)

1 . A device for simulating a surgical task comprising:

a processor configured to:

receive a request for a simulation of an adjustment complication associated with an adverse event of the surgical task;

receive, responsive to a database query, surgical event data associated with the adjustable complication;

generate simulation parameter values based on the surgical event data;

receive user interaction data from a human interface device, wherein the human interface device includes physical equipment that mimics surgical instruments, and wherein the user interaction data is data associated with a user currently performing the simulation of the surgical task using the physical equipment;

execute the simulation based on the simulation parameter values and the user interaction data;

based on the user interaction data, output feedback information associated with the user currently performing the simulation of the adjustable complication;

receive, via a session storage and management module, information associated with a previous run of the simulation of the adjustable complication;

overlay similarities and differences between the information associated with the previous run of the simulation of the adjustable complication and the feedback information associated with the user currently performing the simulation of the adjustable complication; and

based on the similarities and differences between the information associated with the previous run of the simulation of the adjustable complication and the feedback information associated with the user currently performing the simulation of the adjustable complication, provide procedural progress improvement information related to the adverse event of the surgical task to enable recovery.

2 . The device of claim 1 , wherein the surgical event data comprises historical data associated with a medical procedure and context data associated with a medical procedure context.

3 . The device of claim 2 , wherein the processor is further configured to:

filter the surgical event data to filtered surgical event data that matches the medical procedure and the medical procedure context; and

generate simulation parameter values based on the filtered surgical event data.

4 . The device of claim 1 , wherein generating simulation parameter values comprises calculating probabilities of surgical events.

5 . The device of claim 1 , wherein the processor is further configured to:

periodically receive update parameter values based on the user interaction data; and

periodically update the simulation parameter values based on the update parameter values.

6 . The device of claim 1 , wherein the processor is further configured to:

determine surgical event data criteria based on the surgical task;

send the surgical event data criteria to a surgical hub database; and

receive, responsive to a database query, surgical event data that satisfies the surgical event data criteria.

7 . The device of claim 1 , wherein the human interface device includes a manipulation subsystem, and wherein the manipulation subsystem includes:

the physical equipment that mimics the surgical instruments, and

at least one component suitable for collecting manipulation controls from the user to send to the device and for providing the feedback information received from the device to the user.

8 . The device of claim 7 , wherein the physical equipment includes a physical unit that mimics a size, shape, and operation of an actual robotic surgeon's console.

9 . The device of claim 7 , wherein the at least one component suitable for collecting manipulation controls includes one or more sensors that engage with the user to indicate an intent of the user when performing the simulation of the surgical task.

10 . The device of claim 1 , wherein the processor is further configured to:

store the feedback information into a metrics extraction module; and

receive, via the metrics extraction module, statistics related to the simulation.

11 . The device of claim 1 , wherein the adjustable complication is determined based on an aggregation of aspects of similar surgical procedures derived from an artificial intelligence (AI) simulation.

12 . A method for simulating a surgical task, comprising:

receiving a request for a simulation of an adjustment complication associated with an adverse event of the surgical task;

receiving, responsive to a database query, surgical event data associated with the adjustable complication;

generating simulation parameter values based on the surgical event data;

receiving user interaction data from a human interface device, wherein the human interface device includes physical equipment that mimics surgical instruments, and wherein the user interaction data is data associated with a user performing the simulation of the surgical task using the physical equipment;

executing the simulation based on the simulation parameter values and the user interaction data;

based on the user interaction data, outputting feedback information associated with the user currently performing the simulation of the adjustable complication;

receiving, via a session storage and management module, information associated with a previous run of the simulation of the adjustable complication;

overlaying similarities and differences between the information associated with the previous run of the simulation of the adjustable complication and the feedback information associated with the user currently performing the simulation of the adjustable complication; and

based on the similarities and differences between the information associated with the previous run of the simulation of the adjustable complication and the feedback information associated with the user currently performing the simulation of the adjustable complication, providing procedural progress improvement information related to the adverse event of the surgical task to enable recovery.

13 . The method of claim 12 , wherein the surgical event data comprises historical data associated with a medical procedure and context data associated with a medical procedure context.

14 . The method of claim 13 , further comprising:

filtering the surgical event data to filtered surgical event data that matches the medical procedure and the medical procedure context; and

generating simulation parameter values based on the filtered surgical event data.

15 . The method of claim 12 , further comprising:

periodically receiving update parameter values based on the user interaction data; and

periodically updating the simulation parameter values based on the update parameter values.

16 . The method of claim 12 , further comprising:

determining surgical event data criteria based on the surgical task;

sending the surgical event data criteria to a surgical hub database; and

receiving, responsive to a database query, surgical event data that satisfies the surgical event data criteria.

17 . The method of claim 12 , wherein the human interface device includes a manipulation subsystem, and wherein the manipulation subsystem includes:

the physical equipment that mimics the surgical instruments, and

at least one component suitable for collecting manipulation controls from the user to send to the device and for providing the feedback information received from the device to the user.

18 . The method of claim 17 , wherein the physical equipment includes a physical unit that mimics a size, shape, and operation of an actual robotic surgeon's console.

19 . The method of claim 17 , wherein the at least one component suitable for collecting manipulation controls includes one or more sensors that engage with the user to indicate an intent of the user when performing the simulation of the surgical task.

20 . A device for simulating a surgical task, comprising:

a processor configured to:

receive a request for a simulation of an adjustment complication associated with an adverse event of the surgical task, wherein the surgical task comprises a medical procedure and medical procedure context;

receive, responsive to a database query, surgical event data associated with the adjustable complication;

generate simulation parameter values based on the surgical event data;

receive user interaction data from a human interface device, wherein the human interface device includes physical equipment that mimics surgical instruments, and wherein the user interaction data is data associated with a user performing the simulation of the surgical task using the physical equipment;

execute the simulation based on the simulation parameter values and the user interaction data;

based on the user interaction data, output feedback information associated with the user currently performing the simulation of the adjustable complication;

receive, via a session storage and management module, information associated with a previous run of the simulation of the adjustable complication;

overlay similarities and differences between the information associated with the previous run of the simulation of the adjustable complication and the feedback information associated with the user currently performing the simulation of the adjustable complication; and

based on the similarities and differences between the information associated with the previous run of the simulation of the adjustable complication and the feedback information associated with the user currently performing the simulation of the adjustable complication, provide procedural progress improvement information related to the adverse event of the surgical task to enable recovery.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2021
From: SHELTON, FREDERICK E., IV; SCHEIB, CHARLES J.; FIEBIG, KEVIN
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056633/0346 →
Continuity (2)
Provisional Application 63191681 · May 21, 2021
Related Publication 20220370134A1 · Nov 24, 2022
References Cited (91)
US 8311791B1 · Avisar · 2012 [cited by applicant]
US 9104791B2 · Cohen et al. · 2015 [cited by applicant]
US 9734632B2 · Thomas et al. · 2017 [cited by applicant]
US 9747493B2 · Rodriguez et al. · 2017 [cited by applicant]
US 9875339B2 · Namer Yelin et al. · 2018 [cited by applicant]
US 9881520B2 · Ullrich et al. · 2018 [cited by applicant]
US 10172676B2 · Ecabert et al. · 2019 [cited by applicant]
US 20050196737A1 · Mann · 2005 [cited by examiner]
US 20090089092A1 · Johnson · 2009 [cited by examiner]
US 20090112538A1 · Anderson et al. · 2009 [cited by applicant]
US 20090177454A1 · Bronstein et al. · 2009 [cited by applicant]
US 20090202972A1 · Adhami et al. · 2009 [cited by applicant]
US 20100178644A1 · Meglan · 2010 [cited by examiner]
US 20120016691A1 · Sievenpiper et al. · 2012 [cited by applicant]
US 20120197619A1 · Namer et al. · 2012 [cited by applicant]
US 20130060146A1 · Yang et al. · 2013 [cited by applicant]
US 20140272866A1 · Kim · 2014 [cited by examiner]
US 20150005622A1 · Zhao et al. · 2015 [cited by applicant]
US 20150088547A1 · Balram · 2015 [cited by examiner]
US 20160314710A1 · Jarc · 2016 [cited by examiner]
US 20170148213A1 · Thomas et al. · 2017 [cited by applicant]
US 20170181808A1 · Panescu · 2017 [cited by examiner]
US 20170319283A1 · Suresh · 2017 [cited by examiner]
US 20180060455A1 · Castillo · 2018 [cited by examiner]
US 20180098813A1 · Nesichi et al. · 2018 [cited by applicant]
US 20180116724A1 · Gmeiner · 2018 [cited by examiner]
US 20180189966A1 · Kamen et al. · 2018 [cited by applicant]
US 20180247558A1 · Livneh · 2018 [cited by applicant]
US 20180344308A1 · Nawana · 2018 [cited by examiner]
US 20180348876A1 · Banerjee · 2018 [cited by examiner]
US 20190000578A1 · Yu et al. · 2019 [cited by applicant]
US 20190059997A1 · Frushour · 2019 [cited by applicant]
US 20190125361A1 · Shelton, IV · 2019 [cited by examiner]
US 20190200844A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201118A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201137A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201140A1 · Yates et al. · 2019 [cited by applicant]
US 20190206564A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206569A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206576A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190272917A1 · Couture et al. · 2019 [cited by applicant]
US 20190325574A1 · Jin et al. · 2019 [cited by applicant]
US 20190362651A1 · Barral et al. · 2019 [cited by applicant]
US 20190380792A1 · Poltaretskyi et al. · 2019 [cited by applicant]
US 20200118691A1 · Kiljanek · 2020 [cited by applicant]
US 20200174451A1 · Chanin · 2020 [cited by applicant]
US 20200237452A1 · Wolf et al. · 2020 [cited by applicant]
US 20200242686A1 · García Giraldez · 2020 [cited by examiner]
US 20200273581A1 · Wolf et al. · 2020 [cited by applicant]
US 20200275976A1 · Mckinnon et al. · 2020 [cited by applicant]
US 20200279506A1 · Mignan et al. · 2020 [cited by applicant]
US 20200405403A1 · Shelton, IV et al. · 2020 [cited by applicant]
US 20210137634A1 · Lang · 2021 [cited by examiner]
US 20210142497A1 · Pugh et al. · 2021 [cited by applicant]
US 20220233119A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370131A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370132A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370133A1 · Scheib et al. · 2022 [cited by applicant]
US 20220370135A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370136A1 · Scheib et al. · 2022 [cited by applicant]
US 20220370137A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370138A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220375570A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220375620A1 · Scheib et al. · 2022 [cited by applicant]
US 20220384022A1 · Matsuura et al. · 2022 [cited by applicant]
US 20230293236A1 · Wright et al. · 2023 [cited by applicant]
CN 110638529A · 2020 [cited by applicant]
DE 102015208804A1 · 2016 [cited by applicant]
EP 2269693A1 · 2011 [cited by applicant]
EP 3367387A1 · 2018 [cited by applicant]
EP 3506290A1 · 2019 [cited by applicant]
EP 3649994A1 · 2020 [cited by applicant]
JP 2021509034A · 2021 [cited by applicant]
KR 101940706B1 · 2019 [cited by applicant]
WO 2011108994A1 · 2011 [cited by applicant]
WO 2017027638A1 · 2017 [cited by applicant]
WO 2020072255A1 · 2020 [cited by applicant]
WO 2020163358A1 · 2020 [cited by applicant]
Gallagher, A. et al., “Fundamentals of Surgical Simulation”, Gallagher, et al., “Fundamentals of Surgical Simulation, Principles and Practices Improving Medical Outcome—Zero Tolerance”, DOI 10.1007/978-0-85729-763-1_12,… [cited by applicant]
Andersen, Daniel et al., “Augmented Visual Instruction for Surgical Practice and Training”, IEEE Workshop on Virtual and Augmented Realities for Good; Reutlingen, Germany, Mar. 18, 2018, 5 pages. [cited by applicant]
Elhelw, Mohamed A. , “Overview of Surgical Simulation”, Center for Informatics Science, Nile University, Giza, Egypt, May 2020, 26 pages. [cited by applicant]
Reiter, Austin et al., “Surgical Structured Light for 3D Minimally Invasive Surgical Imaging”, IEEE/RSJ International Conference on Intelligent Robot and Systems(IROS 2014), Chicago, IL, Sep. 14-18, 2014, pp. 1282-1287. [cited by applicant]
Wang, Yang et al., “High Resolution Acquisition, Learning, and Transfer of Dynamic 3-D Facial Expressions”, Eurographics, vol. 23, No. 3, 2004, pp. 677-686. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/IB2022/054724, Mailed on Jul. 5, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/IB2022/054738, Mailed on Jul. 14, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/IB2022/054739, Mailed on Jul. 18, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/IB2022/054725, Mailed on Jul. 8, 2022, 11 pages. [cited by applicant]
Bell, Ron, “Introduction to IEC 61508(1)”, Measurement + Control vol. 42/6, Jul. 2009, pp. 174-179. [cited by applicant]
Ben-Hamadou et al., “Construction of Extended 3D Field of Views of the Internal Bladder Wall Surface: A Proof of Concept”, 3D Research, 3D Display Research Center, Seoul, vol. 7, No. 19, 2016, pp. 1-19. [cited by applicant]
Bernhardt et al., “The Status of Augmented Reality in Laparoscopic Surgery as of 2016”, Medical Image Analysis, vol. 37, 2017, pp. 66-90. [cited by applicant]
ISO 26262-1, “Road Vehicles—Functional Safety—Part 1: Vocabulary”, International Organization for Standardization, Edition 2, Dec. 2018, 13 pages. [cited by applicant]