IP Library › Granted Patent US 12,567,506
Granted Patent B2
US 12,567,506 · App. 17/332,197 · Granted Mar 3, 2026

Simulation-based surgical procedure planning system

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Charles J. Scheib (Loveland, OH); Dwight Alan Meglan (Westwood, MA); Kevin M. Fiebig (Cincinnati, OH)
Assignee: Cilag GmbH International
G16H50/50A61B18/14A61B34/25A61B34/30A61B34/37A61B90/36G06F30/20G06N20/00G06N20/10G09B9/00G09B19/003G09B23/30G16H15/00G16H20/40G16H30/40G16H40/20G16H40/63G16H40/67G16H50/70G16H70/20A61B2018/1253A61B2018/126A61B34/10A61B2034/101A61B2034/102A61B2034/105A61B2034/107A61B2034/252A61B2034/254A61B2034/256A61B2034/258A61B2090/363A61B2090/365A61B2218/002A61B2218/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,567,506
App. No.
17/332,197
Granted
Mar 3, 2026
Kind
B2
Abstract

A computing device for generating a surgical procedure plan via surgical simulation may include a processor. The processor may be configured to obtain an indication of a surgical task. The surgical task may be associated with a surgical step of the surgical procedure plan. The processor may be configured to obtain a surgical choice and a corresponding predicted surgical outcome. The surgical choice and the corresponding predicted surgical outcome may be associated with the surgical task. The processor may be configured to generate a visualization of the surgical choice and the corresponding predicted surgical outcome in a simulated environment. The processor may be configured to obtain an indication of the surgical choice being selected. The processor may be configured to store the surgical choice in the surgical procedure plan.

Claims (40)

1 . A computing device for generating a surgical procedure plan via surgical simulation, the computing device comprising:

a processor configured to:

obtain an indication of a surgical task, wherein the surgical task is associated with a surgical step of the surgical procedure plan;

obtain a surgical choice, wherein the surgical choice is associated with the surgical task;

determine a surgeon-based tool-tissue simulation that avoids a surgical error, wherein the surgeon-based tool-tissue simulation is based on the surgical choice, a surgical experience level, and a surgical workload;

determine an infection exposure simulation for a room layout;

determine a predicted surgical outcome based on the surgeon-based tool-tissue simulation, the infection exposure simulation, and a surgical setup data, wherein the surgical setup data comprises the room layout, a staff layout, and a patient position, wherein the patient position minimizes injury to a patient, and wherein the staff layout indicates at least a location of a staff member;

generate a visualization of the surgical choice and the predicted surgical outcome using a simulated environment;

obtain an indication confirming the surgical choice as being selected; and

store the surgical choice in the surgical procedure plan.

2 . The computing device of claim 1 , wherein the indication of the surgical task is obtained from a surgical procedure planning user interface.

3 . The computing device of claim 1 , wherein the indication of the surgical task comprises identifying information of the surgical procedure plan, identifying information of the surgical task, and identifying information of the surgical step.

4 . The computing device of claim 1 , wherein the surgical task comprises a task that contributes to a completion of the surgical step of the surgical procedure plan.

5 . The computing device of claim 1 , wherein the processor is further configured to train a machine learning (ML) model using data from at least a surgical procedure.

6 . The computing device of claim 1 , wherein the surgical choice is a first surgical choice, wherein the predicted surgical outcome is a first corresponding predicted surgical outcome, wherein the visualization is a first visualization, and wherein the processor is further configured to:

obtain a second surgical choice, wherein the second surgical choice is associated with the surgical task;

determine a second predicted surgical outcome based on the second surgical choice and the surgical setup data; and

generate a second visualization of the second surgical choice and the second predicted surgical outcome in the simulated environment.

7 . The computing device of claim 1 , wherein the processor is further configured to determine a machine learning (ML) model, wherein the ML model is associated with data from at least a surgical procedure.

8 . The computing device of claim 7 , wherein the processor being configured to determine the predicted surgical outcome further comprises the processor being configured to determine the predicted surgical outcome based on the surgeon-based tool-tissue simulation, the infection exposure simulation, the surgical setup data, and the ML model.

9 . A computer-implemented method for generating a surgical procedure plan via surgical simulation, the method comprising:

obtaining an indication of a surgical task, wherein the surgical task is associated with a surgical step of the surgical procedure plan;

obtaining a surgical choice, wherein the surgical choice is associated with the surgical task;

determining a surgeon-based tool-tissue simulation that avoids a surgical error, wherein the surgeon-based tool-tissue simulation is based on the surgical choice, a surgical experience level, and a surgical workload;

determining an infection exposure simulation for a room layout;

determining a predicted surgical outcome based on the surgeon-based tool-tissue simulation, the infection exposure simulation, and a surgical setup data, wherein the surgical setup data comprises the room layout, a staff layout, and a patient position, wherein the patient position minimizes injury to a patient, and wherein the staff layout indicates at least a location of a staff member;

generating a visualization of the surgical choice and the predicted surgical outcome using a simulated environment;

obtaining an indication confirming the surgical choice as being selected; and

storing the surgical choice in the surgical procedure plan.

10 . The computer-implemented method of claim 9 , wherein the indication of the surgical task is obtained from a surgical procedure planning user interface.

11 . The computer-implemented method of claim 9 , wherein the indication of the surgical task comprises identifying information of the surgical procedure plan, identifying information of the surgical task, and identifying information of the surgical step.

12 . The computer-implemented method of claim 9 , wherein the surgical task comprises a task that contributes to a completion of the surgical step of the surgical procedure plan.

13 . The computer-implemented method of claim 9 , further comprising:

training a machine learning (ML) model using data from at least a surgical procedure.

14 . The computer-implemented method of claim 9 , wherein the surgical choice is a first surgical choice, wherein the predicted surgical outcome is a first corresponding predicted surgical outcome, wherein the visualization is a first visualization, and wherein the method further comprises:

obtaining a second surgical choice, wherein the second surgical choice is associated with the surgical task;

determining a second predicted surgical outcome based on the second surgical choice and the surgical setup data; and

generating a second visualization of the second surgical choice and the second predicted surgical outcome in the simulated environment.

15 . The computer-implemented method of claim 9 , wherein the method further comprises determining a machine learning (ML) model, wherein the ML model is associated with data from at least a surgical procedure.

16 . The computer-implemented method of claim 15 , wherein determining the predicted surgical outcome further comprises determining the predicted surgical outcome based on the surgeon-based tool-tissue simulation, the infection exposure simulation, the surgical setup data, and the ML model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2021
From: SHELTON, FREDERICK E., IV; SCHEIB, CHARLES J.; MEGLAN, DWIGHT ALAN; FIEBIG, KEVIN
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056622/0035 →
Continuity (2)
Provisional Application 63191681 · May 21, 2021
Related Publication 20220370131A1 · Nov 24, 2022
References Cited (88)
US 8311791B1 · Avisar · 2012 [cited by applicant]
US 9104791B2 · Cohen et al. · 2015 [cited by applicant]
US 9734632B2 · Thomas · 2017 [cited by examiner]
US 9747493B2 · Rodriguez et al. · 2017 [cited by applicant]
US 9875339B2 · Namer Yelin et al. · 2018 [cited by applicant]
US 9881520B2 · Ullrich et al. · 2018 [cited by applicant]
US 10172676B2 · Ecabert et al. · 2019 [cited by applicant]
US 20050196737A1 · Mann · 2005 [cited by applicant]
US 20080235052A1 · Node-Ianglois et al. · 2008 [cited by applicant]
US 20090089092A1 · Johnson et al. · 2009 [cited by applicant]
US 20090112538A1 · Anderson · 2009 [cited by examiner]
US 20090177454A1 · Bronstein et al. · 2009 [cited by applicant]
US 20090202972A1 · Adhami et al. · 2009 [cited by applicant]
US 20100178644A1 · Meglan et al. · 2010 [cited by applicant]
US 20120016691A1 · Sievenpiper et al. · 2012 [cited by applicant]
US 20120197619A1 · Namer et al. · 2012 [cited by applicant]
US 20140272866A1 · Kim · 2014 [cited by applicant]
US 20150005622A1 · Zhao et al. · 2015 [cited by applicant]
US 20150088547A1 · Balram et al. · 2015 [cited by applicant]
US 20160314710A1 · Jarc et al. · 2016 [cited by applicant]
US 20170148213A1 · Thomas · 2017 [cited by examiner]
US 20170181808A1 · Panescu et al. · 2017 [cited by applicant]
US 20170319283A1 · Suresh et al. · 2017 [cited by applicant]
US 20180060455A1 · Castillo · 2018 [cited by applicant]
US 20180098813A1 · Nesichi et al. · 2018 [cited by applicant]
US 20180116724A1 · Gmeiner et al. · 2018 [cited by applicant]
US 20180247558A1 · Livneh · 2018 [cited by applicant]
US 20180344308A1 · Nawana et al. · 2018 [cited by applicant]
US 20180348876A1 · Banerjee et al. · 2018 [cited by applicant]
US 20190000578A1 · Yu · 2019 [cited by examiner]
US 20190059997A1 · Frushour · 2019 [cited by applicant]
US 20190125361A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200844A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201118A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201137A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201140A1 · Yates et al. · 2019 [cited by applicant]
US 20190206564A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206569A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206576A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190272917A1 · Couture et al. · 2019 [cited by applicant]
US 20190325574A1 · Jin et al. · 2019 [cited by applicant]
US 20190362651A1 · Barral et al. · 2019 [cited by applicant]
US 20190380792A1 · Poltaretskyi et al. · 2019 [cited by applicant]
US 20200118691A1 · Kiljanek · 2020 [cited by applicant]
US 20200174451A1 · Chanin · 2020 [cited by applicant]
US 20200237452A1 · Wolf et al. · 2020 [cited by applicant]
US 20200242686A1 · García Giraldez et al. · 2020 [cited by applicant]
US 20200273581A1 · Wolf · 2020 [cited by examiner]
US 20200275976A1 · Mckinnon et al. · 2020 [cited by applicant]
US 20200405403A1 · Shelton, IV et al. · 2020 [cited by applicant]
US 20210137634A1 · Lang · 2021 [cited by applicant]
US 20210142497A1 · Pugh et al. · 2021 [cited by applicant]
US 20220233119A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370132A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370133A1 · Scheib et al. · 2022 [cited by applicant]
US 20220370134A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370135A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370136A1 · Scheib et al. · 2022 [cited by applicant]
US 20220370137A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370138A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220375570A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220375620A1 · Scheib et al. · 2022 [cited by applicant]
US 20220384022A1 · Matsuura et al. · 2022 [cited by applicant]
US 20230293236A1 · Wright et al. · 2023 [cited by applicant]
CN 110638529A · 2020 [cited by applicant]
DE 102015208804A1 · 2016 [cited by applicant]
EP 2269693A1 · 2011 [cited by applicant]
EP 3367387A1 · 2018 [cited by applicant]
EP 3506290A1 · 2019 [cited by applicant]
EP 3649994A1 · 2020 [cited by applicant]
JP 2021509034A · 2021 [cited by applicant]
KR 101940706B1 · 2019 [cited by applicant]
WO 2011108994A1 · 2011 [cited by applicant]
WO 2017027638A1 · 2017 [cited by applicant]
WO 2020072255A1 · 2020 [cited by applicant]
WO 2020163358A1 · 2020 [cited by applicant]
Gallagher, A. et al., “Fundamentals of Surgical Simulation”, Gallagher, et al., “Fundamentals of Surgical Simulation, Principles and Practices Improving Medical Outcome-Zero Tolerance”, DOI 10.1007/978-0-85729-763-1_12,… [cited by applicant]
Andersen et al., “Augmented Visual Instruction for Surgical Practice and Training”, IEEE Workshop on Virtual and Augmented Realities for Good; Reutlingen, Germany, Mar. 18, 2018, 5 pages. [cited by applicant]
Elhelw, Mohamed A., “Overview of Surgical Simulation”, Center for Informatics Science, Nile University, Giza, Egypt, May 2020, 26 pages. [cited by applicant]
Reiter et al., “Surgical Structured Light for 3D Minimally Invasive Surgical Imaging”, IEEE/RSJ International Conference on Intelligent Robot and Systems(IROS 2014), Chicago, IL, Sep. 14-18, 2014, pp. 1282-1287. [cited by applicant]
Wang et al., “High Resolution Acquisition, Learning, and Transfer of Dynamic 3-D Facial Expressions”, Eurographics, vol. 23, No. 3, 2004, pp. 677-686. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/IB2022/054724, Mailed on Jul. 5, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/IB2022/054738, Mailed on Jul. 14, 2022, 14 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/IB2022/054739, Mailed on Jul. 18, 2022, 13 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/IB2022/054725, Mailed on Jul. 8, 2022, 11 pages. [cited by applicant]
Ben-Hamadou et al., “Construction of Extended 3D Field of Views of the Internal Bladder Wall Surface: A Proof of Concept”, 3D Research, 3D Display Research Center, Seoul, vol. 7, No. 19, Jul. 16, 2016, pp. 1-19. [cited by applicant]
Bernhardt et al., “The Status of Augmented Reality in Laparoscopic Surgery as of 2016”, Medical Image Analysis, vol. 37, Apr. 1, 2017, pp. 66-90. [cited by applicant]
ISO 26262-1, “Road Vehicles—Functional Safety—Part 1: Vocabulary”, International Organization for Standardization, Edition 2, Dec. 2018, 13 pages. [cited by applicant]