IP Library › Granted Patent US 12,340,909
Granted Patent B2
US 12,340,909 · App. 17/332,496 · Granted Jun 24, 2025

Simulation-based surgical analysis system

Inventors: Charles J. Scheib (Loveland, OH); Frederick E. Shelton, IV (Hillsboro, OH); Kevin M. Fiebig (Cincinnati, OH)
Assignee: Cilag GmbH International
G16H50/50A61B18/14A61B34/25A61B34/30A61B34/37A61B90/36G06F30/20G06N20/00G06N20/10G09B9/00G09B19/003G09B23/30G16H15/00G16H20/40G16H30/40G16H40/20G16H40/63G16H40/67G16H50/70G16H70/20A61B2018/1253A61B2018/126A61B34/10A61B2034/101A61B2034/102A61B2034/105A61B2034/107A61B2034/252A61B2034/254A61B2034/256A61B2034/258A61B2090/363A61B2090/365A61B2218/002A61B2218/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,340,909
App. No.
17/332,496
Filed
May 27, 2021
Granted
Jun 24, 2025
Kind
B2
Art Unit
2187
USPC
703/6
Abstract

A computing device may be configured to obtain first data associated with a first simulated surgical procedure and second data associated with a second simulated surgical procedure. The first data and the second data may be associated with a surgical task of the surgical procedure. The computing device may be configured to generate aggregation data from the first data and the second data. The computing device may be configured to determine from the aggregation data a first causal relation between a first surgical choice of the first data and a surgical aspect of the first data and a second causal relation between a second surgical choice of the first data and a corresponding surgical aspect of the second data. The computing device may be configured to display the first causal relation with the first data and the second causal relation with the second data.

Claims (36)

1. A computing device for performing surgical analysis via surgical simulation, the computing device comprising:

a processor configured to:

obtain first data associated with a first simulated surgical procedure and second data associated with a second simulated surgical procedure, wherein the first simulated surgical procedure and the second simulated surgical procedure simulate a surgical procedure, wherein the first simulated surgical procedure is a user-simulated procedure and the second simulated surgical procedure is a computer-simulated procedure, and wherein the first data and the second data are associated with a surgical task of the surgical procedure;

generate aggregation data from the first data and the second data based on a surgical aspect of the first data and a corresponding surgical aspect of the second data, wherein to generate the aggregation data comprises the processor being configured to at least contrast the first data and the second data based on a first reaction associated with the first simulated surgical procedure and a second reaction associated with the second simulated surgical procedure, a first complication associated with the first simulated surgical procedure and a second complication associated with the second simulated surgical procedure, and a first outcome associated with the first simulated surgical procedure and a second outcome associated with the second simulated surgical procedure, compile the first data and the second data based on the first reaction associated with the first simulated surgical procedure and the second reaction associated with the second simulated surgical procedure, the first complication associated with the first simulated surgical procedure and the second complication associated with the second simulated surgical procedure, and the first outcome associated with the first simulated surgical procedure and the second outcome associated with the second simulated surgical procedure, or aggregate the first data and the second data based on the first reaction associated with the first simulated surgical procedure and the second reaction associated with the second simulated surgical procedure, the first complication associated with the first simulated surgical procedure and the second complication associated with the second simulated surgical procedure, and the first outcome associated with the first simulated surgical procedure and the second outcome associated with the second simulated surgical procedure;

determine, from the aggregation data, a first causal relation between a first surgical choice of the first data and the surgical aspect of the first data and a second causal relation between a second surgical choice of the first data and the corresponding surgical aspect of the second data, wherein the first causal relation comprises a first relationship between the first surgical choice associated with the user-simulated procedure and a first surgical outcome that is associated with the first surgical choice, and wherein the second causal relation comprises a second relationship between the second surgical choice associated with the computer-simulated procedure and a second surgical outcome that is associated with the second surgical choice; and

display the first data and the second data, wherein the first causal relation is displayed with the first data and the second causal relation is displayed with the second data.

2. The computing device for performing surgical analysis via surgical simulation of claim 1 , wherein the first simulated surgical procedure and the second simulated surgical procedure are configured with a same simulation configuration or a same set of simulation configurations.

3. The computing device for performing surgical analysis via surgical simulation of claim 1 , wherein the surgical aspect is associated with at least one of a time duration of the surgical task, a surgical instrument usage, a surgical outcome, or a surgical complication.

4. The computing device for performing surgical analysis via surgical simulation of claim 1 , wherein the first surgical choice of the first data is a selection from a plurality of surgical choices at a surgical choice selection point, wherein the second surgical choice of the second data is a selection from the plurality of surgical choices of the surgical choice selection point, wherein the surgical choice selection point is a part of the surgical task, wherein the surgical aspect of the first data comprises a surgical complication, and wherein the corresponding surgical aspect of the second data does not comprise the surgical complication.

5. The computing device for performing surgical analysis via surgical simulation of claim 1 , wherein the surgical aspect of the first data comprises a first numeric value, wherein the corresponding surgical aspect of the second data comprises a second numeric value, and wherein the processor is further configured to display the aggregation data.

6. The computing device for performing surgical analysis via surgical simulation of claim 1 , the processor is further configured to:

receive a request to replay a simulation of the first surgical choice of the first data and the surgical aspect of the first data, wherein the surgical aspect of the first data comprises a surgical outcome or a surgical complication; and

generate a visualization of the simulation of the first surgical choice of the first data and the surgical aspect of the first data.

7. The computing device for performing surgical analysis via surgical simulation of claim 4 , and wherein the processor is further configured to:

receive a request to simulate the plurality of surgical choices of the surgical choice selection point in the first simulated surgical procedure; and

generate a visualization of the plurality of surgical choices of the surgical choice selection point in the first simulated surgical procedure.

8. A computer-implemented method for performing surgical analysis via surgical simulation, the method comprising:

obtaining first data associated with a first simulated surgical procedure and second data associated with a second simulated surgical procedure, wherein the first simulated surgical procedure and the second simulated surgical procedure simulate a surgical procedure, wherein the first simulated surgical procedure is a user-simulated procedure and the second simulated surgical procedure is a computer-simulated procedure, and wherein the first data and the second data are associated with a surgical task of the surgical procedure;

generating aggregation data from the first data and the second data based on a surgical aspect of the first data and a corresponding surgical aspect of the second data, wherein generating the aggregation data comprises performing at least one of contrasting the first data and the second data based on a first reaction associated with the first simulated surgical procedure and a second reaction associated with the second simulated surgical procedure, a first complication associated with the first simulated surgical procedure and a second complication associated with the second simulated surgical procedure, and a first outcome associated with the first simulated surgical procedure and a second outcome associated with the second simulated surgical procedure, compiling the first data and the second data based on the first reaction associated with the first simulated surgical procedure and the second reaction associated with the second simulated surgical procedure, the first complication associated with the first simulated surgical procedure and the second complication associated with the second simulated surgical procedure, and the first outcome associated with the first simulated surgical procedure and the second outcome associated with the second simulated surgical procedure, or aggregating the first data and the second data based on the first reaction associated with the first simulated surgical procedure and the second reaction associated with the second simulated surgical procedure, the first complication associated with the first simulated surgical procedure and the second complication associated with the second simulated surgical procedure, and the first outcome associated with the first simulated surgical procedure and the second outcome associated with the second simulated surgical procedure;

determining, from the aggregation data, a first causal relation between a first surgical choice of the first data and the surgical aspect of the first data and a second causal relation between a second surgical choice of the first data and the corresponding surgical aspect of the second data, wherein the first causal relation comprises a first relationship between the first surgical choice associated with the user-simulated procedure and a first surgical outcome that is associated with the first surgical choice, and wherein the second causal relation comprises a second relationship between the second surgical choice associated with the computer-simulated procedure and a second surgical outcome that is associated with the second surgical choice; and

displaying the first data and the second data, wherein the first causal relation is displayed with the first data and the second causal relation is displayed with the second data.

9. The computer-implemented method for performing surgical analysis via surgical simulation of claim 8 , wherein the first simulated surgical procedure and the second simulated surgical procedure are configured with a same simulation configuration or a same set of simulation configurations.

10. The computer-implemented method for performing surgical analysis via surgical simulation of claim 8 , wherein the surgical aspect is associated with at least one of a time duration of the surgical task, a surgical instrument usage, a surgical outcome, or a surgical complication.

11. The computer-implemented method for performing surgical analysis via surgical simulation of claim 8 , wherein the first surgical choice of the first data is a selection from a plurality of surgical choices at a surgical choice selection point, wherein the second surgical choice of the second data is a selection from the plurality of surgical choices of the surgical choice selection point, wherein the surgical choice selection point is a part of the surgical task, wherein the surgical aspect of the first data comprises a surgical complication, and wherein the corresponding surgical aspect of the second data does not comprise the surgical complication.

12. The computer-implemented method for performing surgical analysis via surgical simulation of claim 8 , wherein the surgical aspect of the first data comprises a first numeric value, wherein the corresponding surgical aspect of the second data comprises a second numeric value, and wherein the method further comprises displaying the aggregation data.

13. The computer-implemented method for performing surgical analysis via surgical simulation of claim 8 , further comprising:

receiving a request to replay a simulation of the first surgical choice of the first data and the surgical aspect of the first data, wherein the surgical aspect of the first data comprises a surgical outcome or a surgical complication; and generating a visualization of the simulation of the first surgical choice of the first data and the surgical aspect of the first data.

14. The computer-implemented method for performing surgical analysis via surgical simulation of claim 11 , further comprising:

receiving a request to simulate the plurality of surgical choices of the surgical choice selection point in the first simulated surgical procedure; and

generating a visualization of the plurality of surgical choices of the surgical choice selection point in the first simulated surgical procedure.

15. The computing device for performing surgical analysis via surgical simulation of claim 7 , wherein the visualization of the plurality of surgical choices comprises at least one of a surgical reaction, a surgical outcome, or a surgical complication associated with the plurality of surgical choices, and wherein the processor is configured to:

display the generated visualization of the plurality of surgical choices.

16. The computer-implemented method for performing surgical analysis via surgical simulation of claim 14 , wherein the visualization of the plurality of surgical choices comprises at least one of a surgical reaction, a surgical outcome, or a surgical complication associated with the plurality of surgical choices, and wherein the method comprises:

displaying the generated visualization of the plurality of surgical choices.

17. The computing device for performing surgical analysis via surgical simulation of claim 1 , wherein the first surgical outcome and the second surgical outcome comprise at least one of no surgical complications, a minimum complication, a moderate complication, or a severe complication.

18. The computer-implemented method for performing surgical analysis via surgical simulation of claim 8 , wherein the first surgical outcome and the second surgical outcome comprise at least one of no surgical complications, a minimum complication, a moderate complication, or a severe complication.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2021
From: SHELTON, FREDERICK E., IV; SCHEIB, CHARLES J.; FIEBIG, KEVIN
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056633/0533 →
Continuity (2)
Provisional Application 63191681 · May 21, 2021
Related Publication 20220370136A1 · Nov 24, 2022
References Cited (76)
US 8311791B1 · Avisar · 2012 [cited by applicant]
US 9104791B2 · Cohen et al. · 2015 [cited by applicant]
US 9734632B2 · Thomas et al. · 2017 [cited by applicant]
US 9881520B2 · Ullrich et al. · 2018 [cited by applicant]
US 10172676B2 · Ecabert et al. · 2019 [cited by applicant]
US 20080235052A1 · Node-langlois et al. · 2008 [cited by applicant]
US 20090089092A1 · Johnson et al. · 2009 [cited by applicant]
US 20090177454A1 · Bronstein et al. · 2009 [cited by applicant]
US 20100178644A1 · Meglan et al. · 2010 [cited by applicant]
US 20120016691A1 · Sievenpiper et al. · 2012 [cited by applicant]
US 20120197619A1 · Namer et al. · 2012 [cited by applicant]
US 20140272866A1 · Kim · 2014 [cited by applicant]
US 20150005622A1 · Zhao et al. · 2015 [cited by applicant]
US 20160314710A1 · Jarc et al. · 2016 [cited by applicant]
US 20170148213A1 · Thomas et al. · 2017 [cited by applicant]
US 20170181808A1 · Panescu et al. · 2017 [cited by applicant]
US 20170319283A1 · Suresh et al. · 2017 [cited by applicant]
US 20180060455A1 · Castillo · 2018 [cited by applicant]
US 20180098813A1 · Nesichi et al. · 2018 [cited by applicant]
US 20180247558A1 · Livneh · 2018 [cited by applicant]
US 20180348876A1 · Banerjee et al. · 2018 [cited by applicant]
US 20190000578A1 · Yu et al. · 2019 [cited by applicant]
US 20190059997A1 · Frushour · 2019 [cited by applicant]
US 20190125361A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200844A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201118A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201137A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201140A1 · Yates et al. · 2019 [cited by applicant]
US 20190206564A1 · Shelton, IV · 2019 [cited by examiner]
US 20190206569A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190272917A1 · Couture et al. · 2019 [cited by applicant]
US 20190325574A1 · Jin et al. · 2019 [cited by applicant]
US 20190362651A1 · Barral et al. · 2019 [cited by applicant]
US 20190380792A1 · Poltaretskyi et al. · 2019 [cited by applicant]
US 20200174451A1 · Chanin · 2020 [cited by applicant]
US 20200237452A1 · Wolf et al. · 2020 [cited by applicant]
US 20200242686A1 · García Giraldez et al. · 2020 [cited by applicant]
US 20200275976A1 · Mckinnon et al. · 2020 [cited by applicant]
US 20200405403A1 · Shelton, IV et al. · 2020 [cited by applicant]
US 20220233119A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370131A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370132A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370133A1 · Scheib et al. · 2022 [cited by applicant]
US 20220370134A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370135A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370137A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220370138A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220375570A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220375620A1 · Scheib et al. · 2022 [cited by applicant]
US 20220384022A1 · Matsuura et al. · 2022 [cited by applicant]
US 20230293236A1 · Wright et al. · 2023 [cited by applicant]
CN 110638529A · 2020 [cited by applicant]
DE 102015208804A1 · 2016 [cited by applicant]
EP 2269693A1 · 2011 [cited by applicant]
EP 3367387A1 · 2018 [cited by applicant]
EP 3506290A1 · 2019 [cited by applicant]
EP 3649994A1 · 2020 [cited by applicant]
JP 2021509034A · 2021 [cited by applicant]
KR 101940706B1 · 2019 [cited by applicant]
WO WO2011108994A1 · 2011 [cited by examiner]
WO 2020072255A1 · 2020 [cited by applicant]
WO 2020163358A1 · 2020 [cited by applicant]
“U.S. Appl. No. 17/332,197 filed May 27, 2021”. [cited by applicant]
“U.S. Appl. No. 17/332,399, filed May 27, 2021”. [cited by applicant]
“U.S. Appl. No. 17/332,407, filed May 27, 2021”. [cited by applicant]
“U.S. Appl. No. 17/332,441, filed May 27, 2021”. [cited by applicant]
“U.S. Appl. No. 17/332,462, filed May 27, 2021”. [cited by applicant]
“U.S. Appl. No. 17/332,480, filed May 27, 2021”. [cited by applicant]
“U.S. Appl. No. 17/332,449, filed May 27, 2021”. [cited by applicant]
“U.S. Appl. No. 17/332,524, filed May 27, 2021”. [cited by applicant]
“U.S. Appl. No. 17/332,594, filed May 27, 2021”. [cited by applicant]
Gallagher, A. et al., “Fundamentals of Surgical Simulation”, Gallagher, et al., “Fundamentals of Surgical Simulation, Principles and Practices Improving Medical Outcome—Zero Tolerance”, DOI 10.1007/978-0-85729-763-1_12,… [cited by applicant]
Andersen, Daniel et al., “Augmented Visual Instruction for Surgical Practice and Training”, IEEE Workshop on Virtual and Augmented Realities for Good; Reutlingen, Germany, Mar. 18, 2018, 5 pages. [cited by applicant]
Elhelw, Mohamed A. , “Overview of Surgical Simulation”, Center for Informatics Science, Nile University, Giza, Egypt, May 2020, 26 pages. [cited by applicant]
Reiter, Austin et al., “Surgical Structured Light for 3D Minimally Invasive Surgical Imaging”, IEEE/RSJ International Conference on Intelligent Robot and Systems(IROS 2014), Chicago, IL, Sep. 14-18, 2014, pp. 1282-1287. [cited by applicant]
Wang, Yang et al., “High Resolution Acquisition, Learning, and Transfer of Dynamic 3-D Facial Expressions”, Eurographics, vol. 23, No. 3, 2004, pp. 677-686. [cited by applicant]