IP Library Granted Patent US 12,573,495
Granted Patent B2
US 12,573,495 · App. 18/092,023 · Granted Mar 10, 2026

Surgical computing system with support for interrelated machine learning models

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Jason L. Harris (Lebanon, OH)
Assignee: Cilag GmbH International
G16H20/40G06F21/6245G16H50/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,573,495
App. No.
18/092,023
Granted
Mar 10, 2026
Kind
B2
Abstract

Systems, methods, and instrumentalities are disclosed for a surgical computing system with support for machine learning model interaction. Data exchange behavior between machine learning (ML) models and data storages may be determined and implemented. For example, data exchange may be determined based on privacy implications associated with a ML model and/or data storage. Data exchange may be determined based on processing goals associated with ML models.

Claims (68)

1 . A surgical computing system comprising:

a processor configured to:

receive surgical data comprising a plurality of subsets of surgical data;

determine a first classification for a first subset of the plurality of subsets of surgical data, wherein the first classification is associated with a first privacy level;

determine a second classification for a second subset of the plurality of subsets of surgical data, wherein the second classification is associated with a second privacy level;

determine a first processing goal and a second processing goal, wherein the first processing goal is associated with a first processing task and a first data need, and wherein the second processing goal is associated with a second processing task and a second data need;

determine a first classification threshold associated with the first processing task and a second classification threshold associated with the second processing task;

determine a first data package based on the first processing goal, the first data need, and the first classification threshold, wherein the first data package comprises at least a first portion of the surgical data, and wherein a first machine learning (ML) model is associated with processing the first data package;

determine a second data package based on the second processing goal, the second data need, and the second classification threshold, wherein the second data package comprises at least a second portion of the surgical data, wherein the second portion of the surgical data comprises the first portion of the surgical data, and wherein a second ML model is associated with processing the second data package;

determine whether the first classification for the first subset is below the first classification threshold;

based on the first classification for the first subset being below the first classification threshold, transmit the first subset as part of the first data package to a first processing system included in a facility network configured to execute the first ML model;

determine whether the second classification for the second subset is below the second classification threshold; and

based on the second classification for the second subset being below the second classification threshold, transmit the second subset as part of the second data package to a second processing system that is included in a cloud network outside the facility network and is configured to execute the second ML model.

2 . The surgical computing system of claim 1 , wherein the processor is further configured to:

transmit the first data package to the first ML model; and

transmit the second data package to the second ML model.

3 . The surgical computing system of claim 1 , wherein the first classification threshold is associated with the first privacy level, wherein the second classification threshold is associated with the second privacy level, and wherein the second privacy level is associated with more privacy than the first privacy level.

4 . The surgical computing system of claim 1 , wherein the first classification threshold is a first privacy classification threshold associated with a first location associated with the first processing task, and wherein the second classification threshold is a second privacy classification threshold associated with a second location associated with the second processing task.

5 . The surgical computing system of claim 1 , wherein the first processing task is performed using the first ML model, and wherein the second processing task is performed using the second ML model.

6 . The surgical computing system of claim 1 , wherein the first classification threshold is determined based on the first processing goal, and wherein the second classification threshold is determined based on the second processing goal.

7 . The surgical computing system of claim 6 , wherein the processor is configured to:

determine that the first processing goal has changed;

based on the determination that the first processing goal has changed, determine an updated first processing goal;

determine an updated first classification threshold based on the updated first processing goal;

determine a third data package based on the updated first processing goal and the updated first classification threshold;

determine an updated second processing goal based on the determination that the first processing goal has changed;

determine an updated second classification threshold based on the updated second processing goal; and

determine a fourth data package based on the updated second processing goal and the updated second classification threshold.

8 . A method, the method comprising:

receiving surgical data comprising a plurality of subsets of surgical data;

determining a first classification for a first subset of the plurality of subsets of surgical data, wherein the first classification is associated with a first privacy level;

determining a second classification for a second subset of the plurality of subsets of surgical data, wherein the second classification is associated with a second privacy level;

determining a first processing goal and a second processing goal, wherein the first processing goal is associated with a first processing task and a first data need, and wherein the second processing goal is associated with a second processing task and a second data need;

determining a first classification threshold associated with the first processing task and a second classification threshold associated with the second processing task;

determining a first data package based on the first processing goal, the first data need, and the first classification threshold, wherein the first data package comprises at least a first portion of the surgical data, and wherein a first machine learning (ML) model is associated with processing the first data package;

determining a second data package based on the second processing goal, the second data need, and the second classification threshold, wherein the second data package comprises at least a second portion of the surgical data, wherein the second portion of the surgical data comprises the first portion of the surgical data, and wherein a second ML model is associated with processing the second data package;

determining whether the first classification for the first subset is below the first classification threshold;

based on the first classification for the first subset being below the first classification threshold, transmitting the first subset as part of the first data package to a first processing system included in a facility network configured to execute the first ML model;

determining whether the second classification for the second subset is below the second classification threshold; and

based on the second classification for the second subset being below the second classification threshold, transmitting the second subset as part of the second data package to a second processing system that is included in a cloud network outside the facility network and is configured to execute the second ML model.

9 . The method of claim 8 , wherein the method further comprises:

transmitting the first data package to the first ML model; and

transmitting the second data package to the second ML model.

10 . The method of claim 8 , wherein the first classification threshold is associated with the first privacy level, wherein the second classification threshold is associated with the second privacy level, and wherein the second privacy level is associated with more privacy than the first privacy level.

11 . The method of claim 8 , wherein the first classification threshold is a first privacy classification threshold associated with a first location associated with the first processing task, and wherein the second classification threshold is a second privacy classification threshold associated with a second location associated with the second processing task.

12 . The method of claim 8 , wherein the first processing task is performed using the first ML model, and wherein the second processing task is performed using the second ML model.

13 . The method of claim 8 , wherein the first classification threshold is determined based on the first processing goal, and wherein the second classification threshold is determined based on the second processing goal.

14 . The method of claim 8 , wherein the method further comprises:

determining that the first processing goal has changed;

based on the determination that the first processing goal has changed, determining an updated first processing goal;

determining an updated first classification threshold based on the updated first processing goal;

determining a third data package based on the updated first processing goal and the updated first classification threshold;

determining an updated second processing goal based on the determination that the first processing goal has changed;

determining an updated second classification threshold based on the updated second processing goal; and

determining a fourth data package based on the updated second processing goal and the updated second classification threshold.

15 . A surgical computing system comprising:

a processor configured to:

receive surgical data comprising a plurality of subsets of surgical data;

determine a first classification for a first subset of the plurality of subsets of surgical data, wherein the first classification is associated with a first privacy level;

determine a second classification for a second subset of the plurality of subsets of surgical data, wherein the second classification is associated with a second privacy level;

determine a first processing goal and a second processing goal, wherein the first processing goal is associated with a first processing task and a first data need, and wherein the second processing goal is associated with a second processing task and a second data need;

determine a first privacy threshold associated with the first processing task and a second privacy threshold associated with the second processing task;

determine a first data package based on the first processing goal, the first data need, and the first privacy threshold, wherein the first data package comprises at least a first portion of the surgical data, and wherein a first machine learning (ML) model is associated with processing the first data package;

determine a second data package based on the second processing goal, the second data need, and the second privacy threshold, wherein the second data package comprises at least a second portion of the surgical data, wherein the second portion of the surgical data comprises the first portion of the surgical data, and wherein a second ML model is associated with processing the second data package;

determine whether the first classification for the first subset is below the first privacy threshold;

based on the first classification for the first subset being below the first privacy threshold, transmit the first subset as part of the first data package to a first processing system included in a facility network configured to execute the first ML model;

determine whether the second classification for the second subset is below the second privacy threshold; and

based on the second classification for the second subset being below the second privacy threshold, transmit the second subset as part of the second data package to a second processing system that is included in a cloud network outside the facility network and is configured to execute the second ML model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2023
From: SHELTON, FREDERICK E., IV; HARRIS, JASON L.
To: CILAG GMBH INTERNATIONAL
Reel/Frame 062618/0199 →
Continuity (1)
Related Publication 20240221893A1 · Jul 4, 2024
References Cited (117)
US 6463417B1 · Schoenberg · 2002 [cited by applicant]
US 9345481B2 · Hall et al. · 2016 [cited by applicant]
US 9687230B2 · Leimbach et al. · 2017 [cited by applicant]
US 10390895B2 · Henderson et al. · 2019 [cited by applicant]
US 10695081B2 · Shelton, IV et al. · 2020 [cited by applicant]
US 10842523B2 · Shelton, IV et al. · 2020 [cited by applicant]
US 10881399B2 · Shelton, IV et al. · 2021 [cited by applicant]
US 10932808B2 · Shelton, IV et al. · 2021 [cited by applicant]
US 11410259B2 · Harris et al. · 2022 [cited by applicant]
US 11423007B2 · Shelton, IV et al. · 2022 [cited by applicant]
US 11464590B1 · Roh et al. · 2022 [cited by applicant]
US 12165200B1 · Tilly et al. · 2024 [cited by applicant]
US 20070027459A1 · Horvath et al. · 2007 [cited by applicant]
US 20070192140A1 · Gropper · 2007 [cited by applicant]
US 20080285626A1 · Ma et al. · 2008 [cited by applicant]
US 20090172773A1 · Moore · 2009 [cited by applicant]
US 20100228222A1 · Williams et al. · 2010 [cited by applicant]
US 20110112384A1 · Eisenhardt et al. · 2011 [cited by applicant]
US 20140005743A1 · Giuffrida et al. · 2014 [cited by applicant]
US 20140263552A1 · Hall et al. · 2014 [cited by applicant]
US 20170202605A1 · Shelton, IV et al. · 2017 [cited by applicant]
US 20170296213A1 · Swensgard et al. · 2017 [cited by applicant]
US 20170360512A1 · Couture et al. · 2017 [cited by applicant]
US 20180049822A1 · Henderson et al. · 2018 [cited by applicant]
US 20180360452A1 · Shelton, IV et al. · 2018 [cited by applicant]
US 20190006047A1 · Gorek et al. · 2019 [cited by applicant]
US 20190059929A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190104919A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190125455A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200844A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200981A1 · Harris et al. · 2019 [cited by applicant]
US 20190200997A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201047A1 · Yates et al. · 2019 [cited by applicant]
US 20190201119A1 · Harris et al. · 2019 [cited by applicant]
US 20190201123A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201136A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201137A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201144A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190205441A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190205567A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206555A1 · Morgan et al. · 2019 [cited by applicant]
US 20190206562A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206564A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206569A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190207857A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20200015901A1 · Scheib et al. · 2020 [cited by applicant]
US 20200237452A1 · Wolf et al. · 2020 [cited by applicant]
US 20200405296A1 · Shelton, IV et al. · 2020 [cited by applicant]
US 20210076966A1 · Grantcharov et al. · 2021 [cited by applicant]
US 20210196384A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210210189A1 · Casey et al. · 2021 [cited by applicant]
US 20210244487A1 · Beck · 2021 [cited by applicant]
US 20210315579A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210322014A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210343017A1 · Jordan · 2021 [cited by applicant]
US 20210344880A1 · Katra et al. · 2021 [cited by applicant]
US 20210370790A1 · Feldman · 2021 [cited by applicant]
US 20220039822A1 · Huang et al. · 2022 [cited by applicant]
US 20220096163A1 · Payyavula et al. · 2022 [cited by applicant]
US 20220104822A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220233119A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220238216A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220265233A1 · Boddington · 2022 [cited by examiner]
US 20220286687A1 · Bishop et al. · 2022 [cited by applicant]
US 20220318270A1 · Safary et al. · 2022 [cited by applicant]
US 20220331047A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220367040A1 · Sutherland et al. · 2022 [cited by applicant]
US 20220370138A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220392621A1 · George et al. · 2022 [cited by applicant]
US 20230027978A1 · Gaborit et al. · 2023 [cited by applicant]
US 20230095002A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230097906A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230098538A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230326193A1 · Zia et al. · 2023 [cited by applicant]
US 20230352133A1 · Chen et al. · 2023 [cited by applicant]
US 20230377709A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20240024027A1 · Shelton et al. · 2024 [cited by applicant]
US 20240065550A1 · Connor · 2024 [cited by applicant]
US 20240112768A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240216065A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240216081A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240220763A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221878A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221892A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221894A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221895A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221896A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221897A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221923A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221924A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221931A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221937A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240221960A1 · Shelton, IV et al. · 2024 [cited by applicant]
US 20240265536A1 · Watanabe et al. · 2024 [cited by applicant]
US 20240346374A1 · Ni et al. · 2024 [cited by applicant]
US 20250142289A1 · Seo et al. · 2025 [cited by applicant]
CN 108430339A · 2018 [cited by applicant]
CN 108511057A · 2018 [cited by examiner]
WO 2021113168A1 · 2021 [cited by applicant]
Alsallal, et al., “A Machine Learning Technique to Detect Counterfeit Medicine Based on X-Ray Fluorescence Analyser”, International Conference On Computing, Electronics & Communications Engineering (ICCECE), IEEE, 2018,… [cited by applicant]
Anonymous, , “Cloud computing”, Wikipedia, the free encyclopedia, Dec. 22, 2022, pp. 1-24. [cited by applicant]
Asadizanjani, et al., “Counterfeit Electronics Detection Using Image Processing and Machine Learning”, Journal of Physics Conference Series, vol. 787, 2017, pp. 1-6. [cited by applicant]
Qayyum, “Secure and Robust Machine Learning for Healthcare: A Survey”, IEEE, Reviews In Biomedical Engineering, vol. 14, 2021, 156-180. [cited by applicant]
“International Search Report and Written Opinion received for PCT Application No. PCT/IB2023/063313”, Apr. 5, 2024, 11 pages. [cited by applicant]
“International Search Report and Written Opinion received for PCT Application No. PCT/IB2023/063314”, Jun. 11, 2024, 25 pages. [cited by applicant]
“International Search Report and Written Opinion received for PCT Application No. PCT/IB2023/063316”, Apr. 10, 2024, 12 pages. [cited by applicant]
“International Search Report and Written Opinion received for PCT Application No. PCT/IB2023/063317”, Apr. 25, 2024, 11 pages. [cited by applicant]
“International Search Report and Written Opinion received for PCT Application No. PCT/IB2023/063320”, Mar. 25, 2024, 17 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/IB2023/063321, Apr. 8, 2024, 13 pages. [cited by applicant]
“International Search Report and Written Opinion received for PCT Application No. PCT/IB2023/063322”, Jun. 19, 2024, 20 pages. [cited by applicant]
“International Search Report and Written Opinion received for PCT Application No. PCT/IB2023/063324”, Apr. 10, 2024, 14 pages. [cited by applicant]
“Invitation to Pay Additional Fees received for PCT Application No. PCT/IB2023/063314”, Mar. 22, 2024, 13 pages. [cited by applicant]
“Invitation to Pay Additional Fees received for PCT Application No. PCT/IB2023/063318”, Apr. 12, 2024, 14 pages. [cited by applicant]
“Invitation to Pay Additional Fees received for PCT Application No. PCT/IB2023/063322”, Apr. 16, 2024, 11 pages. [cited by applicant]
Brownlee, Jason, “Dynamic Ensemble Selection (DES) for Classification in Python—MachineLearningMastery.com”, Retrieved from the Internet: URL: https://web.archive.org/web/20221206025245/https://machinelearningmastery.co… [cited by applicant]
ISO 26262-1, “Road Vehicles—Functional Safety—Part 1: Vocabulary”, International Organization for Standardization, Edition 2, Dec. 2018, 13 pages. [cited by applicant]
Zhao, et al., “Tracking-by-detection of Surgical Instruments in Minimally Invasive Surgery via the Convolutional Neural Network Deep Learning-based Method”, Computer Assisted Surgery, vol. 22, No. S1, Dec. 2017, 11 page… [cited by applicant]