IP Library › Granted Patent US 12,744,121
Granted Patent B2
US 12,744,121 · App. 18/606,557 · Granted Sep 22, 2026

Robotically-assisted surgical procedure feedback techniques

Inventors: Pierre Couture (Montreal, CA); William Hartman (Warsaw, IN)
Assignee: MedTech S.A.
G16H40/63A61B5/117A61B5/7267A61B5/746A61B34/10A61B34/32A61F2/461G06F16/2455G06N20/00A61B2034/104A61B2034/105A61F2002/4632
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,744,121
App. No.
18/606,557
Filed
Mar 15, 2024
Granted
Sep 22, 2026
Kind
B2
Art Unit
3683
USPC
705/2
Abstract

A system and method for pre-operative or intra-operative surgical procedure feedback provide a recommendation to a surgeon. A system may include a robotic surgical device to perform a portion of a surgical procedure on a patient, and a processor to determine a recommendation, based on past surgical information, for the portion of the surgical procedure performed by the robotic surgical device or for a next action to be taken, but the robotic surgical device or a surgeon. The system may include outputting the recommendation by intra-operatively providing the recommendation to a surgeon operating the robotic surgical device.

Claims (77)

1 . A system comprising:

a robotic surgical device to automatically perform a portion of a surgical procedure on a patient and capture robotic surgical operation data associated with the portion of the surgical procedure;

a prediction engine and a feature determination engine, the feature determination engine to generate a set of robotic surgical procedure weights based on a correlation of each of a plurality of pre-operative deformities with each of a plurality of successful intra-operative interventions taken by the robotic surgical device, the plurality of successful intra-operative interventions determined by identifying, from among a plurality of intra-operative interventions, a subset of interventions that are associated with favorable post-operative surgical outcome data, the favorable post-operative surgical outcome data identified based on a longitudinal recovery trajectory generated from recovery data generated over a plurality of post-operative time points by a patient-associated sensor, the longitudinal recovery trajectory including objective recovery measurements that change over time; and

a processor and memory including instructions, which when executed by the processor, cause the processor to:

record an action taken by the robotic surgical device during the portion of the surgical procedure;

intra-operatively input the action taken by the robotic surgical device to the prediction engine;

generate, in response to the action taken being input at the prediction engine, a robotic surgical procedure prediction output at the prediction engine based on an application of the set of robotic surgical procedure weights to the action taken by the robotic surgical device, the robotic surgical procedure prediction output including at least one result or next action taken after the action;

determine a robotic surgical procedure recommendation intra-operatively, based on the robotic surgical procedure prediction output, to the portion of the surgical procedure performed by the robotic surgical device; and

output the robotic surgical procedure recommendation by intra-operatively providing the robotic surgical procedure recommendation to a surgeon operating the robotic surgical device.

2 . The system of claim 1 , further including a surgical user interface device to receive a confirmation to execute the robotic surgical procedure recommendation;

the instructions further causing the processor to instruct the robotic surgical device to perform a modified surgical procedure based on the robotic surgical procedure recommendation.

3 . The system of claim 2 , wherein the surgical user interface device includes a touchscreen display device to:

display a user interface for providing the robotic surgical procedure recommendation to the surgeon; and

receive the confirmation to execute the robotic surgical procedure recommendation.

4 . The system of claim 1 , wherein:

the robotic surgical procedure recommendation is specific to the surgeon operating the robotic surgical device; and

the robotic surgical procedure recommendation is based on at least one of a set of surgical preferences associated with the surgeon or a set of previous surgical actions taken by the surgeon.

5 . The system of claim 1 , the instructions further causing the processor to:

preoperatively submit a surgical plan to the prediction engine;

preoperatively receive a surgical procedure success prediction from the prediction engine; and

preoperatively generate a predicted surgical procedure outcome based on the surgical procedure success prediction.

6 . The system of claim 1 , the instructions further causing the processor to:

simulate the portion of the surgical procedure to determine a plurality of recommended changes; and

select the robotic surgical procedure recommendation from the plurality of recommended changes based on predicted outcomes.

7 . The system of claim 1 , the instructions further causing the processor to:

store anonymized data related to the action taken by the robotic surgical device on a first server;

receive a code entered by the patient;

pull the anonymized data onto a second server; and

tie patient identifying information to the anonymized data on the second server.

8 . The system of claim 1 , the instructions further causing the processor to:

store anonymized data related to the action taken by the robotic surgical device;

receive a patient identifying code entered by the patient; and

associate patient identifying information with the anonymized data based on the patient identifying code.

9 . A method comprising:

recording an action taken by a robotic surgical device during a portion of a surgical procedure, the robotic surgical device to automatically perform the portion of the surgical procedure on a patient and capture robotic surgical operation data associated with the portion of the surgical procedure;

intra-operatively inputting the action taken by the robotic surgical device to a prediction engine, the prediction engine configured to generate a robotic surgical procedure prediction output based on a set of robotic surgical procedure weights, the set of robotic surgical procedure weights generated at a feature determination engine based on a correlation of each of a plurality of pre-operative deformities with each of a plurality of successful intra-operative interventions taken by the robotic surgical device, the plurality of successful intra-operative interventions determined by identifying, from among a plurality of intra-operative interventions, a subset of interventions that are associated with favorable post-operative surgical outcome data, the favorable post-operative surgical outcome data identified based on a longitudinal recovery trajectory generated from recovery data generated over a plurality of post-operative time points by a patient-associated sensor, the longitudinal recovery trajectory including objective recovery measurements that change over time;

generating, in response to the action taken being input at the prediction engine, a robotic surgical procedure prediction output at the prediction engine based on an application of the set of robotic surgical procedure weights to the action taken by the robotic surgical device, the robotic surgical procedure prediction output including at least one result or next action taken after the action;

determining a robotic surgical procedure recommendation intra-operatively, based on the robotic surgical procedure prediction output, to the portion of the surgical procedure performed by the robotic surgical device; and

outputting the robotic surgical procedure recommendation by intra-operatively providing the robotic surgical procedure recommendation to a surgeon operating the robotic surgical device.

10 . The method of claim 9 , further including:

receiving, at a surgical user interface device, a confirmation to execute the robotic surgical procedure recommendation; and

instructing the robotic surgical device to perform a modified surgical procedure based on the robotic surgical procedure recommendation.

11 . The method of claim 10 , further including:

displaying a user interface on the surgical user interface device for providing the robotic surgical procedure recommendation to the surgeon, the surgical user interface device including a touchscreen display; and

receiving the confirmation to execute the robotic surgical procedure recommendation.

12 . The method of claim 9 , wherein:

the robotic surgical procedure recommendation is specific to the surgeon operating the robotic surgical device; and

the robotic surgical procedure recommendation is based on at least one of a set of surgical preferences associated with the surgeon or a set of previous surgical actions taken by the surgeon.

13 . The method of claim 9 , further including:

preoperatively submitting a surgical plan to the prediction engine;

preoperatively receiving a surgical procedure success prediction from the prediction engine; and

preoperatively generating a predicted surgical procedure outcome based on the surgical procedure success prediction.

14 . The method of claim 9 , further including:

simulating the portion of the surgical procedure to determine a plurality of recommended changes; and

selecting the robotic surgical procedure recommendation from the plurality of recommended changes based on predicted outcomes.

15 . The method of claim 9 , further including:

storing anonymized data related to the action taken by the robotic surgical device on a first server;

receiving a code entered by the patient;

pulling the anonymized data onto a second server; and

tying patient identifying information to the anonymized data on the second server.

16 . The method of claim 9 , further including:

storing anonymized data related to the action taken by the robotic surgical device;

receiving a patient identifying code entered by the patient; and

associating patient identifying information with the anonymized data based on the patient identifying code.

17 . The method of claim 9 , further including generating a post-operative recommendation for the patient based on the robotic surgical procedure prediction output.

18 . A non-transitory computer-readable medium storing instructions that, when executed by a processor of a device, cause the device to:

record an action taken by a robotic surgical device during a portion of a surgical procedure, the robotic surgical device to automatically perform the portion of the surgical procedure on a patient and capture robotic surgical operation data associated with the portion of the surgical procedure;

intra-operatively input the action taken by the robotic surgical device to a prediction engine, the prediction engine configured to generate a robotic surgical procedure prediction output based on a set of robotic surgical procedure weights, the set of robotic surgical procedure weights generated at a feature determination engine based on a correlation of each of a plurality of pre-operative deformities with each of a plurality of successful intra-operative interventions taken by the robotic surgical device, the plurality of successful intra-operative interventions determined by identifying, from among a plurality of intra-operative interventions, a subset of interventions that are associated with favorable post-operative surgical outcome data, the favorable post-operative surgical outcome data identified based on a longitudinal recovery trajectory generated from recovery data generated over a plurality of post-operative time points by a patient-associated sensor, the longitudinal recovery trajectory including objective recovery measurements that change over time;

generate, in response to the action taken being input at the prediction engine, a robotic surgical procedure prediction output at the prediction engine based on an application of the set of robotic surgical procedure weights to the action taken by the robotic surgical device, the robotic surgical procedure prediction output including at least one result or next action taken after the action;

determine a robotic surgical procedure recommendation intra-operatively, based on the robotic surgical procedure prediction output, to the portion of the surgical procedure performed by the robotic surgical device; and

output the robotic surgical procedure recommendation by intra-operatively providing the robotic surgical procedure recommendation to a surgeon operating the robotic surgical device.

19 . The non-transitory computer-readable medium of claim 18 , the instructions further causing the device to:

receive, at a surgical user interface device, a confirmation to execute the robotic surgical procedure recommendation; and

instruct the robotic surgical device to perform a modified surgical procedure based on the robotic surgical procedure recommendation.

20 . The non-transitory computer-readable medium of claim 19 , the instructions further causing the device to:

display a user interface on the surgical user interface device for providing the robotic surgical procedure recommendation to the surgeon, the surgical user interface device including a touchscreen display; and

receive the confirmation to execute the robotic surgical procedure recommendation.

Continuity (3)
Continuation 16284622 · Feb 25, 2019
Provisional Application 62638492 · Mar 5, 2018
Related Publication 20240371509A1 · Nov 7, 2024
References Cited (99)
US 5499293A · Behram et al. · 1996 [cited by applicant]
US 8498883B2 · Lorsch · 2013 [cited by applicant]
US 9700292B2 · Nawana et al. · 2017 [cited by applicant]
US 9788907B1 · Alvi et al. · 2017 [cited by applicant]
US 10216904B2 · Hughes et al. · 2019 [cited by applicant]
US 10226302B2 · Lacal et al. · 2019 [cited by applicant]
US 10568535B2 · Roberts · 2020 [cited by examiner]
US 11158415B2 · Daley et al. · 2021 [cited by applicant]
US 11967422B2 · Couture et al. · 2024 [cited by applicant]
US 20110020779A1 · Hannaford et al. · 2011 [cited by applicant]
US 20140046128A1 · Lee · 2014 [cited by examiner]
US 20140052999A1 · Aissi · 2014 [cited by examiner]
US 20160210442A1 · Ethington et al. · 2016 [cited by applicant]
US 20160314711A1 · Grubbs · 2016 [cited by applicant]
US 20170228517A1 · Saliman et al. · 2017 [cited by applicant]
US 20170372029A1 · Saliman et al. · 2017 [cited by applicant]
US 20180055577A1 · Barral et al. · 2018 [cited by applicant]
US 20180233222A1 · Daley et al. · 2018 [cited by applicant]
US 20180263535A1 · Cramer · 2018 [cited by applicant]
US 20190008598A1 · Frimer et al. · 2019 [cited by applicant]
US 20190065970A1 · Bonutti et al. · 2019 [cited by applicant]
US 20190206563A1 · Shelton, IV · 2019 [cited by examiner]
US 20190206565A1 · Shelton, IV · 2019 [cited by applicant]
US 20190272917A1 · Couture et al. · 2019 [cited by applicant]
US 20200000400A1 · Mckinnon et al. · 2020 [cited by applicant]
US 20210065870A1 · Spooner et al. · 2021 [cited by applicant]
US 20210233615A1 · Banavar et al. · 2021 [cited by applicant]
CA 2980618A1 · 2016 [cited by applicant]
EP 2380626A1 · 2011 [cited by applicant]
EP 3790019A1 · 2021 [cited by applicant]
EP 3790019B1 · 2024 [cited by applicant]
GB 2505067B · 2015 [cited by applicant]
WO WO2017083768A1 · 2017 [cited by applicant]
WO WO2017214656A1 · 2017 [cited by applicant]
Wang, Z., Majewicz Fey, A. Deep learning with convolutional neural network for objective skill evaluation in robot-assisted surgery. Int J CARS 13, 1959-1970 (2018). https://doi.org/10.1007/s11548-018-1860-1 (Year: 2018… [cited by examiner]
“U.S. Appl. No. 16/560,793, Reply Brief mailed May 6, 2024”, 13 pgs. [cited by applicant]
“Australian Application Serial No. 2022203648, Response filed May 13, 2024 to First Examination Report mailed Jun. 9, 2023”, 32 pgs. [cited by applicant]
“Australian Application Serial No. 2022203648, Subsequent Examination Report mailed May 29, 2024”, 6 pgs. [cited by applicant]
“European Application Serial No. 21179139.7, Communication Pursuant to Article 94(3) EPC mailed Mar. 15, 2024”, 9 pgs. [cited by applicant]
“European Application Serial No. 21179139.7, Response filed Jul. 15, 2024 to Communication Pursuant to Article 94(3) EPC mailed Mar. 15, 2024”, 15 pgs. [cited by applicant]
Patel, Shyamal, et al., “A review of wearable sensors and systems with application in rehabilitation”, Journal of NeuroEngineering and Rehabilitation 9(21), (2012), 17 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Appeal Decision mailed May 16, 2025”, 21 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Final Office Action mailed Aug. 21, 2025”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Advisory Action mailed Jun. 14, 2021”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Appeal Brief filed Dec. 22, 2022”, 21 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Appeal Decision mailed Sep. 28, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Examiner Interview Summary mailed May 24, 2022”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Examiner's Answer mailed Mar. 14, 2023”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Final Office Action mailed Mar. 23, 2021”, 25 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Final Office Action mailed Apr. 13, 2022”, 26 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Non Final Office Action mailed Aug. 13, 2020”, 26 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Non Final Office Action mailed Aug. 19, 2022”, 24 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Non Final Office Action mailed Oct. 26, 2021”, 31 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Notice of Allowability mailed Jan. 8, 2024”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Notice of Allowance mailed Dec. 14, 2023”, 21 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Reply Brief filed May 12, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Response filed Jan. 13, 2021 to Non Final Office Action mailed Aug. 13, 2020”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Response filed Jan. 26, 2022 to Non Final Office Action mailed Oct. 26, 2021”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Response filed May 24, 2021 to Final Office Action mailed Mar. 23, 2021”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Response filed Jun. 23, 2021 to Advisory Action mailed Jun. 14, 2021”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 16/284,622, Response filed Jul. 13, 2022 to Final Office Action mailed Apr. 13, 2022”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Appeal Brief filed Nov. 14, 2023”, 22 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Examiner Interview Summary mailed Jan. 13, 2023”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Examiner Interview Summary mailed May 8, 2023”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Examiner Interview Summary mailed Jul. 11, 2022”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Examiner Interview Summary mailed Aug. 27, 2021”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Final Office Action mailed Jan. 6, 2022”, 18 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Final Office Action mailed Feb. 17, 2023”, 20 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Final Office Action mailed Nov. 25, 2022”, 21 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Non Final Office Action mailed May 25, 2022”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Non Final Office Action mailed Jun. 14, 2023”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Non Final Office Action mailed Jun. 24, 2021”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Response filed Apr. 6, 2022 to Final Office Action mailed Jan. 6, 2022”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Response filed May 17, 2023 to Final Office Action mailed Feb. 17, 2023”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Response filed Aug. 25, 2022 to Non Final Office Action mailed May 25, 2022”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Response filed Sep. 24, 2021 to Non Final Office Action mailed Jun. 24, 2021”, 16 pgs. [cited by applicant]
“Australian Application Serial No. 2020227004, First Examination Report mailed May 31, 2021”, 5 pgs. [cited by applicant]
“Australian Application Serial No. 2020227004, Response filed 01-21-022 to First Examination Report mailed May 31, 2021”, 49 pgs. [cited by applicant]
“Australian Application Serial No. 2020227004, Response filed Mar. 25, 2022 to Subsequent Examiners Report mailed Feb. 15, 2022”, 24 pgs. [cited by applicant]
“Australian Application Serial No. 2020227004, Subsequent Examiners Report mailed Feb. 15, 2022”, 5 pgs. [cited by applicant]
“Australian Application Serial No. 2020227004, Subsequent Examiners Report mailed Apr. 20, 2022”, 4 pgs. [cited by applicant]
“Australian Application Serial No. 2022203648, First Examination Report mailed Jun. 9, 2023”, 3 pgs. [cited by applicant]
“European Application Serial No. 19160858.7, Communication Pursuant to Article 94(3) EPC mailed Apr. 1, 2020”, 8 pgs. [cited by applicant]
“European Application Serial No. 19160858.7, Extended European Search Report mailed Jul. 18, 2019”, 8 pgs. [cited by applicant]
“European Application Serial No. 19160858.7, Response filed Mar. 11, 2020 to Extended European Search Report mailed Jul. 18, 2019”, 17 pgs. [cited by applicant]
“European Application Serial No. 19160858.7, Summons to Attend Oral Proceedings mailed Sep. 14, 2020”, 12 pgs. [cited by applicant]
“European Application Serial No. 20194416.2, Extended European Search Report mailed Jan. 28, 2021”, 13 pgs. [cited by applicant]
“European Application Serial No. 20194416.2, Response filed Sep. 10, 2021 to Extended European Search Report mailed Jan. 28, 2021”, 29 pgs. [cited by applicant]
“European Application Serial No. 21179139.7, Response filed Jul. 12, 2022 to Extended 'European Search Report mailed Dec. 14, 2021”, 30 pgs. [cited by applicant]
“European Application Serial No. 21179139.7, Extended European Search Report mailed Dec. 14, 2021”, 10 pgs. [cited by applicant]
Hossain, Belayat, et al., “Implanted Knee Kinematics Prediction: comparative performance analysis of machine learning techniques”, Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV) and 2018… [cited by applicant]
Prem, Ramkumar N, et al., “Remote Patient Monitoring Using Mobile Health for Total Knee Arthroplasty: Validation of a Wearable and Machine Learning-Based Surveillance Platform”, The Journal of Arthroplasty, Churchill Li… [cited by applicant]
Tan, Tina, “How Verb Surgical Will Deliver on Surgery 4.0”, Clinica; https://medtech.pharmaintelligence.informa.com/MT121764/Exec-Chat-How-Verb-Surgical-Will-Deliver-On-Surgery-40, (Nov. 14, 2017), 5 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Examiner's Answer to Appeal Brief mailed Mar. 6, 2024”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Examiner Interview Summary mailed Sep. 25, 2025”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Response filed Oct. 20, 2025 to Final Office Action mailed Aug. 21, 2025”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Advisory Action mailed Oct. 24, 2025”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 16/560,793, Non Final Office Action mailed Dec. 1, 2025”, 13 pgs. [cited by applicant]
Momi, E. De, “ROBOt and sensors integration for computer assisted surgery and therapy (ICT-2007-215190-Robocast)”, 2009 International Conference on Advanced Robotics, Munich, Germany, (2009), 1-6. [cited by applicant]