IP Library › Granted Patent US 12,156,700
Granted Patent B2
US 12,156,700 · App. 17/427,381 · Granted Dec 3, 2024

Use of robotic surgical data for training

Inventors: Branislav Jaramaz (Pittsburgh, PA); Daniel Farley (Memphis, TN)
Assignees: Smith & Nephew, Inc.; Smith & Nephew Orthopaedics AG; Smith & Nephew Asia Pacific Pte. Limited
A61B34/10A61B17/1764A61B34/25A61B90/361A61B90/37A61B90/39A61F2/461G02B27/0172G06N3/08G06N5/046G06N20/00G06N20/10G09B5/02G09B19/003G09B19/24G16H10/60G16H20/40G16H30/40G16H40/63G16H50/50G16H50/70A61B2017/00199A61B2017/00526A61B17/15A61B17/17A61B2034/102A61B2034/104A61B2034/105A61B2034/107A61B2034/108A61B34/20A61B2034/2048A61B2034/2057A61B2034/2063A61B2034/2065A61B2034/2068A61B2034/2072A61B2034/2074A61B2034/252A61B2034/254A61B2034/256A61B2034/258A61B34/30A61B2090/363A61B2090/365A61B2090/371A61B2090/376A61B2090/3916A61B2090/502A61B90/96A61F2002/30952A61F2002/4633G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,156,700
App. No.
17/427,381
Filed
Jul 30, 2021
Granted
Dec 3, 2024
Kind
B2
Art Unit
3715
USPC
434/PCA.03
Abstract

A method for utilizing robotic surgical data for providing surgical training is disclosed. The method includes collecting, by a computing device, data related to a surgical procedure from one or more components of a computer-assisted surgical system. At least one of the one or more components is a robotically controlled surgical device. A graphical depiction representative of the surgical procedure is generated based on the collected data from the one or more components of the computer-assisted surgical system and one or more images providing a visual depiction of a patient's anatomy. A graphical user interface is output to a display device. The graphical user interface includes the graphical depiction of the surgical procedure and the collected data from the one or more components of the computer-assisted surgical system, to provide surgical training.

Claims (35)

1. A method for utilizing robotic surgical data for providing surgical training, the method comprising:

collecting, by a computing device, data related to a surgical procedure from one or more components of a computer-assisted surgical system, wherein at least one of the one or more components is a robotically controlled surgical device;

generating, by the computing device, a plurality of graphical depictions representative of the surgical procedure based on the collected data from the one or more components of the computer-assisted surgical system and one or more images providing a visual depiction of a patient's anatomy;

intraoperatively generating, by the computing device, a playback video of the surgical procedure based on the plurality of the graphical depictions; providing, by the computing device, the playback video of the surgical procedure;

obtaining, by the computing device, post-operative data for the patient;

determining, by the computing device, one or more complications of the surgical procedure; and

identifying, by the computing device, the one or more complications in the playback video of the surgical procedure.

2. The method of claim 1 , wherein the plurality of graphical depictions comprises one or more images collected pre-operatively to provide various views of the patient's anatomy.

3. The method of claim 1 , wherein the plurality of graphical depictions are based on a three-dimensional model of the patient's anatomy.

4. The method of claim 1 , further comprising outputting, by the computing device, a graphical user interface to a display device, the graphical user interface comprising at least one of the plurality of graphical depictions of the surgical procedure and the collected data from the one or more components of the computer-assisted surgical system, wherein the graphical user interface is configured to allow a user to selectively view the data collected from one or more of the one or more components of the computer-assisted surgical system.

5. The method of claim 1 , wherein the collected data is organized into selectable modules, wherein the modules are selectable based on one or more aspects of the surgical procedure.

6. The method of claim 4 , wherein the graphical user interface is output to the display device in real-time during the surgical procedure.

7. The method of claim 1 , wherein the one or more images are based on images obtained by an augmented reality headset worn by a surgeon during the surgical procedure.

8. The method of claim 1 , wherein the collected data comprises position or orientation data for a robotic arm utilized in the surgical procedure.

9. The method of claim 4 , wherein the graphical user interface provides different colors to display deviations from a surgical plan.

10. The method of claim 1 , wherein the robotically controlled surgical device comprises a resection device.

11. The method of claim 10 , wherein the collected data comprises one or more of measured torque, an audio signature, or a measured displacement for the resection device.

12. The method of claim 4 , further comprising:

providing, by the computing device, the graphical user interface to a remote display device over a communications network.

13. A non-transitory computer readable medium having stored thereon instructions for utilizing robotic surgical data for providing surgical training comprising executable code that, when executed by one or more processors, causes the one or more processors to:

collect data related to a surgical procedure from one or more components of a computer-assisted surgical system, wherein at least one of the one or more components is a robotically controlled surgical device and the data comprises position or orientation data for a robotic arm utilized in the surgical procedure;

generate a plurality of graphical depictions representative of the surgical procedure based on the collected data from the one or more components of the computer-assisted surgical system and one or more images providing a visual depiction of a patient's anatomy;

intraoperatively generate a playback video of the surgical procedure based on the plurality of the graphical depictions;

provide the playback video of the surgical procedure;

obtain post-operative data for the patient;

determine one or more complications of the surgical procedure; and

identify the one or more complications in the playback video of the surgical procedure.

14. A surgical computing device comprising a memory comprising programmed instructions stored thereon for utilizing robotic surgical data for providing surgical training and one or more processors coupled to the memory and configured to execute the stored programmed instructions to:

collect data related to a surgical procedure from one or more components of a computer-assisted surgical system, wherein at least one of the one or more components is a robotically controlled resection device;

generate a plurality of graphical depictions representative of the surgical procedure based on the collected data from the one or more components of the computer-assisted surgical system and one or more images providing a visual depiction of a patient's anatomy;

intraoperatively generate a playback video of the surgical procedure based on the plurality of the graphical depictions;

provide the playback video of the surgical procedure;

obtain post-operative data for the patient;

determine one or more complications of the surgical procedure; and

identify the one or more complications in the playback video of the surgical procedure.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2021
From: SMITH & NEPHEW, INC.
To: SMITH & NEPHEW, INC.; SMITH & NEPHEW ORTHOPAEDICS AG; SMITH & NEPHEW ASIA PACIFIC PTE. LIMITED
Reel/Frame 057886/0807 →
Continuity (6)
Provisional Application 62939946 · Nov 25, 2019
Provisional Application 62885673 · Aug 12, 2019
Provisional Application 62864663 · Jun 21, 2019
Provisional Application 62801245 · Feb 5, 2019
Provisional Application 62801257 · Feb 5, 2019
Related Publication 20220148454A1 · May 12, 2022