IP Library Granted Patent US 11,370,113
Granted Patent B2
US 11,370,113 · App. 15/686,840 · Granted Jun 28, 2022

Systems and methods for prevention of surgical mistakes

Inventors: Joëlle Barral (Mountain View, CA); Martin Habbecke (Palo Alto, CA); Daniele Piponi (Oakland, CA); Thomas Teisseyre (Pacifica, CA)
Assignee: Verily Life Sciences LLC
B25J9/163A61B34/25A61B34/30G05B13/028G05B13/04G06N20/00G16H40/63G16H50/20G16H50/50G16H50/70A61B34/32A61B34/37A61B2034/254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,370,113
App. No.
15/686,840
Granted
Jun 28, 2022
Kind
B2
Abstract

An apparatus, system and process for guiding a surgeon during a medical procedure to prevent surgical mistakes are described. The system may include a machine learning medical procedure server that generates one or more machine learning medical procedure models using, at least, medical procedure data captured during medical procedures performed at a plurality of different medical procedure systems. The system may also include a medical procedure system communicably coupled with the machine learning medical procedure server that receives a selected machine learning medical procedure model from the machine learning medical procedure server, and utilizes the selected machine learning medical procedure model during a corresponding medical procedure to control one or more operations of the medical procedure system.

Claims (51)

1. A system for preventing medical mistakes, the system comprising:

a medical procedure system that receives at least one selected machine learning medical procedure model from a machine learning medical procedure server, and utilizes the selected at least one machine learning medical procedure model during a corresponding medical procedure to control one or more operations of the medical procedure system;

wherein the at least one selected machine learning medical procedure model is associated with a medical procedure and comprises a first classifier trained by the machine learning medical procedure server to identify a current step from a predefined sequence of steps associated with the medical procedure; and

wherein controlling one or more operations of the medical procedure system includes:

using the first classifier to identify the current step;

determining an expected anatomical structure expected to be visible during the current step; and

in response to determining that the expected anatomical structure is not visible during the current step, preventing a movement of a medical tool coupled with the medical procedure system based on the identification of the current step and the determination that the expected anatomical structure is not visible.

2. The system of claim 1 , wherein the at least one selected machine learning medical procedure model further comprises one or more of a second classifier trained by the machine learning medical procedure server to identify anatomical structures visible during corresponding steps of the medical procedure, and a third classifier trained by the machine learning medical procedure server to identify medical tool data indicative of expected operation of one or more medical tools during corresponding steps of the medical procedure.

3. The system of claim 1 , wherein the medical tool comprises a robotically assisted medical device controlled by a medical professional performing the corresponding medical procedure.

4. The system of claim 1 , wherein control of the one or more operations of the medical procedure system comprises generating a graphical user interface with anatomical structure information that informs a medical professional performing the corresponding medical procedure of the expected anatomical structure during the current step.

5. The system of claim 1 , wherein control of the one or more operations of the medical procedure system comprises preventing a requested motion of the medical tool based on one or more characteristics of the requested motion, generating a graphical user interface that requests an acknowledgement of a medical professional to allow the requested motion, and enabling the medical tool to move in accordance with the requested motion.

6. The system of claim 1 , wherein the one or more machine learning medical procedure models are generated based on training sets of medical procedure data comprising one or more positive training sets of medical procedure data having a positive outcome in the corresponding medical procedure, one or more negative training sets of medical procedure data having an outcome with one or more failures at one or more stages in the corresponding medical procedure, and the medical procedure data captured during medical procedures performed at a plurality of different medical procedure systems.

7. The system of claim 1 , wherein the medical procedure system analyzes the corresponding medical procedure using the selected machine learning medical procedure model in real time during the corresponding medical procedure.

8. The system of claim 1 , wherein the medical procedure system tracks sensor data generated during the corresponding medical procedure from medical tool sensors coupled with the medical procedure system, and provides the tracked sensor data to the machine learning medical procedure server for generating or refining a machine learning medical procedure model associated with the corresponding medical procedure.

9. The system of claim 8 , wherein the medical procedure system receivers the generated or refined machine learning medical procedure model from the machine learning medical procedure server to replace existing machine learning medical procedure models associated with the corresponding medical procedure.

10. The system of claim 1 , wherein the at least one selected machine learning medical procedure model is generated using at least medical procedure data captured during medical procedures performed at a plurality of different medical procedure systems.

11. A method comprising:

receiving a selected machine learning medical procedure model at a medical procedure system from a machine learning medical procedure server; and

controlling one or more operations of the medical procedure system using the selected machine learning medical procedure model during a corresponding medical procedure;

wherein controlling the one or more operations of the medical procedure system comprises:

identifying a current step of the corresponding medical procedure;

determining an expected anatomical structure expected to be visible during the current step of the corresponding medical procedure; and

in response to determining that the expected anatomical structure is not visible during the current step, preventing a movement of a medical tool coupled with the medical procedure system based on the identification of the current step and the determination that the expected anatomical structure is not visible.

12. The method of claim 10 , wherein the machine learning medical procedure model is associated with a medical procedure and comprises a first classifier trained by the machine learning medical procedure server to identify steps within the medical procedure, a second classifier trained by the machine learning medical procedure server to identify anatomical structures visible during corresponding steps of the medical procedure, and a third classifier trained by the machine learning medical procedure server to identify medical tool data indicative of expected operation of one or more medical tools during corresponding steps of the medical procedure.

13. The method of claim 11 , wherein controlling the one or more operations of the medical procedure system comprises controlling motion of a medical tool coupled with the medical procedure system during the corresponding medical procedure.

14. The method of claim 13 , wherein the medical tool comprises a robotically assisted medical device controlled by a medical professional performing the corresponding medical procedure.

15. The method of claim 11 , wherein controlling the one or more operations of the medical procedure system comprises:

preventing a requested motion of a medical tool based on one or more characteristics of the requested motion;

generating a graphical user interface that requests an acknowledgement of a medical professional to allow the requested motion; and

enabling the medical tool to move in accordance with the requested motion.

16. The method of claim 11 , wherein the one or more machine learning medical procedure models are generated based on training sets of medical procedure data comprising one or more positive training sets of medical procedure data having a positive outcome in the corresponding medical procedure, one or more negative training sets of medical procedure data having an outcome with one or more failures at one or more stages in the corresponding medical procedure, and the medical procedure data captured during medical procedures performed at a plurality of different medical procedure systems.

17. The method of claim 11 , wherein the medical procedure system analyzes the corresponding medical procedure using the selected machine learning medical procedure model in real time during the corresponding medical procedure.

18. The method of claim 11 , further comprising:

tracking, by the medical procedure system, sensor data generated during the corresponding medical procedure from medical tool sensors coupled with the medical procedure system; and

providing the tracked sensor data to the machine learning medical procedure server for generating or refining a machine learning medical procedure model associated with the corresponding medical procedure.

19. The method of claim 18 , further comprising

receiving the generated or refined machine learning medical procedure model from the machine learning medical procedure server to replace existing machine learning medical procedure models associated with the corresponding medical procedure.

20. The method of claim 11 , wherein the at least one selected machine learning medical procedure model is generated using at least medical procedure data captured during medical procedures performed at a plurality of different medical procedure systems.

21. A non-transitory machine readable storage medium having instructions stored thereon, which when executed by a processing system, cause the processing system to perform a method comprising:

receiving at least one selected machine learning medical procedure model at a medical procedure system from a machine learning medical procedure server; and

controlling one or more operations of the medical procedure system using the at least one selected machine learning medical procedure model during a corresponding medical procedure;

wherein the at least one selected machine learning medical procedure model is associated with a medical procedure and comprises a first classifier trained by the machine learning medical procedure server to identify a current step from a predefined sequence of steps associated with the medical procedure; and

wherein controlling one or more operations of the medical procedure system includes:

using the first classifier to identify the current step;

determining an expected anatomical structure expected to be visible during the current step; and

in response to determining that the expected anatomical structure is not visible during the current step, preventing a movement of a medical tool coupled to the medical procedure system based on the identification of the current step and the determination that the expected anatomical structure is not visible.

22. The non-transitory machine readable storage medium of claim 21 , further comprising:

tracking, by the medical procedure system, sensor data generated during the corresponding medical procedure from medical tool sensors coupled with the medical procedure system; and

providing the tracked sensor data to the machine learning medical procedure server for generating or refining a machine learning medical procedure model associated with the corresponding medical procedure.

23. The non-transitory machine readable storage medium of claim 20 , further comprising:

receiving the generated or refined machine learning medical procedure model from the machine learning medical procedure server to replace existing machine learning medical procedure models associated with the corresponding medical procedure.

Assignments (2)
CHANGE OF NAME Recorded Apr 1, 2026
From: VERILY LIFE SCIENCES LLC
To: VERILY HEALTH INC.
Reel/Frame 075367/0775 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2017
From: BARRAL, JOËLLE; HABBECKE, MARTIN; PIPONI, DANIELE; TEISSEYRE, THOMAS
To: VERILY LIFE SCIENCES LLC
Reel/Frame 043679/0047 →
Continuity (2)
Provisional Application 62383838 · Sep 6, 2016
Related Publication 20180065248A1 · Mar 8, 2018
Cited By (5)
US 12,582,500 US 12,633,121 US 12,661,189 US 12,678,239 US 12,682,637