IP Library › Granted Patent US 11,756,668
Granted Patent B2
US 11,756,668 · App. 16/763,329 · Granted Sep 12, 2023

Systems methods devices circuits and computer executable code for tracking evaluating and facilitating a medical procedure

Inventors: Ofer Talmor (Atlit, IL); Chen Itzhaki (Herzeliya, IL)
Assignee: ALEPH BOT LTD
G16H20/40G06N3/08G06V10/764G06V10/803G06V10/82G06V20/41G06V20/46G06V20/52G16H40/20G16H40/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,756,668
App. No.
16/763,329
Granted
Sep 12, 2023
Kind
B2
Abstract

Disclosed is a system for medical procedure tracking, evaluation and assistance, wherein one or more video cameras, one or more acoustic sensors or one or more medical device interfaces acquire video, audio or medical device feeds from a medical treatment setting. A scene evaluation module detects scene related features in the video, audio or medical device feeds. A procedure compliance assessment module compares one or more scene related features detected and reported by the scene evaluation module to a list of expected actions or equipment usages associated with the procedure being performed in the treatment setting. A procedure assistance module provides compliance based procedure related action recommendations or instructions from within the list of expected actions or equipment usages.

Claims (19)

1. A medical procedure tracking and assistance system, said system comprising:

one or more video cameras, one or more acoustic sensors or one or more medical device interfaces for acquiring video, audio or medical device feeds from a medical treatment setting; a scene evaluation module for detecting scene related features in the video, audio or medical device feeds from the medical treatment setting;

a procedure compliance assessment module for comparing one or more of the scene related features detected and reported by said scene evaluation module to a list of expected actions or equipment usages associated with the procedure being performed in the treatment setting, and registering divergences between one or more of the detected scene features and, one or more of the actions or equipment usages associated with the procedure being performed in the treatment setting;

a procedure assistance module for providing procedure related action recommendations or instructions from within the list of expected actions or equipment usages, wherein one or more action recommendations or instructions are provided upon said procedure compliance assessment module finding a divergence between one or more of the detected scene features and one or more of the actions or equipment usages associated with the procedure being performed,

and wherein said procedure assistance module includes communication functionality for relaying the procedure related action recommendations or instructions, along with a medical tool or item associated therewith; and

a medical tools or items storage component including items or tools storage place indicators and adapted to receive the relayed procedure related action recommendations or instructions and upon receipt to indicate the storage place, within it, of the item or tool, relayed along with the received action recommendations or instructions.

2. The system according to claim 1 , wherein said scene evaluation module includes an audio signature detection component and said procedure compliance assessment module correlates detected sounds within the treatment setting with a certain step of the procedure associated with specific actions or specific medical equipment usage.

3. The system according to claim 1 , wherein said scene evaluation module includes a video recognition component and said procedure compliance assessment module correlates detected medical staff members participating in the procedure, and their orientation within the treatment setting, with a certain step of the procedure associated with specific actions or specific medical equipment usage.

4. The system according to claim 1 , wherein said procedure assistance module includes an artificial intelligence module for shepherding medical staff through the medical procedure, by selecting the procedure related action recommendations or instructions to be provided and the order by which to provide them.

5. The system according to claim 4 , wherein said artificial intelligence module is a deep learning neural network model trained by supervised-learning, wherein the training data for the model includes sets of audio, video or medical-device procedure setting inputs and their corresponding, verified, action recommendations or instructions outputs.

6. The system according to claim 1 , wherein said procedure assistance module further includes a communication module for relaying the procedure related action recommendations or instructions along with the location of the medical procedure setting within a medical facility; and wherein said system further comprises a medical equipment positioning and navigation module for: (a) monitoring the position of one or more autonomous mobile medical components within the medical facility; (b) receiving, from said communication module, a medical procedure recommendation or instruction associated with at least some of the one or more autonomous mobile medical components; (c) referencing a map of the medical facility and calculating navigation routes, to the location of the medical procedure setting, for the autonomous mobile medical components associated with the procedure recommendation or instruction, based on their current location; (d) selecting the fastest route from within the calculated navigation routes; (e) communicating the fastest route navigation instructions to the autonomous mobile medical component associated therewith.

7. A medical procedure tracking and assistance method, said method including:

acquiring video, audio or medical device feeds from a medical treatment setting; detecting scene related features in the video, audio or medical device feeds from the medical treatment setting; comparing one or more of the scene related features detected to a list of expected actions or equipment usages associated with the procedure being performed in the treatment setting;

registering divergences between one or more of the detected scene features and one or more of the actions or equipment usages associated with the procedure being performed in the treatment setting; and

providing procedure related action recommendations or instructions from within the list of expected actions or equipment usages, wherein one or more action recommendations or instructions are provided upon finding a divergence between one or more of the detected scene features and one or more of the actions or equipment usages associated with the procedure being performed, and relaying the procedure related action recommendations or instructions, along with a medical tool or item associated therewith to a medical tools or items storage component including items or tools storage place indicators and adapted to receive the relayed procedure related action recommendations or instructions and upon receipt to indicate the storage place, within it, of the item or tool, relayed along with the received action recommendations or instructions.

8. The method according to claim 7 , further including, correlating detected sounds within the treatment setting with a certain step of the procedure associated with specific actions or specific medical equipment usage.

9. The method according to claim 7 , further including, correlating detected medical staff members participating in the procedure, and their orientation within the treatment setting, with a certain step of the procedure associated with specific actions or specific medical equipment usage.

10. The method according to claim 7 , further including: training a deep learning neural network model with training data including sets of audio, video or medical-device procedure setting inputs and their corresponding, verified, action recommendations or instructions outputs; and shepherding medical staff through the medical procedure, by selecting the procedure related action recommendations or instructions to be provided and the order by which to provide them, based on outputs from the deep learning neural network model.

11. The method according to claim 7 , further including: relaying the procedure related action recommendations or instructions along with the location of the medical procedure setting within a medical facility; monitoring the position of one or more autonomous mobile medical components within the medical facility; receiving a medical procedure recommendation or instruction associated with at least some of the one or more autonomous mobile medical components; referencing a map of the medical facility and calculating navigation routes, to the location of the medical procedure setting, for the autonomous mobile medical components associated with the procedure recommendation or instruction, based on their current location; selecting the fastest route from within the calculated navigation routes; and communicating the fastest route navigation instructions to the autonomous mobile medical component associated therewith.

Continuity (2)
Provisional Application 62584834 · Nov 12, 2017
Related Publication 20200335208A1 · Oct 22, 2020