Granted Patent B2

US 12,640,255 · App. 18/316,007 · Granted May 26, 2026

Inventors: Tamir Wolf (Palo Alto, CA); Dotan Asselmann (Holon, IL)

Assignee: Theator Inc.

G16H40/20G06Q10/10G06Q30/018G06T7/0012G06V20/41G06V20/44G06V20/46G06V20/52G16H10/60G16H15/00G16H30/40G16H40/67G16H70/20G06F40/20G06Q40/08G06T2207/10016G06V10/70G06V10/774G06V2201/03G06V2201/034

Abstract

Claims (72)

1 . A non-transitory computer readable medium containing instructions that, when executed by at least one processor, cause the at least one processor to execute operations to perform intracorporeal video analysis operations for monitoring compliance with surgical guidelines, the operations comprising:

(a) accessing a data structure identifying a particular surgical guideline specifying a set of actions to take place during a particular type of surgical procedure;

(b) identifying a group of surgeons of a medical institution who performed a plurality of surgical procedures of the particular type of surgical procedure, wherein the plurality of surgical procedures are described by records and wherein the records include intracorporeal video footage;

(c) accessing a repository of intracorporeal video footage depicting performance of the plurality of surgical procedures by the group of surgeons;

(d) for each surgical procedure of the plurality of surgical procedures, performing image analysis on the intracorporeal video footage from the repository, the intracorporeal video footage capturing the respective surgical procedure, the image analysis is used to determine at least whether a respective action from the set of actions specified in the particular surgical guideline occurred in the respective surgical procedure;

(e) based on the image analysis performed in (d), determining an aggregated compliance level of the group of surgeons, the aggregated compliance level indicating a degree to which the group of surgeons adhered to the particular surgical guideline in performing the plurality of surgical procedures;

(f) accessing a second data structure containing aggregate data for the particular type of surgery;

(g) based on the aggregated compliance level and the aggregate data for the particular type of surgery, identifying an institutional deficiency in a performance factor describing performance of the particular type of surgery;

(h) outputting an indicator of the aggregated compliance level; and

(i) based on the institutional deficiency and the particular type of surgery, providing a suggested surgical guideline for addressing the institutional deficiency.

2 . The non-transitory computer readable medium of claim 1 , wherein the data structure identifies a plurality of surgical guidelines, each specifying a set of actions to take place during a type of surgical procedure.

3 . The non-transitory computer readable medium of claim 2 , wherein the aggregated compliance level is indicative of an overall compliance level of the group of surgeons to each surgical guideline in the plurality of surgical guidelines.

4 . The non-transitory computer readable medium of claim 3 , wherein the operations further comprise:

based on the image analysis performed in (d), determining an individual compliance level of a respective surgeon from the group of surgeons, the individual compliance level indicating a degree to which the respective surgeon adhered to the particular surgical guideline in performing the plurality of surgical procedures; and

outputting an additional indicator indicative of the individual compliance level.

5 . The non-transitory computer readable medium of claim 1 , wherein the group of surgeons identified in (b) represents surgeons who share a particular specialty.

6 . The non-transitory computer readable medium of claim 1 , wherein the performing image analysis (d) comprises applying a visual action recognition algorithm.

7 . The non-transitory computer readable medium of claim 1 , wherein the performing image analysis (d) comprises applying a machine learning model, the machine learning model being trained to detect at least the respective action of the set of actions using additional intracorporeal video footage where the respective action is known to have occurred.

8 . The non-transitory computer readable medium of claim 1 , wherein the determining (e) comprises determining the aggregated compliance level based on a non-video data source.

9 . The non-transitory computer readable medium of claim 8 , wherein the set of actions includes a first action and a second action, wherein the performing image analysis (d) comprises determining whether the first action occurred, wherein the operations further comprise analyzing the non-video data source to determine whether the second action occurred, and wherein the determining (e) further comprises the aggregated compliance level based on the performing image analysis (d) and the analysis of the non-video data source.

10 . The non-transitory computer readable medium of claim 1 , wherein the providing the suggested surgical guideline includes providing a reference medical institution that follows the suggested surgical guideline.

11 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise determining the suggested surgical guideline based on the identified institutional deficiency and existing surgical guidelines that the medical institution follows.

12 . The non-transitory computer readable medium of claim 1 , wherein the group of surgeons belong to an entity, wherein the performing the image analysis (d) comprises performing image analysis on the intracorporeal video footage capturing the respective surgical procedure to detect a first set of intraoperative actions performed during the particular type of surgical procedure, and wherein the operations further comprise:

based on the detected first set of intraoperative actions, determining a series of video frames depicting a failure to comply with a surgical guideline during the particular type of surgical procedure;

based on the determined series of video frames, providing a recommendation for the entity to follow a suggested surgical guideline;

performing image analysis on a second intracorporeal video footage captured after the provision of the recommendation to detect a second set of intraoperative actions, the second intracorporeal video footage of the entity depicting performance of the particular type of surgical procedure;

based on the detected second set of intraoperative actions, determining a subsequent compliance level with the particular surgical guideline; and

based on the determined subsequent compliance level with the particular surgical guideline, initiating a corrective action.

13 . The non-transitory computer readable medium of claim 12 , wherein the corrective action includes providing a reference video stream demonstrating adherence to the selected surgical guideline.

14 . The non-transitory computer readable medium of claim 12 , wherein the corrective action includes automatic adjustment of an insurance premium of an associated insurance policy.

15 . The non-transitory computer readable medium of claim 12 , wherein the corrective action includes automatically notifying a supervisor of the entity.

16 . The non-transitory computer readable medium of claim 12 , wherein the operations further comprise selecting the corrective action based on a number of subsequent recommendations.

17 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

for each surgical procedure of a subgroup of the plurality of surgical procedures, performing image analysis on a particular intracorporeal video footage from the repository to determine a failure type describing a failure to perform a particular action in a particular surgical procedure, the particular action being included in the set of actions specified in the particular surgical guideline, the particular intracorporeal video footage capturing the particular surgical procedure;

determining a statistical measure describing occurrence of the determined failure types among the identified group of surgeons; and

outputting an additional indicator indicative of the statistical measure.

18 . A computer-implemented method for performing intracorporeal video analysis operations for monitoring compliance with surgical guidelines, comprising:

(a) accessing a data structure identifying a particular surgical guideline specifying a set of actions to take place during a particular type of surgical procedure;

(b) identifying a group of surgeons of a medical institution who performed a plurality of surgical procedures of the particular type of surgical procedure, wherein the plurality of surgical procedures are described by records and wherein the records include intracorporeal video footage;

(c) accessing a repository of intracorporeal video footage depicting performance of the plurality of surgical procedures by the group of surgeons;

(d) for each surgical procedure of the plurality of surgical procedures, performing image analysis on the intracorporeal video footage from the repository, the intracorporeal video footage capturing the respective surgical procedure, the image analysis is used to determine at least whether a respective action from the set of actions specified in the particular surgical guideline occurred in the respective surgical procedure;

(e) based on the image analysis performed in (d), determining an aggregated compliance level of the group of surgeons, the aggregated compliance level indicating a degree to which the group of surgeons adhered to the particular surgical guideline in performing the plurality of surgical procedures;

(f) accessing a second data structure containing aggregate data for the particular type of surgery;

(g) based on the aggregated compliance level and the aggregate data for the particular type of surgery, identifying an institutional deficiency in a performance factor describing performance of the particular type of surgery;

(h) outputting an indicator of the aggregated compliance level; and

(i) based on the institutional deficiency and the particular type of surgery, providing a suggested surgical guideline for addressing the institutional deficiency.

19 . A system for performing intracorporeal video analysis operations for monitoring compliance with surgical guidelines, the system comprising a processor configured to perform steps comprising:

(a) accessing a data structure identifying a particular surgical guideline specifying a set of actions to take place during a particular type of surgical procedure;

(b) identifying a group of surgeons of a medical institution who performed a plurality of surgical procedures of the particular type of surgical procedure, wherein the plurality of surgical procedures are described by records and wherein the records include intracorporeal video footage;

(c) accessing a repository of intracorporeal video footage depicting performance of the plurality of surgical procedures by the group of surgeons;

(d) for each surgical procedure of the plurality of surgical procedures, performing image analysis on the intracorporeal video footage from the repository, the intracorporeal video footage capturing the respective surgical procedure, the image analysis is used to determine at least whether a respective action from the set of actions specified in the particular surgical guideline occurred in the respective surgical procedure;

(e) based on the image analysis performed in (d), determining an aggregated compliance level of the group of surgeons, the aggregated compliance level indicating a degree to which the group of surgeons adhered to the particular surgical guideline in performing the plurality of surgical procedures;

(f) accessing a second data structure containing aggregate data for the particular type of surgery;

(g) based on the aggregated compliance level and the aggregate data for the particular type of surgery, identifying an institutional deficiency in a performance factor describing performance of the particular type of surgery;

(h) outputting an indicator of the aggregated compliance level; and

(i) based on the institutional deficiency and the particular type of surgery, providing a suggested surgical guideline for addressing the institutional deficiency.

20 . A system for performing intracorporeal video analysis operations for monitoring compliance with surgical guidelines, the system comprising a processor configured to perform steps comprising:

(a) accessing a data structure identifying a particular surgical guideline specifying a set of actions to take place during a particular type of surgical procedure;

(b) identifying a group of surgeons of an entity who performed a plurality of surgical procedures of the particular type of surgical procedure, wherein the entity comprises a medical institution and wherein the plurality of surgical procedures are described by records and wherein the records include intracorporeal video footage;

(c) accessing a repository of intracorporeal video footage depicting performance of the plurality of surgical procedures by the group of surgeons;

(d) for each surgical procedure of the plurality of surgical procedures, performing image analysis on the intracorporeal video footage from the repository, the intracorporeal video footage capturing the respective surgical procedure, the image analysis is used to determine at least whether a respective action from the set of actions specified in the particular surgical guideline occurred in the respective surgical procedure, the image analysis further comprising:

detecting a first set of intraoperative actions performed during the particular type of surgical procedure; and

based on the detected first set of intraoperative actions, determining a series of video frames depicting a failure to comply with the particular surgical guideline during the particular type of surgical procedure;

(e) based on the determined series of video frames, providing a recommendation for the entity to follow a suggested surgical guideline;

(f) based on the image analysis performed in (d), determining an aggregated compliance level of the group of surgeons, the aggregated compliance level indicating a degree to which the group of surgeons adhered to the particular surgical guideline in performing the plurality of surgical procedures;

(g) accessing a second data structure containing aggregate data for the particular type of surgery;

(h) based on the aggregated compliance level and the aggregate data for the particular type of surgery, identifying an institutional deficiency in a performance factor describing performance of the particular type of surgery;

(i) outputting an indicator of the aggregated compliance level;

(j) based on the institutional deficiency and the particular type of surgery, providing the suggested surgical guideline for addressing the institutional deficiency;

(k) performing image analysis on a second intracorporeal video footage captured after the provisioning of the recommendation in (e) to detect a second set of intraoperative actions, the second intracorporeal video footage of the entity depicting performance of the particular type of surgical procedure;

(l) based on the detected second set of intraoperative actions, determining a subsequent compliance level with the particular surgical guideline; and

(m) based on the determined subsequent compliance level with the particular surgical guideline, initiating a corrective action.

Assignments (1)

Continuity (5)

References Cited (157)