IP Library Granted Patent US 10,878,966
Granted Patent B2
US 10,878,966 · App. 16/101,543 · Granted Dec 29, 2020

System and method for analysis and presentation of surgical procedure videos

Inventors: Tamir Wolf (New York City, NY); Dotan Asselmann (Tel Aviv, IL)
Assignee: THEATOR INC.
G16H70/20G06F3/0482G06K9/00711G06K9/3233G06T7/0012G16H10/60G16H20/40G16H30/20G16H30/40G16H40/63G16H50/70G06F40/20G06K2009/00738G06K2209/05G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,878,966
App. No.
16/101,543
Granted
Dec 29, 2020
Kind
B2
Abstract

Systems and methods for analysis and presentation of videos of surgical procedures are provided. For example, a video of a surgical procedure may be obtained, time points corresponding to key intraoperative events may be obtained, and properties of the key intraoperative events may be obtained. Further, the properties of the key intraoperative events may be presented to a user, and a selection of a selected intraoperative event may be received from the user. In response, part of the video associated with the time point corresponding to the selected intraoperative event may be presented.

Claims (54)

1. A method for presentation of videos of surgical procedures, the method comprising:

obtaining information related to a planned surgical procedure, the information indicating past surgical complications associated with a health professional in conjunction with the planned surgical procedure;

selecting a video of a surgical procedure from a plurality of videos of surgical procedures based on the past surgical complications;

obtaining, based on analysis of the video to identify intraoperative events appearing in the video, a plurality of time points corresponding to a plurality of key intraoperative events in the video;

obtaining at least one property of the plurality of key intraoperative events, wherein obtaining at least a part of the at least one property of the plurality of key intraoperative events includes analyzing the video;

visually presenting the at least one property of the plurality of key intraoperative events to a user;

in response to the visual presentation, receiving from the user a selection of a selected intraoperative event of the plurality of key intraoperative events, the selected intraoperative event depicting a leak;

analyzing the video to identify a source of the leak; and

in response to receiving the selection of the intraoperative event, presenting at least part of at least one frame of the video associated with a time point of the plurality of time points corresponding to the selected key intraoperative event, and the identified source of the leak.

2. The method of claim 1 , further comprising:

analyzing the video to identify at least part of the plurality of time points corresponding to a plurality of key intraoperative events; and

analyzing the video to identify at least part of the at least one property of the plurality of key intraoperative events.

3. The method of claim 1 , further comprising:

obtaining an electronic health record associated with the video of the surgical procedure; and

analyzing textual information from the electronic health record to identify at least part of the at least one property of the plurality of key intraoperative events.

4. The method of claim 1 , wherein the plurality of key intraoperative events comprises a plurality of intraoperative phases.

5. The method of claim 1 , wherein the plurality of key intraoperative events comprises at least one of an insertion, a removal, or a usage of medical equipment.

6. The method of claim 1 , wherein the plurality of key intraoperative events comprises an intraoperative surgical error.

7. The method of claim 1 , wherein the obtained information further comprises information related to a patient, and wherein the selection of the video is based on the information related to the patient.

8. The method of claim 1 , wherein the obtained information further comprises information related to a second health professional, and wherein the selection of the video is further based on the information related to the second health professional.

9. The method of claim 1 , wherein the obtained information comprises information related to past performance of the health professional, and the selection of the video is based on the past performance.

10. The method of claim 1 , wherein the obtained information further comprises information related to an intraoperative surgical error, and wherein the selection of the video is based on the information related to the intraoperative surgical error.

11. The method of claim 1 , wherein the obtained information further comprises information related to an intraoperative event, and wherein the selection of the video is based on the information related to the intraoperative event.

12. The method of claim 1 , wherein the obtained information further comprises information related to a second video of a second surgical procedure, and wherein the selection of the video is based on the information related to the second video.

13. The method of claim 1 , further comprising presenting, in conjunction with the at least one frame, at least one property of the selected intraoperative event.

14. The method of claim 13 , wherein the selected intraoperative event further comprises a bleeding, the method further comprising analyzing the video to identify an amount associated with the bleeding, and the presented at least one property comprises the identified amount.

15. The method of claim 13 , wherein the presented at least one property comprises the identified source of the leak.

16. The method of claim 13 , wherein the selected intraoperative event further comprises an injury, the method further comprising analyzing the video to identify a type of the injury, and the presented at least one property comprises the identified type.

17. The method of claim 1 , further comprising:

analyzing the at least one frame to detect a region of the at least one frame depicting the selected intraoperative event; and

based on the detected region, present an overlay over the presentation of the at least part of at least one frame.

18. The method of claim 1 , further comprising presenting, in conjunction with the at least one frame, information related to complications associated with the selected intraoperative event.

19. The method of claim 1 , further comprising presenting, in conjunction with the at least one frame, suggestion of at least one additional video.

20. The method of claim 1 , wherein the receiving from the user the selection of the selected intraoperative event includes receipt of a time point corresponding to a video frame at a start of the intraoperative event.

21. The method of claim 1 , wherein the obtained information further comprises information related to a surgical instrument associated with the planned surgical procedure, and the selection of the video is further based on the surgical instrument.

22. A system for presentation of videos of surgical procedures, the system comprising:

at least one processor configured to:

obtain information related to a planned surgical procedure, the information indicating past surgical complications associated with a health professional in conjunction with the planned surgical procedure;

select a video of a surgical procedure from a plurality of videos of surgical procedures based on the past surgical complications

obtain, based on analysis of the video to identify intraoperative events appearing in the video, a plurality of time points corresponding to a plurality of key intraoperative events;

obtain at least one property of the plurality of key intraoperative events, wherein obtaining at least a part of the at least one property of the plurality of key intraoperative events includes analyzing the video;

visually present the at least one property of the plurality of key intraoperative events to a user;

in response to the visual presentation, receive from the user a selection of a selected intraoperative event of the plurality of key intraoperative events, the selected intraoperative event depicting a leak;

analyzing the video to identify a source of the leak; and

in response to receiving the selection of the intraoperative event, present at least one frame of the video associated with a time point of the plurality of time points corresponding to the selected key intraoperative event, and the identified source of the leak.

23. A non-transitory computer readable medium storing data and computer implementable instructions for carrying out a method for presentation of videos of surgical procedures, the method comprising:

obtaining information related to a planned surgical procedure, the information indicating past surgical complications associated with a health professional in conjunction with the planned surgical procedure;

selecting a video of a surgical procedure from a plurality of videos of surgical procedures based on the past surgical complications;

obtaining, based on analysis of the video to identify intraoperative events appearing in the video, a plurality of time points corresponding to a plurality of key intraoperative events;

obtaining at least one property of the plurality of key intraoperative events, wherein obtaining at least a part of the at least one property of the plurality of key intraoperative events includes analyzing the video;

visually presenting the at least one property of the plurality of key intraoperative events to a user;

in response to the visual presentation, receiving from the user a selection of a selected intraoperative event of the plurality of key intraoperative events, the selected intraoperative event depicting a leak;

analyzing the video to identify a source of the leak; and

in response to receiving the selection of the intraoperative event, presenting at least one frame of the video associated with a time point of the plurality of time points corresponding to the selected key intraoperative event, and the identified source of the leak.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2019
From: WOLF, TAMIR; ASSELMANN, DOTAN
To: THEATOR INC.
Reel/Frame 048610/0633 →
Continuity (3)
Provisional Application 62544834 · Aug 13, 2017
Provisional Application 62667847 · May 7, 2018
Related Publication 20180366231A1 · Dec 20, 2018
Cited By (23)
US 12,228,987 US 12,235,697 US 12,239,353 US 12,293,432 US 12,315,036 US 12,354,186 US 12,369,960 US 12,369,994 US 12,376,896 US 12,444,094 US 12,462,439 US 12,478,382 US 12,488,512 US 12,493,996 US 12,505,584 US 12,579,496 US 12,629,194 US 12,639,250 US 12,661,188 US 12,670,670 US 12,682,578 US 12,682,579 US 12,697,178