Interactive display for surgery with mother and daughter video feeds

Inventors: Francois I. Luks (Barrington, RI); Derek Merck (Barrington, RI)

Assignee: University Surgical Associates, Inc.

A61B34/20 A61B1/0005 A61B1/00009 A61B1/00011 A61B1/00045 A61B1/00188 A61B1/045 A61B1/3132 A61B2034/2055 A61B2034/2074

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 10,499,994
App. No.: 15/121,670
Granted: Dec 10, 2019
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Data characterizing a mother video feed acquired by an endoscopic video capture device can be received. The mother video feed can be for characterizing an operative field within a patient. One or more predefined markers can be identified within the mother video feed. Each of the one or more predefined markers can be associated with a surgical instrument in the operative field. Using the data characterizing the mother video feed, a daughter video feed comprising a sub-portion of the mother video feed can be generated. At least one of a location of the daughter video feed within the mother video feed and a zoom of the daughter video feed can be based on the identified one or more predefined markers. The daughter video feed can be provided. Related apparatus, systems, techniques, and articles are also described.

Claims (40)

1. A method for implementation by one or more data processors forming part of at least one computing system, the method comprising:

receiving, by at least one data processor, data characterizing a mother video feed acquired by an endoscopic video capture device, the mother video feed for characterizing an operative field within a patient;

identifying, using at least one data processor, a first predefined marker within the mother video feed and associated with a first surgical instrument in the operative field;

identifying, using at least one data processor, a second predefined marker within the mother video feed and associated with a second surgical instrument in the operative field;

generating, using at least one data processor and the data characterizing the mother video feed, a first daughter video feed comprising a first sub-portion of the mother video feed, wherein a location of the first daughter video feed within the mother video feed and a zoom of the first daughter video feed is based on the identified first predefined marker;

generating simultaneously with generation of the first daughter video feed, using at least one data processor and the mother video feed, a second daughter video feed comprising a second sub-portion of the mother video feed, wherein a location of the second daughter video feed within the mother video feed and a zoom of the second daughter video feed is based on the identified second predefined marker;

tracking the first predefined marker and the second predefined marker through the mother video feed,

wherein the first daughter video feed automatically pans through the mother video feed by changing the location of the first daughter video feed and based on the tracking of the first predefined marker;

wherein the first daughter video feed automatically changes a level of magnification within the mother video feed by changing the zoom of the first daughter video feed and based on the tracking of the first predefined marker; and

providing, using at least one data processor, the first daughter video feed and the second daughter video feed.

2. The method of claim 1 , wherein the first daughter video feed location is centered on the identified first predefined marker.

3. The method of claim 1 , wherein the first predefined marker is located at or near a distal end of the first surgical instrument; and the second predefined marker is located at or near a distal end of the second surgical instrument.

4. The method of claim 1 , wherein the endoscopic video capture device is hand-held.

5. The method of claim 1 , wherein the location of the first daughter video feed defines a sub-portion of the mother video feed.

6. The method of claim 1 , wherein the zoom of the first daughter video feed defines a level of magnification and a window size.

7. The method of claim 1 , wherein the zoom of the first daughter video feed is based on a present size of the identified first predefined marker within the mother video feed.

8. The method of claim 1 , wherein providing includes at least one of displaying, transmitting, storing, or processing.

9. The method of claim 1 , wherein providing includes displaying the first daughter video feed and the second daughter video feed separately for viewing during videoscopic procedures.

10. The method of claim 1 , wherein the first sub-portion of the mother video feed is a windowed portion of the mother video feed.

11. The method of claim 1 , wherein the location and the zoom of the first daughter video feed is independent of a position and/or a gaze of a surgeon.

12. A non-transitory computer program product storing instructions, which when executed by at least one data processor of at least one computing system, implement operations comprising:

identifying, using at least one data processor, a first predefined marker within the mother video feed and associated with a first surgical instrument in the operative field;

identifying, using at least one data processor, a second predefined marker within the mother video feed and associated with a second surgical instrument in the operative field;

tracking the first predefined marker and the second predefined marker through the mother video feed,

providing, using at least one data processor, the first daughter video feed and the second daughter video feed.

13. A system comprising: at least one data processor; and memory storing instructions, which when executed by the at least one data processor, implement operations comprising:

identifying, using at least one data processor, a first predefined marker within the mother video feed and associated with a first surgical instrument in the operative field;

identifying, using at least one data processor, a second predefined marker within the mother video feed and associated with a second surgical instrument in the operative field;

tracking the first predefined marker and the second predefined marker through the mother video feed,

providing, using at least one data processor, the first daughter video feed and the second daughter video feed.

Continuity (2)

Provisional Application 61945673 · Feb 27, 2014

Related Publication 20170027650A1 · Feb 2, 2017

Cited By (30)

US 12,193,636 US 12,193,766 US 12,207,817 US 12,226,151 US 12,226,166 US 12,232,729 US 12,239,320 US 12,256,995 US 12,295,674 US 12,303,159 US 12,310,586 US 12,318,152 US 12,329,467 US 12,376,855 US 12,376,910 US 12,383,115 US 12,396,806 US 12,433,508 US 12,458,351 US 12,500,948 US 12,514,584 US 12,521,191 US 12,549,622 US 12,574,434 US 12,575,855 US 12,582,457 US 12,648,789 US 12,653,628 US 12,672,922 US 12,708,427