IP Library Granted Patent US 11,266,468
Granted Patent B2
US 11,266,468 · App. 15/940,670 · Granted Mar 8, 2022

Cooperative utilization of data derived from secondary sources by intelligent surgical hubs

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Jason L. Harris (Lebanon, OH); David C. Yates (Morrow, OH)
Assignee: Cilag GmbH International
A61B34/25A61B34/35A61B34/76G16H30/40A61B34/77A61B90/361A61B90/37A61B2017/00199A61B2017/00221A61B2017/00225A61B2017/00477A61B2034/254A61B2034/302A61B2034/304A61B2034/305G16H40/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,266,468
App. No.
15/940,670
Granted
Mar 8, 2022
Kind
B2
Abstract

Various surgical hubs are disclosed. A surgical hub is for use with a medical imaging device at a remote surgical site in a surgical procedure. The surgical hub comprises a circuit configured to: receive a livestream of the surgical site from the medical imaging device; capture an image frame of a surgical step of the surgical procedure from the livestream; derive information relevant to the surgical step from data extracted from the image frame; and overlay the information onto the livestream.

Claims (49)

1. A surgical hub for use with a medical imaging device at a remote surgical site in a surgical procedure, wherein the surgical hub comprises a circuit configured to:

receive a livestream of the surgical site from the medical imaging device;

capture an image frame of a surgical step of the surgical procedure from the livestream;

derive information relevant to a surgical instrument in the surgical step from data extracted from the image frame; and

overlay the information onto the livestream;

wherein the derived information includes a type of the surgical instrument;

wherein the circuit is configured to derive the information by detecting a staple pattern in the image frame; and

wherein the staple pattern is defined by staples deployed from a staple cartridge into tissue at the surgical site.

2. The surgical hub of claim 1 , wherein the information is regarding completion of the surgical step.

3. The surgical hub of claim 1 , wherein the information identifies a leak at the surgical site.

4. The surgical hub of claim 1 , wherein the information identifies the surgical step.

5. A surgical hub for use with a medical imaging device at a remote surgical site in a surgical procedure, wherein the surgical hub comprises a circuit configured to:

receive a livestream of the surgical site from the medical imaging device;

capture an image frame of a surgical step of the surgical procedure from the livestream;

derive information relevant to the surgical step from data extracted from the image frame; and

overlay the information onto the livestream;

wherein the surgical step comprises deploying staples from a staple cartridge into tissue at the surgical site; and

wherein the information identifies the staple cartridge.

6. The surgical hub of claim 5 , wherein the information comprises a serial number of the staple cartridge.

7. A surgical hub for use with a medical imaging device at a remote surgical site in a surgical procedure including surgical steps, wherein the surgical hub comprises a circuit configured to:

receive a livestream of the surgical site from the medical imaging device;

capture image frames of the surgical steps of the surgical procedure from the livestream;

derive information relevant to at least one surgical instrument in the surgical steps; and

differentiate among the surgical steps based on data extracted from the image frames,

wherein the derived information includes a type of the at least one surgical instrument;

wherein the circuit is configured to derive the information by detecting a staple pattern in the image frames; and

wherein the staple pattern is defined by staples deployed from a staple cartridge into tissue at the surgical site.

8. The surgical hub of claim 7 , wherein the information is regarding completion of the surgical steps from the data extracted from the image frames.

9. The surgical hub of claim 8 , wherein the information identifies a leak at the surgical site.

10. The surgical hub of claim 8 , wherein one of the surgical steps comprises deploying the staples from the staple cartridge into the tissue at the surgical site.

11. The surgical hub of claim 10 , wherein another one of the surgical steps comprises applying energy to tissue at the surgical site.

12. A surgical hub for use with a medical imaging device at a remote surgical site in a surgical procedure including surgical steps, wherein the surgical hub comprises a circuit configured to:

receive a livestream of the surgical site from the medical imaging device;

capture image frames of the surgical steps of the surgical procedure from the livestream;

differentiate among the surgical steps based on data extracted from the image frames;

derive information regarding completion of surgical steps from the data extracted from the image frames;

wherein one of the surgical steps comprises deploying staples from a staple cartridge into tissue at the surgical site; and

wherein the information identifies the staple cartridge.

13. The surgical hub of claim 12 , wherein the information comprises a serial number of the staple cartridge.

14. A surgical hub for use with a medical imaging device at a remote surgical site in a surgical procedure, wherein the surgical hub comprises a circuit configured to:

receive a livestream of the surgical site from the medical imaging device;

capture an image frame from the livestream;

detect a staple pattern in the image frame, wherein the staple pattern is defined by staples deployed from a staple cartridge into tissue at the surgical site; and

identify the staple cartridge based on the staple pattern.

15. The surgical hub of claim 14 , wherein the staple pattern corresponds to a serial number of the staple cartridge.

16. The surgical hub of claim 15 , wherein the staples comprise a first staple and a second staple different than the first staple.

17. The surgical hub of claim 16 , wherein the first staple is comprised of a non-ionized material.

18. The surgical hub of claim 17 , wherein the second staple is comprised of an ionized material.

19. The surgical hub of claim 14 , wherein the staple pattern is defined in a plurality of rows of staples.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2021
From: ETHICON LLC
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056601/0339 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2018
From: SHELTON, FREDERICK E., IV; HARRIS, JASON L.; YATES, DAVID C.
To: ETHICON LLC
Reel/Frame 045729/0421 →
Cited By (9)
US 12,575,831 US 12,582,457 US 12,636,006 US 12,648,789 US 12,653,628 US 12,672,765 US 12,672,922 US 12,702,497 US 12,708,427