IP Library › Granted Patent US 11,925,309
Granted Patent B2
US 11,925,309 · App. 17/348,304 · Granted Mar 12, 2024

Method of using imaging devices in surgery

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Andrew C. Deck (Cincinnati, OH); Jason L. Harris (Lebanon, OH); Chad E. Eckert (Terrace Park, OH); Daniel J. Mumaw (Liberty Township, OH); Kevin M. Fiebig (Cincinnati, OH); Sarah A. Worthington (Cincinnati, OH)
Assignee: Cilag GmbH International
A61B1/000094A61B1/00194A61B1/009A61B1/046A61B1/0605A61B90/361A61B90/37G06T7/30G06T7/521G06T19/00A61B17/064A61B34/25A61B34/30A61B2090/064A61B2090/367A61B2090/3735G06T2200/24G06T2207/10081G06T2207/10088G06T2207/20221G06T2207/30092G06T2210/41G06T2219/004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,925,309
App. No.
17/348,304
Granted
Mar 12, 2024
Kind
B2
Abstract

A surgical hub for use with a surgical system in a surgical procedure performed in an operating room is disclosed. The surgical hub comprises a control circuit configured to generate a first image of a surgical site from a real-time imaging source, receive a second image of the surgical site from a non-real-time image source, align the first image and the second image, generate a representation of the surgical site based on the first image and the second image as aligned, display the representation on a display screen, receive a first user selection to overlay hidden structures on the representation, receive a second user selection to manipulate the representation, and adjust the representation based on the second user selection.

Claims (53)

1. A surgical hub for use with a surgical system in a surgical procedure performed in an operating room, the surgical hub comprising:

a control circuit configured to:

generate a first image of a surgical site from a real-time imaging source;

receive a second image of the surgical site from a non-real-time image source;

align the first image and the second image;

generate a representation of the surgical site based on the first image and the second image as aligned;

display the representation on a display screen;

receive a first user selection to overlay hidden structures on the representation;

receive a second user selection to manipulate the representation; and

adjust the representation based on the second user selection.

2. The surgical hub of claim 1 , wherein the non-real-time image source comprises at least one of a computed tomography scan or a magnetic resonance imaging scan.

3. The surgical hub of claim 1 , wherein the real-time imaging source comprises structured electromagnetic radiation emitted from an imaging system.

4. The surgical hub of claim 1 , wherein adjusting the representation comprises updating the representation as displayed on the display screen from a first state to a second state according to the received second user selection.

5. The surgical hub of claim 1 , wherein adjusting the representation comprises moving the representation to another display screen.

6. The surgical hub of claim 1 , wherein adjusting the representation comprises displaying the representation in conjunction with the first image.

7. The surgical hub of claim 1 , wherein adjusting the representation comprises displaying the representation in conjunction with the second image.

8. The surgical hub of claim 1 , wherein the control circuit is further configured to generate a third image of the surgical site from the real-time imaging source, wherein the representation comprises portions of an anatomical structure that lie outside of the third image.

9. The surgical hub of claim 1 , wherein the display screen is within a sterile barrier, and wherein the control circuit is further configured to:

generate a third image of the surgical site from the real-time imaging source;

transmit the third image to a second display outside the sterile barrier; and

receive a modified third image from outside the sterile barrier.

10. A surgical hub for use with a surgical system in a surgical procedure performed in an operating room, the surgical hub comprising:

a control circuit configured to:

receive real-time image data indicative of a surgical site from a camera;

generate a first image of the surgical site from the real-time image data;

receive a second image of the surgical site from a pre-operative image source;

interrogate the first image and the second image;

generate a representation of the surgical site based on the first image and the second image;

display the representation on a display screen;

display the first image on the display screen in conjunction with the representation;

receive a first user selection to overlay hidden structures on the representation;

receive a second user selection to manipulate the representation; and

adjust the representation based on the second user selection.

11. The surgical hub of claim 10 , wherein the pre-operative image source comprises at least one of a computed tomography scan or a magnetic resonance imaging scan.

12. The surgical hub of claim 10 , wherein the real-time image data comprises data indicative of structured electromagnetic radiation emitted from an imaging system.

13. The surgical hub of claim 10 , wherein adjusting the representation comprises updating the representation as displayed on the display screen from a first state to a second state according to the received second user selection.

14. The surgical hub of claim 10 , wherein adjusting the representation comprises moving the representation to another display screen.

15. The surgical hub of claim 10 , wherein adjusting the representation comprises displaying the representation in conjunction with the second image.

16. A surgical hub for use with a surgical system in a surgical procedure performed in an operating room, the surgical hub comprising:

a control circuit configured to:

generate a first image of a surgical site based on structured electromagnetic radiation emitted from an imaging system;

receive a second image of the surgical site from a pre-operative image source;

cooperatively assemble the first image and the second image;

generate a representation of the surgical site based on the first image and the second image as aligned;

display the representation on a display screen;

receive a first user selection to overlay hidden structures on the representation;

receive a second user selection to manipulate the representation; and

adjust the representation based on the second user selection.

17. The surgical hub of claim 16 , wherein the pre-operative image source comprises at least one of a computed tomography scan or a magnetic resonance imaging scan.

18. The surgical hub of claim 16 , wherein adjusting the representation comprises updating the representation as displayed on the display screen from a first state to a second state according to the received second user selection.

19. The surgical hub of claim 16 , wherein adjusting the representation comprises moving the representation to another display screen.

20. The surgical hub of claim 16 , wherein adjusting the representation comprises displaying the representation in conjunction with the first image.

21. The surgical hub of claim 16 , wherein adjusting the representation comprises displaying the representation in conjunction with the second image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2021
From: ETHICON LLC
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056876/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2021
From: SHELTON, FREDERICK E., IV; DECK, ANDREW C.; HARRIS, JASON L.; ECKERT, CHAD E.; MUMAW, DANIEL J.; FIEBIG, KEVIN M.; WORTHINGTON, SARAH A.
To: ETHICON LLC
Reel/Frame 056723/0392 →
Continuity (2)
Continuation 16729807 · Dec 30, 2019
Related Publication 20210307865A1 · Oct 7, 2021