IP Library › Granted Patent US 11,510,743
Granted Patent B2
US 11,510,743 · App. 17/062,507 · Granted Nov 29, 2022

Communication control for a surgeon controlled secondary display and primary display

Inventors: Frederick E. Shelton, IV (New Vienna, OH); Jason L. Harris (Lebanon, OH)
Assignee: Cilag GmbH International
A61B34/25A61B17/072A61B17/320092A61B18/14G06F3/1423G16H40/63A61B5/021A61B34/37A61B2017/00039A61B2017/00199A61B2017/00221A61B2017/00398A61B2017/07235A61B2017/07285A61B2017/32007A61B2017/320084A61B2017/320095A61B2017/320097A61B2018/0063A61B2018/00541A61B2018/00565A61B2018/00601A61B2018/00994A61B2034/252A61B2034/256A61B2034/258A61B2218/002A61B2218/007A61B2218/008G06F3/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,510,743
App. No.
17/062,507
Filed
Oct 2, 2020
Granted
Nov 29, 2022
Kind
B2
Art Unit
2693
USPC
345/1.1
Abstract

A tiered multi-display control scheme may provide various communication control options for a surgeon-controlled secondary display and primary operating room display. A powered surgical tool may be in operative communication with a local display and at least one main monitor within the operating room outside the sterile field for displaying multiple data and/or imaging sources. The local display may be interactable by the surgeon within the sterile field. The display outside the sterile field may show an image of an aspect of the laparoscopic scope and may contain superimposed other data streams from other devices besides the scope. The secondary display could be used to direct from its displayed content up onto the primary display or remove it from the display. The added or removed data streams may be originated from the secondary display, passed through the secondary display, or be networked with the secondary display.

Claims (69)

1. A powered surgical instrument comprising:

a communication module operably connected to a first display inside a surgical sterile field and a second display outside of the surgical sterile field; and

a processor configured to:

obtain a multi-display control parameter;

identify a current multi-display control mode based on the multi-display control parameter;

determine, based on the current multi-display control mode, whether to generate visualization control data configured to control display content on the second display outside of the surgical sterile field in response to a user indication at the first display inside the surgical sterile field; and

interact with the first display inside the surgical sterile field and the second display outside of the surgical sterile field based on the determination.

2. The powered surgical instrument of claim 1 , wherein the communication module is operably connected to a surgical hub, and the multi-display control parameter comprises an indication from the surgical hub.

3. The powered surgical instrument of claim 1 , wherein the communication module is operably connected to a surgical hub, and the processor is further configured to:

receive, from the surgical hub, content for displaying on first display inside the surgical sterile field; and

send the received content to the first display.

4. The powered surgical instrument of claim 1 , wherein the processor is further configured to:

based on a determination that the current multi-display control mode supports sterile field display-based control, obtain, via the first display inside the surgical sterile field, the visualization control data associated with the second display outside of the surgical sterile field; and

send the visualization control data associated with the second display to a surgical hub for controlling the second display outside of the surgical sterile field.

5. The powered surgical instrument of claim 1 , wherein the processor is further configured to:

based on a determination that the current multi-display control mode does not support sterile field display-based control, disable generation of the visualization control data associated with the second display outside of the surgical sterile field.

6. The powered surgical instrument of claim 1 , wherein the communication module is operably connected to a surgical hub, the powered surgical instrument comprises at least one sensor for sensing surgical data, and the processor is further configured to:

determine, based on the current multi-display control mode, whether to request an aggregation analysis from a remote server via the surgical hub;

based on a determination to request the aggregation analysis, generate an aggregation analysis request;

receive an aggregation analysis response via the communication module; and

combine the received aggregation analysis response with surgical data generated based on the sensed surgical data for displaying on the first display inside the surgical sterile field.

7. The powered surgical instrument of claim 1 , wherein the powered surgical instrument comprises the first display inside the surgical sterile field.

8. The powered surgical instrument of claim 1 , wherein the first display inside the surgical sterile field is external to the powered surgical instrument.

9. The powered surgical instrument of claim 1 , wherein the multi-display control parameter comprises at least one of:

available processing capability associated with powered surgical instrument;

available power capability associated with powered surgical instrument; or

available data bandwidth associated with powered surgical instrument.

10. The powered surgical instrument of claim 1 , wherein the multi-display control parameter comprises a subscription level associated with multi-display control, and the processor is further configured to:

based on a determination that the subscription level associated with multi-display control supports sterile field display-based control, obtain, via the first display inside the surgical sterile field, the visualization control data configured to control the display content on the second display outside of the surgical sterile field, and send the visualization control data; and

based on a determination that the subscription level associated with multi-display control does not support sterile field display-based control, disable generation of the visualization control data configured to control the display content the second display outside of the surgical sterile field.

11. The powered surgical instrument of claim 1 , wherein the processor is further configured to:

based on a determination that the current multi-display control mode supports sterile field display-based control, receive the user indication, the user indication indicating a request of changing the display content on the second display outside of the surgical sterile field;

generate the visualization control data associated with the second display outside of the surgical sterile field based on the received user indication; and

send the visualization control data associated with the second display outside of the surgical sterile field to a surgical hub for controlling the second display outside of the surgical sterile field.

12. The powered surgical instrument of claim 11 , wherein the user indication indicating the request of changing the display content on the second display outside of the surgical sterile field is received via the first display inside a surgical sterile field.

13. The powered surgical instrument of claim 11 , wherein the user indication indicates at least one of:

projecting content associated with the first display inside the surgical sterile field onto the second display outside of the surgical sterile field, or

removing the content associated with the first display inside the surgical sterile field from the second display outside of the surgical sterile field.

14. A surgical hub comprising:

a communication module operably connected to a surgical instrument, a first display inside a surgical sterile field and a second display outside of the surgical sterile field; and

a processor configured to:

obtain a multi-display control parameter;

identify a current multi-display control mode based on the multi-display control parameter;

determine, based on the current multi-display control mode, whether to receive visualization control data configured to control display content on the second display outside of the surgical sterile field from the first display inside a surgical sterile field in response to a user indication at the first display inside the surgical sterile field; and

interact with the first display inside the surgical sterile field and the second display outside of the surgical sterile field based on the determination.

15. The surgical hub of claim 14 , wherein the processor is further configured to:

based on a determination that the current multi-display control mode supports sterile field display-based control, receive the visualization control data associated with the second display outside of the surgical sterile field; and

control the second display outside of the surgical sterile field based on the received visualization control data associated with the second display outside of the surgical sterile field.

16. The surgical hub of claim 14 , wherein the processor is further configured to:

determine, based on the current multi-display control mode, whether to retrieve aggregation analysis from a remote server for displaying on the first display inside the surgical sterile field;

based on a determination that the current multi-display control mode supports remote aggregation, generate an aggregation analysis request;

receive an aggregation analysis response via the communication module; and

combine the received aggregation analysis response with surgical data received from the surgical instrument to generate content for displaying on first display inside the surgical sterile field.

17. A method for communicating with a first display inside a surgical sterile field and a second display outside of the surgical sterile field, the method comprising:

obtaining a multi-display control parameter;

identifying a current multi-display control mode based on the multi-display control parameter;

determining, based on the current multi-display control mode, whether to generate visualization control data configured to control display content on the second display outside of the surgical sterile field in response to a user indication at the first display inside the surgical sterile field; and

interacting with the first display inside the surgical sterile field and the second display outside of the surgical sterile field based on the determination.

18. The method of claim 17 , further comprising:

determining, based on the current multi-display control mode, whether to request an aggregation analysis from a remote server;

based on a determination to request the aggregation analysis, generating an aggregation analysis request;

receiving an aggregation analysis response;

receiving sensed surgical data from at least one sensor; and

combining the received aggregation analysis response with surgical data generated based on the sensed surgical data for displaying on the first display inside the surgical sterile field.

19. The method of claim 17 , further comprising:

based on a determination that the current multi-display control mode supports sterile field display-based control, receiving the user indication, the user indication indicating a request of changing the display content on the second display outside of the surgical sterile field;

generating the visualization control data associated with the second display outside of the surgical sterile field based on the received user indication; and

sending the visualization control data associated with the second display outside of the surgical sterile field for controlling the second display outside of the surgical sterile field.

20. The method of claim 19 , wherein the user indication indicating the request of changing the display content on the second display outside of the surgical sterile field is received via the first display inside a surgical sterile field.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2021
From: ETHICON LLC
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056601/0339 →
CORRECTIVE ASSIGNMENT TO CORRECT THE FIRST INVENTOR'S NAME PREVIOUSLY RECORDED AT REEL: 054387 FRAME: 0332. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 19, 2020
From: SHELTON, FREDERICK E., IV; HARRIS, JASON L.
To: ETHICON LLC
Reel/Frame 054477/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2020
From: SHELTON, FREDERICK E.; HARRIS, JASON L.
To: ETHICON LLC
Reel/Frame 054387/0332 →
Continuity (1)
Related Publication 20220104889A1 · Apr 7, 2022
Cited By (16)
US 1,087,135 US 1,087,995 US 12,376,934 US 12,465,447 US 12,479,098 US 12,496,728 US 12,599,445 US 12,599,449 US 12,611,272 US 12,616,474 US 12,617,078 US 12,642,613 US 12,648,685 US 12,661,192 US 12,672,927 US 12,708,466