IP Library Granted Patent US 11,166,758
Granted Patent B2
US 11,166,758 · App. 16/153,721 · Granted Nov 9, 2021

Methods of user interfaces for electrosurgical tools in robotic surgical systems

Inventors: Paul W. Mohr (Mountain View, CA); David W. Robinson (Mountain View, CA); Thomas R. Nixon (San Jose, CA); Michael Hanuschik (Mountain View, CA); Randal P. Goldberg (Campbel, CA); Salvatore J. Brogna (Pleasanton, CA)
Assignee: Intuitive Surgical Operations, Inc.
A61B18/12A61B1/00009A61B18/1206A61B18/1233A61B34/30A61B34/37A61B18/1482A61B18/20A61B34/25A61B90/361A61B2017/00477A61B2017/00973A61B2017/32007A61B2017/320069A61B2017/320071
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,166,758
App. No.
16/153,721
Filed
Oct 6, 2018
Granted
Nov 9, 2021
Kind
B2
Art Unit
3792
USPC
600/528
Abstract

A method for a minimally invasive surgical system is disclosed including capturing camera images of a surgical site; generating a graphical user interface (GUI) including a first colored border portion in a first side and a second colored border in a second side opposite the first side; and overlaying the GUI onto the captured camera images of the surgical site for display on a display device of a surgeon console. The GUI provides information to a user regarding the first electrosurgical tool and the second tool in the surgical site that is concurrently displayed by the captured camera images. The first colored border portion in the GUI indicates that the first electrosurgical tool is controlled by a first master grip of the surgeon console and the second colored border portion indicates the tool type of the second tool controlled by a second master grip of the surgeon console.

Claims (75)

1. A minimally invasive surgical method comprising:

swapping control from a first side having a first robotic surgical tool mounted to a first robotic arm controlled by a first master grip of a surgeon console to a second side having a second robotic surgical tool mounted to a second robotic arm controlled by a second master grip of the surgeon console;

swapping a control icon from a first side of a graphical user interface (GUI) to a second side of the GUI; and

displaying an active control border and an active control icon in the second side of the GUI and an inactive control border in the first side of the GUI to provide information to a user, based on the second robotic surgical tool being a supply controllable tool.

2. The method of claim 1 , wherein

a remote controlled supply equipment is not under control of a user input device, and the method further comprises

displaying an inactive control border and an inactive control icon in the second side of the GUI and the inactive control border in the first side of the GUI to provide information to a user.

3. The method of claim 1 , wherein

the second robotic surgical tool is an electrosurgical tool,

an electrosurgical energy generator is under control of a user input device to supply energy to the second robotic surgical tool,

the active control border is an active energy border and the active control icon is an active energy icon and the inactive control border is an inactive energy border;

energy control is swapped from the first side to the second side; and

the control icon is an energy icon.

4. The method of claim 1 , wherein

the second robotic surgical tool is an electrosurgical tool,

an electrosurgical energy generator is not under control of a user input device, and the method further comprises

displaying an inactive energy border and an inactive energy icon in the second side of the GUI and an inactive energy border in the first side of the GUI to provide information to a user.

5. The method of claim 1 , wherein

the second robotic surgical tool is not an electrosurgical tool, and the method further comprises

displaying an inactive energy border and an inactive energy icon in the second side of the GUI to provide information to a user.

6. The method of claim 1 , wherein:

the active control border presents the user with enhanced feedback signaling.

7. The method of claim 6 , further wherein:

the enhanced feedback signaling includes one or more of a vibration in the second master grip, a sound played on a speaker on the second side, and a flashing of the active control border.

8. The method of claim 1 , wherein:

a remote controlled supply equipment is under control of a user input device to supply the second robotic surgical tool.

9. The method of claim 8 , wherein

the user input device is a control pedal.

10. A minimally invasive surgical method comprising:

swapping control from a first side having a first robotic surgical tool mounted to a first robotic arm controlled by a first master grip of a surgeon console to a second side having a second robotic surgical tool mounted to a second robotic arm controlled by a second master grip of the surgeon console;

swapping a control icon from a first side of a graphical user interface (GUI) to a second side of the GUI; and

displaying an inactive control border and an inactive control icon in the second side of the GUI to provide information to a user, based on the second robotic surgical tool not being a supply controllable tool.

11. The method of claim 10 , further comprising:

receiving a tool swap input at a tool swap input device.

12. The method of claim 11 , wherein

the tool swap input device is a tool swap pedal.

13. A method for minimally invasive surgery, the method comprising:

receiving a tool swap input at a tool swap input device;

swapping tool control from a first robotic surgical tool, mounted to a first left side robotic arm controlled by a left master grip of a surgeon console to a second robotic surgical tool mounted to a second left side robotic arm, in response to receiving the tool swap input at the tool swap pedal;

swapping an indicator of the first robotic tool to a tool swap icon and an indicator of the second robotic tool to a left tool type icon, the indicators and icons displayed on a graphical user interface (GUI); and

displaying an active control border and an active control icon on a left side of the GUI to provide information to a user, based on the second robotic surgical tool being a supply controllable tool.

14. The method of claim 13 , further comprising:

displaying an inactive control border and an inactive control icon in the left side of the GUI, based on the second robotic surgical tool not being a supply controllable tool.

15. The method of claim 13 , wherein

a remote controlled supply equipment is not under control of a user input device, and the method further comprises

displaying an inactive control border and an inactive control icon on the left side of the GUI.

16. The method of claim 15 , wherein

the tool swap input device is a tool swap pedal and

the user input device is a control pedal.

17. The method of claim 13 , wherein

the tool swap input device is a tool swap pedal.

18. The method of claim 13 , wherein

the second robotic surgical tool is an electrosurgical tool,

the remote controlled supply equipment is an electrosurgical energy generator under control of the user input device to supply energy to the second robotic tool,

the active control border is an active energy border and the active control icon is an active energy icon and the inactive control border is an inactive energy border;

energy control is swapped from the first robotic tool to the second robotic tool; and

the control icon is an energy icon.

19. The method of claim 18 , further comprising:

if an electrosurgical energy generator is not under control of the user input device, then displaying an inactive energy border and an inactive energy icon in the left side of the GUI to provide information to a user.

20. The method of claim 13 , further comprising:

if the second robotic tool is not an electrosurgical tool, then displaying an inactive energy border and an inactive energy icon in the left side of the GUI to provide information to a user.

21. The method of claim 13 , wherein:

the active control border presents the user with enhanced feedback signaling.

22. The method of claim 21 , further wherein:

the enhanced feedback signaling includes one or more of a vibration in the left master grip, a sound played on a speaker on the left side, and a flashing of the active control border.

23. A method for minimally invasive surgery, the method comprising:

receiving a tool swap input at a tool swap input device;

swapping tool control from a first robotic surgical tool, mounted to a first right side robotic arm controlled by a right master grip of a surgeon console to a second robotic surgical tool mounted to a second right side robotic arm, in response to receiving the tool swap input at the tool swap pedal;

swapping an indicator of the first robotic tool to a tool swap icon and an indicator of the second robotic tool to a right tool type icon, the indicators and icons displayed on a graphical user interface (GUI); and

displaying an active control border and an active control icon on a right side of the GUI to provide information to a user, based on the second robotic surgical tool being a supply controllable tool.

24. The method of claim 23 , wherein:

the active control border presents the user with an enhanced feedback signaling,

the enhanced feedback signaling includes one or more of a vibration in the right master grip, a sound played on a speaker on the right side, and a flashing of the active control border.

25. The method of claim 23 , wherein:

a remote controlled supply equipment is under control of a user input device to supply the second robotic surgical tool.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2021
From: MOHR, PAUL W.; ROBINSON, DAVID; NIXON, TOM R.; HANUSCHIK, MICHAEL; GOLDBERG, RANDAL P.; BROGNA, SALVATORE J.
To: INTUITIVE SURGICAL, INC.
Reel/Frame 057764/0940 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2021
From: INTUITIVE SURGICAL, INC.
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 057765/0381 →
Continuity (3)
Division 13848224 · Mar 21, 2013
Division 12400738 · Mar 9, 2009
Related Publication 20190038335A1 · Feb 7, 2019
Cited By (49)
US 1,066,378 US 1,066,379 US 1,066,380 US 1,066,381 US 1,066,382 US 1,066,383 US 1,066,404 US 1,066,405 US 1,087,135 US 1,087,995 US 12,186,040 US 12,223,629 US 12,256,890 US 12,262,863 US 12,262,964 US 12,315,109 US 12,329,475 US 12,350,828 US 12,369,998 US 12,376,934 US 12,390,240 US 12,390,294 US 12,409,003 US 12,419,711 US 12,433,699 US 12,433,700 US 12,453,596 US 12,465,447 US 12,479,098 US 12,491,028 US 12,496,119 US 12,496,728 US 12,539,625 US 12,548,667 US 12,564,457 US 12,599,445 US 12,599,449 US 12,611,086 US 12,611,272 US 12,616,474 US 12,617,078 US 12,626,422 US 12,642,613 US 12,648,685 US 12,661,192 US 12,672,927 US 12,678,238 US 12,685,603 US 12,708,466