Graphical user guidance for a robotic surgical system
Graphical user guidance for a robotic surgical system is provided. In one embodiment, a graphical user interface for a robotic surgical system comprises a first region and a second region. The first region is used to display an endoscopic view of a surgical site inside a patient taken by an endoscopic camera of the robotic surgical system, and the second region is used to display user feedback information. The graphical user interface overlays a guidance message on top of the endoscopic view of the surgical site in the first region to provide user instructions for interacting with a user input device to engage a robotic arm of the robotic surgical system. Other embodiments are provided.
1. A method for a robotic surgical system, the method comprising:
performing the following in a robotic surgical system comprising a robotic arm, a user input device, and a display device:
displaying, in a first region of a graphical user interface on the display device, an endoscopic view of a surgical site inside a patient taken by an endoscopic camera of the robotic surgical system;
determining whether data to be displayed in the graphical user interface is (i) a guidance message that shows user instructions, the shown user instructions being for how the user is to interact with the user input device to engage the robotic arm or (ii) user feedback information about operation of the robotic surgical system;
in response to determining that the data to be displayed in the graphical user interface is the guidance message, overlaying the guidance message on top of the endoscopic view of the surgical site in the first region; and
in response to determining that the data to be displayed in the graphical user interface is the user feedback information, displaying the user feedback information in a second region.
2. The method of claim 1 , wherein the user input device comprises a handheld user input device configured to remotely control the robotic arm, and wherein the guidance message instructs a user to match a grip of the handheld user input device with a grip of the robotic arm.
3. The method of claim 2 , wherein the guidance message comprises a graphic that changes as the grip of the user input device changes.
4. The method of claim 1 , wherein the user input device comprises a foot-operated control, and wherein the guidance message comprises text that instructs a user to press the foot-operated control.
5. The method of claim 1 , wherein the user feedback information displayed in the second region comprises one or more of the following: an error, a warning, an alert, or a notification.
6. The method of claim 1 , wherein the user feedback information displayed in the second region comprises one or more of the following: information on an energy level applied by engaging the user input device, a warning that the user input device is approaching a workspace limit, a message that the user input device has exceeded a workspace limit, a message that a rotation limit has been reached, a message that eye contact has been lost, and a message that the user input device has been dropped.
7. The method of claim 1 , further comprising displaying an application in the second region.
8. The method of claim 7 , further comprising swapping the display of the endoscopic view of the surgical site and the display of the application between the first and second regions.
9. A method for a robotic surgical system, the method comprising:
displaying, in a first region of a display device, a view of a surgical site inside a patient taken by an image capture device of the robotic surgical system;
displaying, in a second region of the display device, user feedback information about control of the robotic arm in response to a user input device; and
overlaying a guidance message on top of the view of the surgical site in the first region, wherein the guidance message shows user instructions for interacting with the user input device to transition from not engaged to engaged with a robotic surgical instrument of the robotic surgical system, wherein only guidance messages are overlaid on top of the view of the surgical site.
10. The method of claim 9 , wherein the guidance message instructs a user to match a grip of the user input device with a grip of the robotic surgical instrument.
11. The method of claim 10 , wherein overlaying comprises overlaying the guidance message as a graphic that changes as the grip of the user input device changes.
12. The method of claim 9 , wherein the guidance message instructs a user to press a foot-operated control.
13. The method of claim 9 , wherein the user feedback information displayed in the second region comprises one or more of the following: an error, a warning, an alert, or a notification.
14. The method of claim 9 , wherein the user feedback information displayed in the second region comprises one or more of the following: information on an energy level applied by engaging the user input device, a warning that the user input device is approaching a workspace limit, a message that the user input device has exceeded a workspace limit, a message that a rotation limit has been reached, a message that eye contact has been lost, and a message that one of the user input device has been dropped.
15. The method of claim 9 , further comprising displaying an application in the second region.
16. A method for a robotic surgical system, the method comprising:
displaying a graphical user interface, wherein the graphical user interface comprises a first region displaying a view of a surgical site with a surgical instrument inside a patient taken by an endoscopic camera of the robotic surgical system and a second region;
displaying user feedback information about control of a robotic arm or the surgical instrument in response to a user input device in the second region; and
overlaying a guidance message on top of the view of the surgical site in the first region, wherein the guidance message shows user instructions for interacting with the user input device to engage the robotic arm connected with the surgical instrument of the robotic surgical system, the engagement being a transition from a non-engaged state where the user input device does not control the robotic arm.
17. The method of claim 16 , wherein overlaying comprises overlaying the guidance message as an instruction to a user to match a grip of the user input device with a grip of the robotic arm.
18. The method of claim 17 , wherein the guidance message is a graphic that changes as the grip of the user input device changes.
19. The method of claim 17 , wherein overlaying comprises overlaying the guidance message as an instruction to a user to press a foot-operated control.
20. The method of claim 16 , wherein displaying the user feedback information comprises displaying the user feedback information as one or more of the following: an error, a warning, an alert, or a notification.