IP Library Granted Patent US 11,478,312
Granted Patent B2
US 11,478,312 · App. 16/409,620 · Granted Oct 25, 2022

Unmatching/matching UID to robot grasper for engaging teleoperation

Inventors: Ellen Klingbeil (Mountain View, CA); Haoran Yu (Milpitas, CA)
Assignee: VERB SURGICAL INC.
A61B34/35A61B17/28G16H40/67A61B2017/00199A61B2017/00216A61B2017/00973A61B2034/252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,478,312
App. No.
16/409,620
Granted
Oct 25, 2022
Kind
B2
Abstract

A surgical robotic system has a robotic grasper, a user interface device (UID), and one or more processors communicatively coupled to the UID and the robotic grasper. The system detects a directive to engage or re-engage a teleoperation mode, determines that the system is in a non-teleoperation mode, receives a sequence of user actions through the UID, determines the UID matches a jaw angle or a grip force of the robotic grasper, and transitions into teleoperation mode. Other embodiments are also described and claimed.

Claims (54)

1. A surgical robotic system comprising:

a robotic grasper having two jaws;

a user interface device (UID); and

one or more processors communicatively coupled to the UID and the robotic grasper and configured to control operation of the robotic grasper in accordance with user input from the UID while teleoperation mode is engaged, prevent the UID from controlling the robotic grasper while the system is in a non-teleoperation mode, and perform the following operations while the system is in the non-teleoperation mode:

detect a directive to engage or re-engage the teleoperation mode;

receive a sequence of detected user actions through the UID;

determine that, as a result of the sequence of detected user actions, the UID matches a jaw angle between the two jaws or a grip force affected by the two jaws of the robotic grasper; and

transition the surgical robotic system into the teleoperation mode, responsive to determination that the UID matches the jaw angle or the grip force.

2. The surgical robotic system of claim 1 , wherein the directive to engage or re-engage the teleoperation mode is indicated by at least one of the UID being removed from a dock by a user, focusing of a user gaze on a display of a user console, or a pedal action by a user.

3. The surgical robotic system of claim 1 , wherein:

the non-teleoperation mode includes one of disengaged mode or pause mode;

wherein the disengaged mode is with the UID disengaged from controlling the robotic grasper, prior to a teleoperation session; and

the pause mode is with the UID disengaged from controlling the robotic grasper to pause a teleoperation session.

4. The surgical robotic system of claim 1 , wherein the sequence of detected user actions includes opening the UID, closing the UID, and opening the UID until the UID and the robotic grasper match.

5. The surgical robotic system of claim 1 , wherein to determine the UID matches and to transition the surgical robotic system into the teleoperation mode, the one or more processors are further configured to operate a state machine comprising:

an unmatching open state for waiting for the UID to open, transitioning to an unmatching close state when the UID is open and starts to close;

the unmatching close state for waiting for the UID to close, transitioning to a matching state when the UID is closed and starts to open;

the matching state for waiting for the UID to match the robotic grasper, transitioning to a matched state when the UID matches the robotic grasper; and

the matched state for when the UID matches the robotic grasper, and for the transition into the teleoperation mode.

6. The surgical robotic system of claim 1 , wherein the one or more processors are further configured to:

determine that the surgical robotic system is in a pause mode;

receive a user action to match the UID and the robotic grasper; and

transition the surgical robotic system into the teleoperation mode.

7. The surgical robotic system of claim 1 , wherein the one or more processors are further configured to:

provide a guidance on the sequence of detected user actions.

8. The surgical robotic system of claim 1 , wherein the one or more processors are further configured to:

display an indication of a match state, responsive to determining the UID matches the jaw angle or the grip force.

9. A method of re-engaging teleoperation for a surgical robotic system, the method comprising the following operations while the system is in a non-teleoperation mode, wherein in the non-teleoperation mode, a robotic grasper is not being controlled by the system to follow a user interface device, UID, of the system:

detecting, by one or more processors communicatively coupled to the UID and to the robotic grasper, a directive to re-engage teleoperation;

executing, by the one or more processors, a state machine having a plurality of states;

receiving a sequence of user actions through the UID that cause the state machine to transition between the plurality of states; and

responsive to determining that the state machine has reached a state corresponding to the UID matching a jaw angle or a grip force of the robotic grasper, engaging the surgical robotic system in teleoperation.

10. The method of claim 9 , wherein the plurality of states comprises a matching state for waiting for the UID to match the robotic grasper.

11. The method of claim 9 , wherein the plurality of states comprises a matched state for when the UID matches the robotic grasper.

12. The method of claim 9 , wherein the executing the state machine comprises transitioning from a first state for waiting for the UID to match the robotic grasper to a second state for when the UID matches the robotic grasper, responsive to the UID matching the robotic grasper.

13. The method of claim 12 , wherein the sequence of user actions that result in transitioning from the first state to the second state are when the user is squeezing a UID grasper linkage or deformable surface.

14. A method for engaging teleoperation of a surgical robotic system, performed by the surgical robotic system, the method comprising the following operations while the surgical robotic system is not in a teleoperation mode, wherein in the teleoperation mode, a robotic end effector is controlled by user inputs received from a user input device (UID):

detecting a directive to engage the teleoperation mode;

receiving a sequence of user actions through the UID;

determining that, as a result of the sequence of user actions, the UID matches a position of, or a grip force affected by, the robotic end effector; and

transitioning the surgical robotic system into the teleoperation mode, as a result of the determining the UID matches the position or the grip force of the robotic end effector.

15. The method of claim 14 , wherein the detecting the directive to engage or re-engage the teleoperation mode comprises detecting at least one of a clutch release by a user, the UID being removed from a dock, focusing of a user gaze on a display of a user console, or pedal action.

16. The method of claim 14 , wherein:

the surgical robotic system not in the teleoperation mode includes one of disengaged mode or pause mode;

the disengaged mode is when the system performs an elaborate process before enabling teleoperation; and

the pause mode is when the system performs a simple process before enabling teleoperation.

17. The method of claim 14 , wherein the sequence of user actions includes opening the UID, closing the UID, and opening the UID until the UID and the robotic end effector match.

18. The method of claim 14 , further comprising:

receiving a user action to match the UID and the robotic end effector, while the surgical robotic system is in a pause mode; and then

transitioning the surgical robotic system from the pause mode into the teleoperation mode.

19. The method of claim 14 , further comprising:

providing a guidance on the sequence of user actions.

20. The method of claim 14 , further comprising:

displaying an indication of the transitioning the surgical robotic system into the teleoperation mode.

Assignments (5)
MERGER Recorded Jan 26, 2026
From: VERB SURGICAL INC.
To: AURIS HEALTH, INC.
Reel/Frame 073583/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2021
From: KLINGBEIL, ELLEN; YU, HAORAN
To: VERB SURGICAL INC.
Reel/Frame 057805/0829 →
RELEASE OF SECURITY INTEREST Recorded Feb 20, 2020
From: JOHNSON & JOHNSON INNOVATION - JJDC, INC.
To: VERB SURGICAL INC.
Reel/Frame 051983/0028 →
RELEASE OF SECURITY INTEREST Recorded Feb 20, 2020
From: VERILY LIFE SCIENCES LLC
To: VERB SURGICAL INC.
Reel/Frame 051986/0252 →
SECURITY INTEREST Recorded Jun 14, 2019
From: VERB SURGICAL INC.
To: JOHNSON & JOHNSON INNOVATION - JJDC, INC.; VERILY LIFE SCIENCES LLC
Reel/Frame 049474/0591 →
Continuity (1)
Related Publication 20200352663A1 · Nov 12, 2020
Cited By (1)
US 12,358,136