IP Library Granted Patent US 11,911,120
Granted Patent B2
US 11,911,120 · App. 16/833,275 · Granted Feb 27, 2024

Training and feedback for a controller workspace boundary

Inventors: Anette Lia Freiin von Kapri (Mountain View, CA); Eric Mark Johnson (Mountain View, CA); Joan Savall (Palo Alto, CA)
Assignee: Verb Surgical Inc.
A61B34/25A61B34/20A61B34/37A61B34/76A61B2017/00115A61B2017/00734A61B2034/2051A61B2034/2055
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,911,120
App. No.
16/833,275
Filed
Mar 27, 2020
Granted
Feb 27, 2024
Kind
B2
Art Unit
3792
USPC
606/1
Abstract

A method of determining a location of a user input device of a surgical robotic system within a surgical workspace using a virtual workspace including determining, by one or more processors communicatively coupled to a user input device, that a user is engaging with the user input device within a surgical workspace; in response to determining the user is engaging with the user input device, displaying a virtual user input device within a first virtual workspace boundary, wherein at least a portion of the first virtual workspace boundary is operable to move in response to a movement of the user input device; displaying a second virtual workspace boundary that represents a second workspace limit beyond which the user input device is inoperable to control the surgical robotic instrument in the teleoperation mode; and determining a location of the user input device within the surgical workspace.

Claims (47)

1. A method of determining a location of a user input device of a surgical robotic system within a surgical workspace using a virtual workspace, the method comprising:

determining, by one or more processors communicatively coupled to the user input device, that a user is engaging with the user input device within a surgical workspace;

in response to determining the user is engaging with the user input device,

displaying a virtual user input device within a first virtual workspace boundary, the first virtual workspace boundary representing a first workspace limit within which the user input device is operable to control a surgical robotic instrument in a teleoperation mode, wherein at least a portion of the first virtual workspace boundary is operable to move in response to a movement of the user input device;

displaying a second virtual workspace boundary that represents a second workspace limit beyond which the user input device is inoperable to control the surgical robotic instrument in the teleoperation mode; and

determining, by the one or more processors, a location of the user input device within the surgical workspace based on a proximity of the portion of the first virtual workspace boundary relative to the second virtual workspace boundary.

2. The method of claim 1 wherein the first virtual workspace boundary comprises a first three dimensional shape and the second virtual workspace boundary comprises a second three dimensional shape that encompasses the first three dimensional shape.

3. The method of claim 2 wherein an area between the first three dimensional shape and the second three dimensional shape defines a warning zone that indicates the user input device is nearing the second workspace limit.

4. The method of claim 1 wherein the first virtual workspace boundary comprises a cube.

5. The method of claim 4 wherein the portion of the first virtual workspace boundary operable to move is a side wall of the cube.

6. The method of claim 1 wherein determining the location of the user input device within the surgical workspace comprises:

detecting that the portion of the first virtual workspace boundary has moved closer to the second virtual workspace boundary, and the method further comprises:

in response to the detecting, providing user feedback.

7. The method of claim 6 , wherein the user feedback comprises changing a visual characteristic of the first virtual workspace boundary.

8. The method of claim 1 wherein determining the location of the user input device within the surgical workspace comprises:

detecting that the portion of the first virtual workspace boundary intersects with the second virtual workspace boundary, and the method further comprises:

in response to the detecting, providing user feedback.

9. The method of claim 8 , wherein the feedback comprises changing a visual characteristic of the first virtual workspace boundary or the second virtual workspace boundary.

10. The method of claim 8 wherein the user feedback comprises at least one of an audible alert or haptic feedback.

11. The method of claim 1 wherein the user input device is an ungrounded user input device.

12. A method of determining a location of an ungrounded user input device of a surgical robotic system within a surgical workspace, the method comprising:

determining, by one or more processors communicatively coupled to the surgical robotic system, whether a user is engaging with an ungrounded user input device;

in response to determining the user is engaging with the ungrounded user input device, determining, by one or more processors communicatively coupled to the surgical robotic system, whether the ungrounded user input device is within a warning zone of the surgical workspace; and

in response to determining the user input device is within the warning zone of the surgical workspace, providing user feedback corresponding to a location of the ungrounded user input device relative to the surgical workspace.

13. The method of claim 12 wherein the surgical workspace comprises a workspace limit beyond which the ungrounded user input device is inoperable to control a surgical robotic instrument, and the warning zone of the surgical workspace comprises an area of the surgical workspace near the workspace limit.

14. The method of claim 12 wherein determining the ungrounded user input device is within the warning zone of the surgical workspace comprises:

providing a first virtual three-dimensional boundary representing an inner boundary of the warning zone;

providing a second virtual three-dimensional boundary representing a workspace limit beyond which the ungrounded user input device is inoperable to control a surgical robotic instrument, the second virtual three-dimensional boundary encompasses the first virtual three-dimensional boundary; and

determining a location of the ungrounded user input device within the surgical workspace corresponds to an area between the first virtual three-dimensional boundary and the second virtual three-dimensional boundary.

15. The method of claim 12 wherein providing user feedback comprises providing the user with information indicating the user input device is near a workspace limit of the surgical workspace.

16. The method of claim 12 wherein providing user feedback comprises providing the user with information indicating the ungrounded user input device has exceeded a workspace limit of the surgical workspace.

17. The method of claim 12 wherein the surgical workspace comprises a workspace limit defined by a plurality of sides, and providing user feedback comprises providing the user with information indicating which of the plurality of sides the ungrounded user input device is closest to.

18. The method of claim 12 wherein the ungrounded user input device is a first user input device, and the surgical robotic system further comprises a second user input device, and providing user feedback comprises providing the user with information indicating whether the first user input device or the second user input device is in the warning zone of the surgical workspace.

19. The method of claim 18 wherein the surgical workspace comprises a three-dimensional shape and providing user feedback further comprises providing the user with information indicating which side of the three-dimensional shape the first user input device or the second user input device is closest to.

20. The method of claim 17 wherein the plurality of sides define a workspace limit having a three-dimensional shape.

21. The method of claim 12 wherein the feedback comprises a visual feedback on a display of the surgical robotic system.

22. The method of claim 21 wherein the visual feedback comprises at least one icon, and a location of the at least one icon on the display indicates the location of the ungrounded user input device relative to the surgical workspace.

23. The method of claim 22 wherein the visual feedback comprises at least one icon, and a location of the at least one icon on the display indicates whether the ungrounded user input device within the warning zone is a left user input device or a right user input device.

24. The method of claim 23 wherein the visual feedback comprises the at least one icon, and a size or shape of the at least one icon changes to indicate the location of the user input device relative to the surgical workspace.

25. A method of determining a position of a user input device of a surgical robotic system within a surgical workspace based on a virtual workspace, the method comprising:

determining, by one or more processors communicatively coupled to the surgical robotic system, whether a user controlling the user input device is in at least one mode of operation selected from a training mode, a pre-usage reminder mode, and a feedback during usage mode;

in response to determining the user is in a training mode, assigning a user input device training operation to be performed within a virtual workspace boundary corresponding to the surgical workspace;

in response to determining the user is in a pre-usage reminder mode, assigning a user input device engagement operation to be performed within the virtual workspace boundary after at least one other engagement operation is performed; and

in response to determining the user is in a feedback during usage mode, determining whether the user input device is within a warning zone of the surgical workspace, and upon determining the user input device is within the warning zone, providing user feedback.

26. The method of claim 25 wherein the training mode occurs prior to a teleoperation mode in which the user input device is operable to control a surgical robotic instrument, and the user input device training operation comprises moving the user input device without exceeding the virtual workspace boundary.

27. The method of claim 25 wherein the pre-usage reminder mode occurs prior to a teleoperation mode in which the user input device is operable to control a surgical robotic instrument, and the at least one other engagement operation comprises positioning a chair of the surgical robotic system to a position suitable for teleoperation, and the user input device engagement operation comprises moving the user input device to a side of the virtual workspace boundary.

28. The method of claim 25 wherein the feedback during usage mode occurs during a teleoperation mode in which the user input device is operable to control a surgical robotic instrument, and providing feedback comprises indicating to the user (1) the user input device is nearing a side of the surgical workspace, (2) which side of the surgical workspace the user input device is closest to or (3) whether the user input device is a left user input device or a right user input device.

Assignments (2)
MERGER Recorded Jan 26, 2026
From: VERB SURGICAL INC.
To: AURIS HEALTH, INC.
Reel/Frame 073584/0300 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2020
From: FREIIN VON KAPRI, ANETTE LIA; JOHNSON, ERIC MARK; SAVALL, JOAN
To: VERB SURGICAL INC.
Reel/Frame 052250/0184 →
Continuity (1)
Related Publication 20210298845A1 · Sep 30, 2021
Cited By (20)
US 1,119,865 US 12,232,838 US 12,329,397 US 12,376,928 US 12,377,206 US 12,419,703 US 12,433,702 US 12,440,289 US 12,446,979 US 12,447,317 US 12,508,093 US 12,558,175 US 12,564,414 US 12,564,458 US 12,569,308 US 12,605,523 US 12,636,022 US 12,661,193 US 12,678,249 US 12,702,509