IP Library › Granted Patent US 12,517,625
Granted Patent B2
US 12,517,625 · App. 18/852,283 · Granted Jan 6, 2026

User interface interaction elements with associated degrees of freedom of motion

Inventors: Sarthak Ghosh (Sunnyvale, CA); Brandon D. Itkowitz (San Jose, CA); Paul W. Mohr (Mountain View, CA); Erik D. Wakefield (Issaquah, WA)
Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
G06F3/04815A61B34/25G06F3/0346
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,517,625
App. No.
18/852,283
Granted
Jan 6, 2026
Kind
B2
Abstract

A method may comprise displaying an interaction panel on a display device. The interaction panel having a display frame of reference and include a plurality of interaction elements. The method may also comprise constraining motion of an operator interface device to translational motion in a haptic plane with a haptic plane constraint while the interaction panel is displayed and determining a cursor position in the display frame of reference that corresponds to a position of a selection portion of the operator interface device in an operator frame of reference. The method may also comprise determining an element type for a first interaction element of the plurality of interaction elements at which the cursor position is located and removing the haptic plane constraint on the operator interface device if the element type is a three-dimensional rotation type.

Claims (33)

1 . A method comprising:

displaying an interaction panel on a display device, the interaction panel having a display frame of reference and including a plurality of interaction elements;

constraining motion of an operator interface device to translational motion in a haptic plane with a haptic plane constraint while the interaction panel is displayed;

determining a cursor position in the display frame of reference that corresponds to a position of a selection portion of the operator interface device in an operator frame of reference;

determining an element type for a first interaction element of the plurality of interaction elements at which the cursor position is located; and

removing the haptic plane constraint on the operator interface device if the element type is a three-dimensional rotation type.

2 . The method of claim 1 further comprising:

constraining rotational motion of the operator interface device with a rotational constraint while the interaction panel is displayed.

3 . The method of claim 2 further comprising:

removing the rotational constraint on the operator interface device if the element type is a three-dimensional rotation type.

4 . The method of claim 3 further comprising:

determining if the cursor position has moved off the first interaction element, and if so, restoring the haptic plane constraint and the rotational constraint on the operator interface device.

5 . The method of claim 1 further comprising:

receiving a rotational motion input from the operator interface device in the operator frame of reference.

6 . The method of claim 5 further comprising:

generating a rotational motion for the first interaction element in the display frame of reference that corresponds to the rotational motion input from the operator interface device.

7 . The method of claim 1 wherein removing the haptic plane constraint on the operator interface device is further based on receipt of a rotation signal from the operator interface device.

8 . The method of claim 7 wherein the rotation signal includes a pinch gesture on the operator interface device.

9 . The method of claim 7 wherein a marker of the cursor position disappears when the rotation signal is received.

10 . The method of claim 1 , wherein the operator interface device has a plurality of translational and rotational degrees of freedom.

11 . The method of claim 1 , wherein the interaction panel includes a menu element responsive to translational motion of an operator interface device in the haptic plane.

12 . The method of claim 1 , wherein the haptic plane constraint is generated by a restraint force provided to the operator interface device.

13 . The method of claim 1 , wherein a cursor marker may be displayed at the cursor position on the display device.

14 . The method of claim 1 , wherein the selection portion of the operator interface device is a tip portion of the operator interface device.

15 . The method of claim 1 , wherein the element type is a three-dimensional rotation type.

16 . The method of claim 1 , wherein the element type is a two-dimensional translation type, the method further comprising:

constraining motion of the operator interface device to motion in the haptic plane if the element type is a two-dimensional rotation type.

17 . The method of claim 1 , wherein the element type is a single dimension translation type, the method further comprising:

constraining motion of the operator interface device to a single translational direction in the haptic plane if the element type is a single dimension translation type.

18 . The method of claim 1 , wherein the element type is a single dimension rotation type, the method further comprising:

constraining motion of the operator interface device to rotational motion in the haptic plane if the element type is a single dimension rotation type.

19 . The method of claim 1 wherein the interaction panel is displayed on the display device while a control system is in an auxiliary mode.

20 . The method of claim 1 wherein the interaction panel is displayed over a field of view image on the display device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2024
From: GHOSH, SARTHAK; ITKOWITZ, BRANDON D.; MOHR, PAUL W.; WAKEFIELD, ERIK D.
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 068756/0005 →
Continuity (2)
Provisional Application 63326652 · Apr 1, 2022
Related Publication 20250199655A1 · Jun 19, 2025
References Cited (15)
US 12399552B2 · Noohi Bezanjani · 2025 [cited by examiner]
US 20030204364A1 · Goodwin · 2003 [cited by examiner]
US 20090036902A1 · DiMaio · 2009 [cited by examiner]
US 20160338782A1 · Bowling · 2016 [cited by examiner]
US 20170333139A1 · Suresh · 2017 [cited by examiner]
US 20190099230A1 · Suresh · 2019 [cited by examiner]
US 20190339804A1 · Gleeson · 2019 [cited by examiner]
US 20230074495A1 · Iorgulescu · 2023 [cited by examiner]
US 20240111357A1 · Noohi Bezanjani · 2024 [cited by examiner]
EP 3866174A1 · 2021 [cited by applicant]
WO WO2016077543A1 · 2016 [cited by applicant]
WO WO2021167954A1 · 2021 [cited by applicant]
International Preliminary Report on Patentability for Application No. PCT/US2023/016874, mailed Oct. 10, 2024, 08 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2023/016874, mailed Jul. 26, 2023, 13 pages. [cited by applicant]
Vertut, J., and Coiffet, P., “Robot Technology: Teleoperation and Robotics Evolution and Development,” English translation, Prentice-Hall, Inc., Inglewood Cliffs, NJ, USA 1986, vol. 3A, 332 pages. [cited by applicant]