IP Library › Granted Patent US 12,611,270
Granted Patent B2
US 12,611,270 · App. 17/004,277 · Granted Apr 28, 2026

Control of an endoscope by a surgical robot

Inventors: Renbin Zhou (Santa Clara, CA); Seungkook Yun (Santa Clara, CA); Haoran Yu (Santa Clara, CA); Ellen Klingbeil (Santa Clara, CA); Apoorv Shrivastava (Santa Clara, CA)
Assignee: AURIS HEALTH, INC.
A61B34/35A61B34/25A61B2017/00199A61B2017/00973A61B2018/00595A61B2018/1253A61B2018/126A61B2034/2048A61B2034/2051A61B2034/2055A61B2034/301A61B2034/742
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,611,270
App. No.
17/004,277
Granted
Apr 28, 2026
Kind
B2
Abstract

An endoscope is controlled by a surgical robotic system. A user input with six degrees of freedom maps to control of an endoscope by a robotic arm having a fewer number of degrees of freedom. For example, untethered user interface devices control motion of an endoscope through a series of projections from user command, to endoscope motion, and to joint motion of the robotic arm. The projection from user command to endoscope motion may project a singular angular motion from three angular motions of the user interface devices. The projection may account for the remote center of motion and/or an angular orientation of the view of the endoscope relative to a shaft of the endoscope.

Claims (21)

1 . A method for control of an endoscope by a surgical robotic system, the method comprising:

detecting movement by a handheld user input device having six degrees of freedom;

mapping the movement by the handheld user input device to movement of the endoscope coupled to a robotic manipulator of the surgical robotic system, the mapping using projection from the six degrees of freedom of the handheld user input device limited to a fewer number of degrees of freedom of the endoscope, the projection further comprising projecting the movement by the handheld user input device from a motion command for the endoscope to a remote center of motion frame of the robotic manipulator;

calculating movements of one or more joints of the robotic manipulator to facilitate the movement of the endoscope, wherein calculating comprises projecting from the remote center of motion frame of the robotic manipulator to joint position commands for the robotic manipulator; and

driving the one or more joints according to the calculated movements.

2 . The method of claim 1 wherein the six degrees of freedom correspond to translations along three spatial dimensions and rotations about the three spatial dimensions, the one or more joints comprise four or fewer joints providing less than six degrees of freedom of the robotic manipulator as the fewer number, and wherein mapping the movement of the handheld user input device to the movement of the endoscope comprises projecting only in roll space without yaw and pitch.

3 . The method of claim 1 wherein detecting comprises detecting the movement based on change in position and/or orientation of two handheld user interface objects, the movement being at a center between the two handheld user interface objects.

4 . The method of claim 1 wherein detecting comprises detecting the movement by a base sensor where the handheld user input device comprises one or more untethered objects.

5 . The method of claim 1 wherein mapping the movement by the handheld user input device to the movement of the endoscope comprises passing linear translation and projecting angular motion as a shaft rotation of the endoscope.

6 . The method of claim 1 wherein mapping the movement by the handheld user input device to the movement of the endoscope comprises mapping an angular motion about an axis from the remote center of motion of the robotic manipulator to a control point based on a non-zero angle of a viewer of the endoscope.

7 . The method of claim 1 wherein mapping the movement by the handheld user input device to the movement of the endoscope comprises constraining the movement of the endoscope by the remote center of motion of the robotic manipulator.

8 . The method of claim 1 wherein projecting comprises removing yaw and pitch from the movement of the handheld user input device and adding yaw and pitch of the endoscope to maintain the remote center of motion.

9 . The method of claim 1 further comprising scaling a linear component of the movement of the endoscope with an amount of the scaling being based on a distance of the endoscope from the remote center of motion of the robotic manipulator.

10 . The method of claim 1 wherein calculating the movements of the one or more joints comprises performing inverse kinematics.

11 . A method for control of an endoscope by a surgical robotic system, the method comprising:

sensing input translation and rotation about three axes in space;

projecting the input rotation about the three axes to rotation about a single axis for the endoscope mounted to a robotic arm, wherein projecting the input rotation comprises projecting from the sensing to an input motion command for the endoscope;

projecting from the input motion command for the endoscope to a remote center of motion frame of the robotic arm, and projecting from the remote center of motion frame of the robotic arm to joint position commands for the robotic arm; and

controlling the robotic arm to move the endoscope based on the sensed input translation and the protected rotation about a single axis.

12 . The method of claim 11 wherein sensing comprises sensing of a first handheld, physically unconnected object in a left hand of a user and sensing a second handheld, physically unconnected object in a right hand of the user, the input translation and rotation about the three axes corresponding to six degrees of freedom at a center point between the first and second handheld, physically unconnected objects.

13 . The method of claim 11 wherein projecting from the input motion command for the endoscope to the remote center of motion frame comprises converting from an arm frame for the endoscope to the remote center of motion frame and converting back from the remote center of motion frame to the arm frame with added rotation from the remote center of motion frame.

Assignments (2)
MERGER Recorded Jan 27, 2026
From: VERB SURGICAL INC.
To: AURIS HEALTH, INC.
Reel/Frame 073601/0834 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2021
From: ZHOU, RENBIN; YUN, SEUNGKOOK; YU, HAORAN; KLINGBEIL, ELLEN; SHRIVASTAVA, APOORV
To: VERB SURGICAL INC.
Reel/Frame 056982/0781 →
Continuity (1)
Related Publication 20220061936A1 · Mar 3, 2022
References Cited (31)
US 8992422B2 · Spivey · 2015 [cited by applicant]
US 20070167679A1 · Miyamoto et al. · 2007 [cited by applicant]
US 20120039681A1 · Ishida · 2012 [cited by applicant]
US 20120316681A1 · Hagn · 2012 [cited by applicant]
US 20140039681A1 · Bowling · 2014 [cited by applicant]
US 20140316681A1 · Whitney et al. · 2014 [cited by applicant]
US 20170020615A1 · Koenig · 2017 [cited by applicant]
US 20170095295A1 · Overmyer · 2017 [cited by examiner]
US 20180036088A1 · Kilroy · 2018 [cited by examiner]
US 20190000578A1 · Yu · 2019 [cited by applicant]
US 20190125462A1 · Peine · 2019 [cited by examiner]
US 20190175286A1 · Zhou · 2019 [cited by applicant]
US 20190176334A1 · Zhou · 2019 [cited by applicant]
US 20190201142A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190320874A1 · Yu · 2019 [cited by applicant]
US 20200054401A1 · Yu · 2020 [cited by applicant]
US 20200054403A1 · Zhou · 2020 [cited by applicant]
US 20200138524A1 · Brunelli et al. · 2020 [cited by applicant]
US 20200289205A1 · Scheib et al. · 2020 [cited by applicant]
US 20200289230A1 · Denlinger · 2020 [cited by examiner]
CN 102973321A · 2013 [cited by applicant]
CN 104758012A · 2015 [cited by applicant]
CN 104758060A · 2015 [cited by applicant]
CN 106890025A · 2017 [cited by applicant]
WO 2014028558A1 · 2014 [cited by applicant]
WO 2018013965A1 · 2018 [cited by applicant]
International Search Report and the Written Opinion for International Patent Application PCT/US2020/48138 mailed Nov. 20, 2020. [cited by applicant]
De Moura, Diogo Turiani Hourneaux, Hiroyuki Aihara, and Christopher C. Thompson. “Robotic-assisted surgical endoscopy: a new era for endoluminal therapies.” VideoGIE 4.9 (2019): 399. [cited by applicant]
Mettler, L., M. Ibrahim, and W. Jonat. “One year of experience working with the aid of a robotic assistant (the voice-controlled optic holder AESOP) in gynaecological endoscopic surgery.” Human reproduction (Oxford, Eng… [cited by applicant]
European Search Report for European Application No. 20951779.6-1113 mailed Mar. 28, 2024. [cited by applicant]
Chinese Office Action for Chinese App. No. 202080103502.0 mailed Mar. 14, 2025, with English translation. [cited by applicant]