IP Library Granted Patent US 12,433,704
Granted Patent B2
US 12,433,704 · App. 18/408,332 · Granted Oct 7, 2025

Correcting a robotic surgery user interface device tracking input

Inventors: Hasan Tutkun Sen (San Mateo, CA); Sina Nia Kosari (Fremont, CA)
Assignee: Verb Surgical Inc.
A61B34/32A61B34/30A61B34/74B25J3/00B25J9/161B25J13/088B25J15/0019G06F3/0346G06F3/038Y10S901/02Y10S901/41Y10S901/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,433,704
App. No.
18/408,332
Granted
Oct 7, 2025
Kind
B2
Abstract

A sequence of input samples that are measures of position or orientation of an input device being held by a user are received. A current output sample of a state of linear quadratic estimator, LQE, is computed that is an estimate of the position or orientation of the input device. The current output sample is computed based on i) a previously computed output sample, and ii) a velocity term. An updated output sample of the state of the LQE is computed, based on i) a previously computed output sample, and ii) a new input sample. Other embodiments are also described and claimed.

Claims (29)

1. A method comprising:

receiving an input sequence of input samples that track a changing position or orientation of an input device of a robotic surgery system,

computing a current output sample, wherein the current output sample is computed based on i) a previously computed output sample, and ii) a velocity term that comprises a slope of a line fitted to a plurality of previously computed output samples, and

when an input sample is received, computing a new output sample based on i) a previously computed output sample, and ii) the input sample;

producing an output sequence that includes the current output sample and the new output sample; and

translating, by a feedback control system controller, the output sequence into actuator commands of a surgical robotic arm to which a surgical tool is attached so that the surgical tool mimics the changing position or orientation of the input device.

2. The method of claim 1 wherein when the input sample is received, the new output sample is computed by computing a Kalman filter gain.

3. The method of claim 1 wherein the input sequence comprises a sequence of orientation vectors, and the output sequence comprises an estimate of orientation of the input device.

4. The method of claim 1 wherein the current output sample is computed while the input sample has not been received, from a window of a plurality of previously computed output samples.

5. The method of claim 4 further comprising

wherein while the input sample has not been received, computing a next output sample based on i) another previously computed output sample, and ii) another velocity term, by

moving the window forward so that another plurality of previously computed output samples are within the window, and

fitting a line to said another plurality of previously computed output samples and taking a derivative of the line to compute said another velocity term.

6. The method of claim 4 wherein when the input sample is received the new output sample is computed using the previously computed output sample, the input sample, and not a velocity term.

7. The method of claim 1 wherein when the input sample is received the new output sample is computed using the previously computed output sample, the input sample, and not a velocity term.

8. An article of manufacture comprising a machine-readable medium having stored therein instructions that when executed by a processor of a robotic surgery system:

receive an input sequence of input samples that are measures of a changing position or orientation of an input device;

compute a current output sample based on i) a previously computed output sample, and ii) a velocity term that comprises a slope of a line fitted to a plurality of previously computed output samples;

when an input sample is received, compute a new output sample based on i) a previously computed output sample, and ii) the input sample;

produce an output sequence that includes the current output sample and the new output sample; and

translating the output sequence into actuator commands of a surgical robotic arm to which a surgical tool is attached so that the surgical tool mimics the changing position or orientation of the input device.

9. The article of manufacture of claim 8 wherein when the input sample is received, the new output sample is computed by computing a Kalman filter gain.

10. The article of manufacture of claim 8 wherein the input sequence comprises a sequence of orientation vectors, and the output sequence comprises an estimate of orientation of the input device.

11. The article of manufacture of claim 8 wherein the current output sample is computed while the input sample has not been received, from a window of a plurality of previously computed output samples.

12. The article of manufacture of claim 11 wherein the machine-readable medium has stored there further instructions that configure the processor to, while the input sample has not been received, compute a next output sample based on i) another previously computed output sample, and ii) another velocity term, by:

moving the window forward so that another plurality of previously computed output samples are within the window, and

fitting a line to said another plurality of previously computed output samples and taking a derivative of the line to compute said another velocity term.

13. The article of manufacture of claim 11 wherein when the input sample is received the new output sample is computed using the previously computed output sample, the input sample, and not a velocity term.

14. The article of manufacture of claim 8 wherein when the input sample is received the new output sample is computed using the previously computed output sample, the input sample, and not a velocity term.

Assignments (1)
MERGER Recorded Jan 23, 2026
From: VERB SURGICAL INC.
To: AURIS HEALTH, INC.
Reel/Frame 073571/0754 →
Continuity (4)
Continuation 17878670 · Aug 1, 2022
Continuation 17110928 · Dec 3, 2020
Division 15900552 · Feb 20, 2018
Related Publication 20240216088A1 · Jul 4, 2024
References Cited (57)
US 4442404A · Bergmann · 1984 [cited by applicant]
US 7453227B2 · Prisco et al. · 2008 [cited by applicant]
US 8073528B2 · Zhao et al. · 2011 [cited by applicant]
US 8079950B2 · Stern et al. · 2011 [cited by applicant]
US 8287522B2 · Moses et al. · 2012 [cited by applicant]
US 8613724B2 · Lanier et al. · 2013 [cited by applicant]
US 8996169B2 · Lightcap et al. · 2015 [cited by applicant]
US 9220917B2 · Boyden et al. · 2015 [cited by applicant]
US 9296104B2 · Swarup et al. · 2016 [cited by applicant]
US 9727963B2 · Mintz et al. · 2017 [cited by applicant]
US 9861447B2 · Hourtash et al. · 2018 [cited by applicant]
US 10881472B2 · Sen · 2021 [cited by examiner]
US 11071441B2 · Yu et al. · 2021 [cited by applicant]
US 11076918B2 · Quaid, III · 2021 [cited by applicant]
US 11413101B2 · Sen · 2022 [cited by examiner]
US 11883119B2 · Sen · 2024 [cited by examiner]
US 20060142657A1 · Quaid et al. · 2006 [cited by applicant]
US 20060187305A1 · Trivedi · 2006 [cited by examiner]
US 20060258938A1 · Hoffman et al. · 2006 [cited by applicant]
US 20070138992A1 · Prisco · 2007 [cited by examiner]
US 20070252550A1 · Takaishi · 2007 [cited by applicant]
US 20120041263A1 · Sholev · 2012 [cited by applicant]
US 20130064427A1 · Picard et al. · 2013 [cited by applicant]
US 20130218340A1 · Hager et al. · 2013 [cited by applicant]
US 20140249654A1 · Blevins et al. · 2014 [cited by applicant]
US 20150018841A1 · Seo · 2015 [cited by applicant]
US 20150164609A1 · Wu · 2015 [cited by applicant]
US 20160025756A1 · Pollack et al. · 2016 [cited by applicant]
US 20170036346A1 · Kamioka · 2017 [cited by applicant]
US 20170084027A1 · Mintz et al. · 2017 [cited by applicant]
US 20170252111A1 · Wu · 2017 [cited by applicant]
US 20180232048A1 · Popovich et al. · 2018 [cited by applicant]
US 20190041634A1 · Popovich et al. · 2019 [cited by applicant]
US 20190095644A1 · Park et al. · 2019 [cited by applicant]
US 20190380794A1 · Al et al. · 2019 [cited by applicant]
WO 2006091494A1 · 2006 [cited by applicant]
WO 2007136768A2 · 2007 [cited by applicant]
Application of Unscented Kalman Filter to a cable driven surgical robot: A simulation study, by Srikrishnan Ramadurai, Sina Nia Kosari, H. Hawkeye King, Howard Jay Chizeck and Blake Hannaford; International Conference o… [cited by applicant]
Aravind, M.A., et al. “Optimal Position Control of a DC Motor Using LQG with EKF,” 2017 International Conference on Mechanical, System and Control Engineering, 2017, pp. 149-154. [cited by applicant]
Eom, Ki Hwan, “Improved Kalman Filter Method for Measurement Noise Reduction in Multi Sensor RFID Systems,” Sensors, vol. 11, Oct. 28, 2011, 10266-10282. [cited by applicant]
Extended European Search Report for European Application No. 18907327.3 mailed Sep. 29, 2021, 11 pages. [cited by applicant]
Gudpati, Mounika S.K., “Application of Kalman Filter to Estimate Position of a Mobile Node in Indoor Environments,” May 2017, 55 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2018/019774 mailed Sep. 3, 2020, 6 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2018/019774 mailed Nov. 13, 2018, 10 pages. [cited by applicant]
Kalman, R.E., “A New Approach to Linear Filtering and Predication Problems,” Transactions of the ASME—Journal or Basic Engineering, 82(Scrics D), Jan, 1, 2960, 12 pages. [cited by applicant]
Mounika S. K. Gudipati, Application of Kalman Filter to Estimate Position of a Mobile Node in Indoor Environments, 55 pages (Year: 2017). [cited by applicant]
Negenborn, Rudy, “Robot Localization and Kalman Filters on Finding your position in a noisy world,” A thesis submitted to the Institute of Information and Computing Sciences in partial fulfillment of the requirements fo… [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/900,552, mailed on Apr. 7, 2020, 13 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 17/878,670, mailed on Jun. 12, 2023, 27 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/110,928, mailed on Mar. 25, 2022, 31 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 17/878,670, mailed on Sep. 20, 2023, 10 pages. [cited by applicant]
Ramadurai, Srikrishnan, et al., “Application of Unscented Kalman Filter to a Cable Driven Surgical Robot: A Simulation Study,” 2012 IEEE International Conference on Robotics and Automation, May 14, 2012, pp. 1495-1500. [cited by applicant]
Requirement for Restriction/Election received for U.S. Appl. No. 15/900,552, mailed on Feb. 10, 2020, 10 pages. [cited by applicant]
Requirement for Restriction/Election received for U.S. Appl. No. 17/110,928, mailed on Feb. 4, 2022, 9 pages. [cited by applicant]
Shala, Ubejd, et al., “Indoor Positioning using Sensor-fusion in Android Devices,” Sep. 2011, 58 pages. [cited by applicant]
Tully, Stephen, et al, “Inequality Constrained Kalman Filtering for the Localization and Registration of a Surgical Robot,” Intelligent Robots and Systems (IROS), 2011 IEEE/RSJ International Conference on, Sep. 1, 2011,… [cited by applicant]
Wang, Yuguan, ct aL, “Filling the Gap between Low Frequency Measurements with Their Estimates,” Robotics and Automation (ICRA), 2014 IEEE International Conference on, May 31, 2014, 6 pages. [cited by applicant]