IP Library Granted Patent US 10,881,472
Granted Patent B2
US 10,881,472 · App. 15/900,552 · Granted Jan 5, 2021

Correcting a robotic surgery user interface device tracking input

Inventors: Hasan Tutkun Sen (San Mateo, CA); Sina Nia Kosari (Fremont, CA)
Assignee: VERB SURGICAL INC.
A61B34/32A61B34/30A61B34/74B25J3/00B25J9/161B25J13/088B25J15/0019G06F3/038G06F3/0346Y10S901/02Y10S901/41Y10S901/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,881,472
App. No.
15/900,552
Granted
Jan 5, 2021
Kind
B2
Abstract

A sequence of tracking input samples that are measures of position or orientation of a user interface device, UID, being held by a user, are received. In a prediction phase, a current output sample of a state of linear quadratic estimator, LQE, is computed that is an estimate of the position or orientation of the UID. The current output sample is computed based on i) a previously computed output sample, and ii) a velocity term. In an update phase, an updated output sample of the state of the LQE is computed, based on i) a previously computed output sample from the prediction phase, and ii) a most recent tracking input sample. Other embodiments are also described and claimed.

Claims (31)

1. A method for correcting a user interface device, UID, tracking input in a robotic surgery system, the method comprising:

receiving a sequence of tracking input samples that are measures of position or orientation of a user interface device, UID, in a robotic surgery system;

in a prediction phase of a linear quadratic estimator, LQE, computing a current output sample of a state of the LQE that is an estimate of the position or orientation of the UID, wherein the current output sample is computed based on i) a previously computed output sample, and ii) a velocity term, wherein computing the current output sample comprises fitting a line to a plurality of previously computed output samples that are within a window and the velocity term comprises a slope of the line; and

in an update phase of the LQE, computing an updated output sample of the state of the LQE, based on i) a previously computed output sample from the prediction phase, and ii) a tracking input sample.

2. The method of claim 1 wherein the current output sample is computed based on a tuning parameter that adjusts a sample-to-sample time interval used in the prediction phase.

3. The method of claim 1 wherein in the update phase of the LQE, computing the updated output sample of the state of the LQE comprises computing a Kalman filter gain.

4. The method of claim 1 wherein the sequence of tracking input samples has a sampling rate that is lower than that of computing the output samples of the state of the LQE in the prediction phase.

5. The method of claim 1 wherein the UID tracking input comprises an orientation vector, and the state of the LQE is an estimate of the orientation of the UID.

6. The method of claim 1 further comprising in the prediction phase:

computing a next output sample of the state of the LQE based on i) another previously computed output sample, and ii) another velocity term, by

moving the window forward so that another plurality of previously computed output samples are within the window; and

repeating a) and b) with the moved window to compute said another velocity term.

7. The method of claim 1 wherein the sequence of tracking input samples is processed as a live stream of data and is processed in real time.

8. The method of claim 2 wherein the sample-to-sample time interval used in the prediction phase comprises a sum of i) the tuning parameter and ii) a nominal output sampling period of the LQE.

9. The method of claim 6 wherein the next output sample is computed based on a tuning parameter that adjust a sample-to-sample time interval used in the prediction phase.

10. An article of manufacture comprising:

a machine-readable medium having stored therein instructions that when executed by a processor correct a user interface device, UID, tracking input, by producing an output sequence that is an estimate of the position or the orientation of the UID, wherein the processor is to

receive a sequence of tracking input samples that are measures of position or orientation of a user interface device, UID, in a robotic surgery system,

in a prediction phase of a linear quadratic estimator, LQE, compute a current output sample of a state of the LQE that is an estimate of the position or orientation of the UID, wherein the current output sample is computed based on i) a previously computed output sample, and ii) a velocity term, wherein the processor computes the current output sample by fitting, a line to a plurality of previously computed output samples that are within a window and the velocity comprises a slope of the line, and

in an update phase of the LQE, compute an updated output sample of the state of the LQE, based on i) a previously computed output sample from the prediction phase, and ii) a tracking input sample.

11. The article of manufacture of claim 10 wherein the current output sample is computed based on a tuning parameter that adjusts a sample-to-sample time interval used in the prediction phase.

12. The article of manufacture of claim 10 wherein in the update phase of the LQE, the processor computes the updated output sample of the state of the LQE by computing a Kalman filter gain.

13. The article of manufacture of claim 10 wherein the sequence of tracking input samples has a sampling rate that is lower than that of computing the output samples of the state of the LQE in the prediction phase.

14. The article of manufacture of claim 10 wherein the UID tracking input comprises an orientation vector, and the state of the LQE is an estimate of the orientation of the UID.

15. The article of manufacture of claim 10 , wherein in the prediction phase the processor:

computes a next output sample of the state of the LQE based on i) another previously computed output sample, and ii) another velocity term, by

moving the window forward so that another plurality of previously computed output samples come within the window; and

repeating a) and b) with the moved window to compute said another velocity term.

16. The article of manufacture of claim 10 wherein the sequence of tracking input samples is processed as a live stream of data and is processed in real time.

17. The article of manufacture of claim 11 wherein the sample-to-sample time interval used in the prediction phase comprises a sum of i) the tuning parameter and ii) a nominal output sampling period of the LQE.

18. The article of manufacture of claim 15 wherein the next output sample is computed based on a tuning parameter that adjust a sample-to-sample time interval used in the prediction phase.

Assignments (5)
MERGER Recorded Jan 23, 2026
From: VERB SURGICAL INC.
To: AURIS HEALTH, INC.
Reel/Frame 073571/0754 →
RELEASE OF SECURITY INTEREST Recorded Feb 20, 2020
From: JOHNSON & JOHNSON INNOVATION - JJDC, INC.
To: VERB SURGICAL INC.
Reel/Frame 051983/0028 →
RELEASE OF SECURITY INTEREST Recorded Feb 20, 2020
From: VERILY LIFE SCIENCES LLC
To: VERB SURGICAL INC.
Reel/Frame 051986/0252 →
SECURITY INTEREST Recorded Jun 14, 2019
From: VERB SURGICAL INC.
To: JOHNSON & JOHNSON INNOVATION - JJDC, INC.; VERILY LIFE SCIENCES LLC
Reel/Frame 049474/0591 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2018
From: SEN, HASAN TUTKUN; NIA KOSARI, SINA
To: VERB SURGICAL INC.
Reel/Frame 044982/0147 →
Continuity (1)
Related Publication 20190254761A1 · Aug 22, 2019
Cited By (23)
US 1,102,447 US 1,119,865 US 12,232,838 US 12,329,397 US 12,376,928 US 12,377,206 US 12,419,703 US 12,433,702 US 12,433,704 US 12,440,289 US 12,446,979 US 12,447,317 US 12,508,093 US 12,515,322 US 12,558,175 US 12,564,414 US 12,564,458 US 12,569,308 US 12,605,523 US 12,636,022 US 12,661,193 US 12,678,249 US 12,702,509