IP Library Granted Patent US 10,827,913
Granted Patent B2
US 10,827,913 · App. 16/365,507 · Granted Nov 10, 2020

Systems and methods for displaying estimated location of instrument

Inventors: Ritwik Ummalaneni (San Mateo, CA); Prasanth Jeevan (San Mateo, CA)
Assignee: Auris Health, Inc.
A61B1/05A61B5/066A61B34/20A61B2034/2051
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,827,913
App. No.
16/365,507
Granted
Nov 10, 2020
Kind
B2
Abstract

Provided are systems and methods for displaying an estimated location of an instrument. In one aspect, the method includes determining a first location of the instrument based on first location data generated by a set of one or more location sensors for the instrument, the first location data corresponding to a first time period, and after the first time period, receiving a user command to move the instrument during a second time period. The method also includes estimating a second location of the instrument based on the first location and the received user command, the estimated second location corresponding to the second time period, and confirming the estimated second location based on second location data generated by the set of location sensors. The method further includes causing the estimated second location to be displayed prior to the confirmation of the estimated second location.

Claims (89)

1. A system, comprising:

a processor; and

at least one computer-readable memory in communication with the processor and having stored thereon computer-executable instructions to cause the processor to:

determine a first location of an instrument based on first location data generated by a set of one or more location sensors for the instrument, the first location data corresponding to a first time period;

after the first time period, receive a user command to move the instrument during a second time period;

estimate a second location of the instrument based on the first location and the received user command, the estimated second location corresponding to the second time period;

confirm the estimated second location based on second location data generated by the set of location sensors, the second location data corresponding to the second time period; and

cause the estimated second location to be displayed prior to the confirmation of the estimated second location.

2. The system of claim 1 , wherein the difference between the first time period and the second time period is based on a processing period for the confirmation of the second location estimate.

3. The system of claim 1 , wherein:

the estimating of the second location has a first processing delay;

the confirming of the estimated second location has a second processing delay; and

the first processing delay is less than the second processing delay.

4. The system of claim 1 , wherein the memory further has stored thereon computer-executable instructions to cause the processor to:

estimate the first location of the instrument for the first time period; and

confirm the estimated first location based on the first location data to determine the first location.

5. The system of claim 1 , wherein the memory further has stored thereon computer-executable instructions to cause the processor to:

maintain a set of predictive states for a predicted location of the instrument, each of the predictive states associated with a corresponding probability; and

estimate the second location based on the predictive state having the highest probability for the second time period.

6. The system of claim 5 , wherein the memory further has stored thereon computer-executable instructions to cause the processor to:

adjust a speed of movement of the instrument in response to the probability of the predictive state being less than a threshold probability.

7. The system of claim 1 , wherein the memory further has stored thereon computer-executable instructions to cause the processor to:

receive second location data from set of the location sensors during the second time period, wherein the confirming of the estimated second location comprises determining the second location of the instrument based on the second location data; and

cause the estimated second location to be displayed prior to determining the second location based on the second location data.

8. The system of claim 7 , wherein the memory further has stored thereon computer-executable instructions to cause the processor to:

compare the second location to the estimated second location; and

store the second location in the memory in response to the second location being different from the estimated second location.

9. The system of claim 8 , wherein the memory further has stored thereon computer-executable instructions to cause the processor to:

estimate a third location of the instrument based on the estimated second location, the estimated third location corresponding to a third time period after the second time period; and

update the estimated third location based on the second location in response to the second location being different from the estimated second location.

10. The system of claim 1 , wherein the set of location sensors comprises at least one of an electromagnetic (EM) sensor, a shape-sensing fiber, and a camera.

11. A non-transitory computer readable storage medium having stored thereon instructions that, when executed, cause at least one computing device to:

determine a first location of an instrument based on first location data generated by a set of one or more location sensors for the instrument, the first location data corresponding to a first time period;

after the first time period, receive a user command to move the instrument during a second time period;

estimate a second location of the instrument based on the first location and the received user command, the estimated second location corresponding to the second time period;

confirm the estimated second location based on second location data generated by the set of location sensors, the second location data corresponding to the second time period; and

cause the estimated second location to be displayed prior to the confirmation of the estimated second location.

12. The non-transitory computer readable storage medium of claim 11 , wherein the difference between the first time period and the second time period is based on a processing period for the confirmation of the second location estimate.

13. The non-transitory computer readable storage medium of claim 11 , wherein:

the estimating of the second location has a first processing delay;

the confirming of the estimated second location has a second processing delay; and

the first processing delay is less than the second processing delay.

14. The non-transitory computer readable storage medium of claim 11 , further having stored thereon instructions that, when executed, cause at least one computing device to:

estimate the first location of the instrument for the first time period; and

confirm the estimated first location based on the first location data to determine the first location.

15. The non-transitory computer readable storage medium of claim 11 , further having stored thereon instructions that, when executed, cause at least one computing device to:

maintain a set of predictive states for a predicted location of the instrument, each of the predictive states associated with a corresponding probability; and

estimate the second location based on the predictive state having the highest probability for the second time period.

16. The non-transitory computer readable storage medium of claim 15 , further having stored thereon instructions that, when executed, cause at least one computing device to:

adjust a speed of movement of the instrument in response to the probability of the predictive state being less than a threshold probability.

17. The non-transitory computer readable storage medium of claim 11 , further having stored thereon instructions that, when executed, cause at least one computing device to:

receive second location data from set of the location sensors during the second time period, wherein the confirming of the estimated second location comprises determining the second location of the instrument based on the second location data; and

cause the estimated second location to be displayed prior to determining the second location based on the second location data.

18. The non-transitory computer readable storage medium of claim 17 , further having stored thereon instructions that, when executed, cause at least one computing device to:

compare the second location to the estimated second location; and

store the second location in the memory in response to the second location being different from the estimated second location.

19. The non-transitory computer readable storage medium of claim 18 , further having stored thereon instructions that, when executed, cause at least one computing device to:

estimate a third location of the instrument based on the estimated second location, the estimated third location corresponding to a third time period after the second time period; and

update the estimated third location based on the second location in response to the second location being different from the estimated second location.

20. The non-transitory computer readable storage medium of claim 11 , wherein the set of location sensors comprises at least one of an electromagnetic (EM) sensor, a shape-sensing fiber, and a camera.

21. A method of displaying an estimated location of an instrument, comprising:

determining a first location of the instrument based on first location data generated by a set of one or more location sensors for the instrument, the first location data corresponding to a first time period;

after the first time period, receiving a user command to move the instrument during a second time period;

estimating a second location of the instrument based on the first location and the received user command, the estimated second location corresponding to the second time period;

confirming the estimated second location based on second location data generated by the set of location sensors, the second location data corresponding to the second time period; and

causing the estimated second location to be displayed prior to the confirmation of the estimated second location.

22. The method of claim 21 , wherein the difference between the first time period and the second time period is based on a processing period for the confirmation of the second location estimate.

23. The method of claim 21 , wherein:

the estimating of the second location has a first processing delay;

the confirming of the estimated second location has a second processing delay; and

the first processing delay is less than the second processing delay.

24. The method of claim 21 , further comprising:

estimating the first location of the instrument for the first time period; and

confirming the estimated first location based on the first location data to determine the first location.

25. The method of claim 21 , further comprising:

maintaining a set of predictive states for a predicted location of the instrument, each of the predictive states associated with a corresponding probability; and

estimating the second location based on the predictive state having the highest probability for the second time period.

26. The method of claim 25 , further comprising:

adjusting a speed of movement of the instrument in response to the probability of the predictive state being less than a threshold probability.

27. The method of claim 21 , further comprising:

receiving second location data from set of the location sensors during the second time period, wherein the confirming of the estimated second location comprises determining the second location of the instrument based on the second location data; and

causing the estimated second location to be displayed prior to determining the second location based on the second location data.

28. The method of claim 27 , further comprising:

comparing the second location to the estimated second location; and

storing the second location in the memory in response to the second location being different from the estimated second location.

29. The method of claim 28 , further comprising:

estimating a third location of the instrument based on the estimated second location, the estimated third location corresponding to a third time period after the second time period; and

updating the estimated third location based on the second location in response to the second location being different from the estimated second location.

30. The method of claim 21 , wherein the set of location sensors comprises at least one of an electromagnetic (EM) sensor, a shape-sensing fiber, and a camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2019
From: UMMALANENI, RITWIK; JEEVAN, PRASANTH
To: AURIS HEALTH, INC.
Reel/Frame 050170/0571 →
Continuity (2)
Provisional Application 62649501 · Mar 28, 2018
Related Publication 20190298160A1 · Oct 3, 2019
Cited By (66)
US 1,095,845 US 1,119,865 US 1,121,033 US 12,201,483 US 12,226,074 US 12,232,838 US 12,243,634 US 12,251,174 US 12,251,175 US 12,251,177 US 12,256,923 US 12,257,082 US 12,268,460 US 12,290,239 US 12,303,220 US 12,310,677 US 12,311,530 US 12,318,064 US 12,318,102 US 12,318,151 US 12,324,635 US 12,324,645 US 12,329,397 US 12,357,405 US 12,357,409 US 12,364,557 US 12,370,002 US 12,376,883 US 12,376,928 US 12,377,206 US 12,383,352 US 12,390,175 US 12,390,286 US 12,419,703 US 12,433,696 US 12,433,702 US 12,440,289 US 12,446,979 US 12,447,317 US 12,478,444 US 12,508,093 US 12,527,540 US 12,539,177 US 12,544,167 US 12,551,132 US 12,558,164 US 12,558,175 US 12,564,414 US 12,564,456 US 12,564,458 US 12,569,308 US 12,575,901 US 12,582,467 US 12,599,407 US 12,605,523 US 12,636,022 US 12,636,069 US 12,636,103 US 12,642,602 US 12,642,607 US 12,648,745 US 12,661,193 US 12,672,793 US 12,678,249 US 12,702,509 US 12,702,515