IP Library Granted Patent US 11,129,602
Granted Patent B2
US 11,129,602 · App. 16/675,832 · Granted Sep 28, 2021

Systems and methods for tracking robotically controlled medical instruments

Inventors: Serena Wong (Mountain View, CA); Sean Walker (Mountain View, CA); Jason Hsu (Mountain View, CA); June Park (San Jose, CA); Neal Tanner (Burnet, TX); Kiran Murthy (Sunnyvale, CA)
Assignee: Auris Health, Inc.
A61B17/00A61B34/25A61B34/30A61B34/37A61B90/39G06T7/248A61B2017/00212A61B2034/105A61B2034/2059A61B2034/2061A61B2034/301A61B2090/3735A61B2090/3782A61B2090/3966G06T2207/30004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,129,602
App. No.
16/675,832
Filed
Nov 6, 2019
Granted
Sep 28, 2021
Kind
B2
Art Unit
2666
USPC
382/103
Abstract

Systems and methods are described herein for tracking an elongate instrument or other medical instrument in an image.

Claims (36)

1. A method of registering a tool of a robotic drive system to a fluoroscopy image of an anatomy of a patient, the method comprising:

identifying one or more distinctive elements of the tool in the fluoroscopy image, the identifying including receiving a user input via an input device coupled to a controller, wherein the input device and the controller are part of the robotic drive system, the user input including the user selecting certain marked points of the tool in the fluoroscopy image, the one or more distinctive elements being defined by the certain marked points selected by the user such that the user identifies the distinctive elements;

tracking a location of the tool of the robotic drive system using one or more sensors coupled to the tool;

comparing the distinctive elements of the tool in the fluoroscopy image to corresponding measured points of the tool to generate a registration of the tool to the fluoroscopy image; and

determining a location of the tool in the fluoroscopy image of the anatomy, based on the registration of the tool to the fluoroscopy image.

2. The method of claim 1 , wherein the one or more distinctive elements of the tool comprises one or more of a tip of the tool, a shape of tool, or an articulation band of the tool.

3. The method of claim 1 , wherein the one or more distinctive elements of the tool comprises one or more fluoroscopy markers.

4. The method of claim 3 , wherein the one or more fluoroscopy markers is positioned outside the patient.

5. The method of claim 3 , wherein the one or more fluoroscopy markers is positioned on a splayer, the splayer operatively connected to the tool.

6. The method of claim 1 , wherein the one or more sensors comprises a fiber sensor.

7. The method of claim 1 , wherein a position, an orientation, or a shape of the one or more sensors are known in relation to the tool.

8. The method of claim 1 , further comprising:

receiving a user input via an input device coupled to a controller, wherein the input device and the controller are part of the robotic drive system; and

using the location of the tool in the fluoroscopy image to permit intuitive driving of the tool using the robotic drive system.

9. The method of claim 1 , further comprising driving the tool to one or more marked points in the fluoroscopy image.

10. A method of registering a tool of a robotic drive system to a fluoroscopy image of an anatomy of a patient, the method comprising:

tracking a location of the tool of the robotic drive system using one or more sensors coupled to the tool;

comparing distinctive elements of the tool in the fluoroscopy image to corresponding measured points of the tool to generate a registration of the tool to the fluoroscopy image, the registration being generated by determining a transformation matrix that transforms one or more reference frames corresponding to the one or more sensors into a fluoroscopy reference frame;

determining a location of the tool in the fluoroscopy image of the anatomy, based on the registration of the tool to the fluoroscopy image; and

displaying a location of the tool in the fluoroscopy image of the anatomy, based on the registration of the tool to the fluoroscopy image.

11. The method of claim 10 , further comprising identifying the distinctive elements of the tool.

12. The method of claim 11 , wherein the distinctive elements of the tool comprises one or more of a tip of the tool, a shape of tool, or an articulation band of the tool.

13. The method of claim 11 , wherein the distinctive elements of the tool comprises one or more fluoroscopy markers.

14. The method of claim 13 , wherein the one or more fluoroscopy markers is positioned outside the patient.

15. The method of claim 13 , wherein the one or more fluoroscopy markers is positioned on a splayer, the splayer operatively connected to the tool.

16. The method of claim 10 , wherein the one or more sensors comprises a fiber sensor.

17. The method of claim 10 , wherein a position, an orientation, or a shape of the one or more sensors are known in relation to the tool.

18. The method of claim 10 , further comprising:

receiving a user input via an input device coupled to a controller, wherein the input device and the controller are part of the robotic drive system; and

using the location of the tool in the fluoroscopy image to permit intuitive driving of the tool using the robotic drive system.

19. The method of claim 10 , further comprising driving the tool to one or more marked points in the fluoroscopy image.

20. A method comprising:

tracking a location of a tool in a patient using one or more sensors coupled to the tool;

comparing distinctive elements of the tool in a fluoroscopy image to corresponding measured points of the tool to generate a registration of the tool to the fluoroscopy image, the fluoroscopy image including anatomy of the patient, the registration being generated by determining a transformation matrix that transforms one or more reference frames corresponding to the one or more sensors into a fluoroscopy reference frame;

determining a location of the tool in the fluoroscopy image, based on the registration of the tool to the fluoroscopy image; and

displaying a location of the tool in the fluoroscopy image, based on the registration of the tool to the fluoroscopy image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2019
From: HANSEN MEDICAL, INC.
To: AURIS HEALTH, INC.
Reel/Frame 051380/0572 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2019
From: WONG, SERENA; WALKER, SEAN; HSU, JASON; PARK, JUNE; TANNER, NEAL; MURPHY, KIRAN
To: HANSEN MEDICAL, INC.
Reel/Frame 051372/0908 →
Continuity (5)
Continuation 16165377 · Oct 19, 2018
Continuation 15649522 · Jul 13, 2017
Continuation 14663021 · Mar 19, 2015
Continuation 13835698 · Mar 15, 2013
Related Publication 20200170630A1 · Jun 4, 2020
Cited By (22)
US 1,102,447 US 1,119,865 US 12,232,711 US 12,232,838 US 12,329,397 US 12,376,928 US 12,377,206 US 12,419,703 US 12,433,702 US 12,440,289 US 12,446,979 US 12,447,317 US 12,508,093 US 12,558,175 US 12,564,414 US 12,564,458 US 12,569,308 US 12,605,523 US 12,636,022 US 12,661,193 US 12,678,249 US 12,702,509