IP Library › Granted Patent US 11,957,446
Granted Patent B2
US 11,957,446 · App. 17/097,998 · Granted Apr 16, 2024

System and method for medical instrument navigation and targeting

Inventors: Hedyeh Rafii-Tari (Mountain View, CA); Prasanth Jeevan (San Mateo, CA); Douglas T. Boyd (Soquel, CA); Melissa A. Teran (Redwood City, CA); Alexander James Sheehy (Redwood City, CA); Nicolas E. Robert (San Leandro, CA); Miroslav Drahos (Freehold, NJ); Jeffery D. Howard (San Francisco, CA); Andrew Esbenshade Zeldis (Berkeley, CA); René Ango Mambembe (Nantes, FR)
Assignee: Auris Health, Inc.
A61B5/066A61B34/20A61B34/25A61B34/30A61B34/74A61B2017/00809A61B2034/105A61B2034/107A61B2034/2051A61B2034/2059A61B2034/2061A61B2034/2065A61B2034/256A61B2034/258A61B2034/301A61B2090/306A61B2090/309A61B2090/3614A61B2090/365A61B2090/368A61B90/37A61B2090/372A61B2090/376A61B2090/3762A61B2090/502A61B2217/005A61B2217/007
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,957,446
App. No.
17/097,998
Filed
Nov 13, 2020
Granted
Apr 16, 2024
Kind
B2
Art Unit
3798
USPC
600/424
Abstract

Certain aspects relate to systems and techniques for medical instrument navigation and targeting. In one aspect, a system includes a medical instrument having an elongate body and at least one sensor, a display, a processor, and a memory storing a model of a mapped portion of a luminal network and a position of a target with respect to the model. The processor may be configured to: determine, based on data from the at least one sensor, a position and orientation of a distal end of the medical instrument with respect to the model, and cause, on at least a portion of the display, a rendering of the model, the position of the target, and the position and orientation of the distal end of the medical instrument. The rendering may be based on a viewpoint directed at the target and different from a viewpoint of the medical instrument.

Claims (65)

1. A method of navigating a medical instrument, comprising:

determining, based on data received from at least one sensor of the medical instrument, a position and orientation of a distal end of the medical instrument with respect to a model of a mapped portion of a luminal network;

causing, on at least a portion of a display, a rendering of the model, a position of an object with respect to the model, and the position and orientation of the distal end of the medical instrument, wherein the rendering is based on a viewpoint directed at the object and different from a viewpoint of the medical instrument; and

causing, on at least a portion of the display, a rendering of a modified view, wherein the modified view comprises a rotated view of the model, the position of the object, and the position and orientation of the distal end of the medical instrument, with the object as a center of rotation.

2. The method of claim 1 , further comprising:

receiving, via a user input element, a first type of user interaction with the user input element; and

generating a first type of rendering instruction based on the first type of user interaction with the user input element;

wherein the rendering of the modified view is generated in response to the first type of rendering instruction.

3. The method of claim 2 , wherein the first type of rendering instruction comprises a rotation instruction to rotate the viewpoint directed at the object.

4. The method of claim 2 , further comprising:

receiving, via the user input element, a second type of user interaction with the user input element;

generating a second type of rendering instruction based on the second type of user interaction with the user input element, the second type of rendering instruction comprising an elevation instruction to alter a view angle between a reference plane centered at the object and the viewpoint directed at the object; and

in response to generating the second type of rendering instruction, causing within the portion of the display a rendering of the model having an altered angle between the reference plane and the viewpoint directed at the object.

5. The method of claim 4 , wherein:

the user input element comprises a button,

the first type of user interaction comprises an actuation of the button for greater than a threshold period of time; and

the second type of user interaction comprises an actuation of the button for less than the threshold period of time.

6. The method of claim 2 , further comprising:

receiving, via the user input element, a second type of user interaction with the user input element;

generating a second type of rendering instruction based on the second type of user interaction with the user input element; and

in response to the second type of rendering instruction, causing, on at least a portion of the display, a rendering of a toggled view of the model;

wherein:

the second type of rendering instruction comprising a toggle perspective instruction to toggle the viewpoint of the rendering between the viewpoint different from the viewpoint of the medical instrument to the viewpoint of the medical instrument; and

the toggled view comprises a rendering of the model from the viewpoint of the medical instrument.

7. The method of claim 1 , further comprising:

causing, based on the position and orientation of the distal end of the medical instrument, a rendering of a graphical indicator extending from the distal end of the medical instrument in an insertion direction of the medical instrument;

determining, based on the data from the at least one sensor, a change in at least one of the position and orientation of the distal end of the medical instrument;

determining, in response to determining the change in at least one of the position and orientation of the distal end of the medical instrument, that the graphical indicator intersects the object; and

causing a rendering of a change to the graphical indicator in response to said determining that the graphical indicator intersects the object.

8. The method of claim 1 , further comprising:

determining, based on the data from the at least one sensor, that the distal end of the medical instrument is within a threshold distance from the object; and

causing a rendering of a graphical indicator in response to the determining that the distal end of the medical instrument is within a threshold distance from the object, the graphical indicator extending from the distal end of the medical instrument in an insertion direction of the medical instrument.

9. The method of claim 8 , wherein the graphical indicator is selected from: a line, a cylinder, or a cone.

10. The method of claim 8 , wherein the graphical indicator is a cone, an aperture of the cone being based on an estimated error range of the orientation of the distal end of the medical instrument.

11. The method of claim 8 , further comprising:

determining, in response to determining a change in at least one of the position and orientation of the distal end of the medical instrument, that the graphical indicator intersects a center of the object; and

causing a rendering of a change in color of the graphical indicator in response to said determining that the graphical indicator intersects the center of the object.

12. The method of claim 11 , wherein the object comprises a main body portion and a secondary body portion joined to the main body portion, the main body portion having a larger volume than the secondary body portion, and the center of the object defined with respect to a center of the main body portion.

13. The method of claim 1 , wherein:

the model comprises a skeleton comprising a plurality of segments, wherein each of the segments is defined with respect to a center line of a corresponding lumen of the mapped portion of the luminal network; and

the method further comprises:

identifying a segment in which the distal end of the medical instrument is located;

determining a depth of the distal end of the medical instrument along the identified segment; and

determining the position of the distal end of the medical instrument based on the identified segment and the depth.

14. The method of claim 13 , further comprising determining a distance between the distal end of the medical instrument and the object based on the determined position of the distal end of the medical instrument and the position of the object.

15. The method of claim 13 , further comprising causing, on at least another portion of the display, a rendering of the position of the distal end of the medical instrument based on the determined position of the distal end of the medical instrument.

16. The method of claim 13 , further comprising:

determining that the position of the distal end of the medical instrument is within a volume defined by the model; and

restricting the determined position of the distal end of the medical instrument to be located along the skeleton.

17. The method of claim 13 , wherein:

the at least one sensor comprises one of: an electromagnetic (EM) sensor or a shape sensing fiber; and

said determining the position is based solely on data received from one of the EM sensor or the shape sensing fiber.

18. A method of navigating a medical instrument, comprising:

accessing a virtual model of an anatomical luminal network;

determining a real-time position of a medical instrument;

registering the real-time position of the medical instrument to the virtual model;

generating first graphical interface data representing a first rendering including a first plurality of views, the first plurality of views including a first view of the virtual model, a position of an object with respect to the virtual model, and the position of the medical instrument, the first view being associated with a viewpoint directed at the object and different from a viewpoint of the medical instrument; and

generating second graphical interface data representing a modified view that comprises a rotated view of the virtual model, the position of the object, and the position of the medical instrument, with the object as a center of rotation.

19. The method of claim 18 , further comprising:

receiving a first signal indicating a user interaction with a button of a user input device; and

in response to the first signal, generating second graphical interface data representing a second rendering including a second plurality of views.

20. The method of claim 19 , wherein said generating the second graphical interface data is based at least in part on a type of the user interaction, the user interaction being one of:

an actuation of the button for a greater than a first threshold period of time;

an actuation of the button for less than the first threshold period of time; or

an actuation of the button twice within a second threshold period of time.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2023
From: HOWARD, JEFFERY D.; ZELDIS, ANDREW ESBENSHADE; MAMBEMBE, RENÉ ANGO
To: MATTER INC.
Reel/Frame 065480/0429 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2023
From: MATTER INC.
To: AURIS HEALTH, INC.
Reel/Frame 065480/0527 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2023
From: RAFII-TARI, HEDYEH; JEEVAN, PRASANTH; BOYD, DOUGLAS T.; TERAN, MELISSA A.; SHEEHY, ALEXANDER JAMES; ROBERT, NICOLAS E.; DRAHOS, MIROSLAV
To: AURIS HEALTH, INC.
Reel/Frame 065480/0694 →
Continuity (3)
Continuation 16212495 · Dec 6, 2018
Provisional Application 62596710 · Dec 8, 2017
Related Publication 20210059559A1 · Mar 4, 2021
Cited By (1)
US 12,672,793