IP Library › Granted Patent US 11,690,678
Granted Patent B2
US 11,690,678 · App. 16/482,020 · Granted Jul 4, 2023

Systems and methods of registration for image-guided procedures

Inventor: Tao Zhao (Sunnyvale, CA)
Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
A61B34/20A61B34/35A61B1/00045A61B1/2676A61B2034/2051A61B2034/2055A61B2034/2065
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,690,678
App. No.
16/482,020
Filed
Jul 30, 2019
Granted
Jul 4, 2023
Kind
B2
Art Unit
3793
USPC
600/424
Abstract

Systems and methods for supporting image-guided procedures include a device having an instrument usable to collect location data for one or more passageways and one or more processors coupled to the instrument. The one or more processors are configured to organize a plurality of points within the location data based on a corresponding insertion depth of the instrument when each of the plurality of points is collected, create a passageway tree based on the points, identify at least three non-collinear landmark locations within the passageway tree, create a seed transformation between one or more of the at least three non-collinear landmark locations and corresponding model locations in model data, and register, using the seed transformation, the plurality of points to the model data for the one or more passageways. In some embodiments, the at least three non-collinear landmark locations are based on a main branch point in the passageway tree.

Claims (51)

1. A device, comprising:

an instrument usable to collect location data for one or more passageways; and

one or more processors coupled to the instrument;

wherein the one or more processors are configured to:

organize a plurality of points within the location data based on a corresponding insertion depth of the instrument when each of the plurality of points is collected by placing the plurality of points into bins based on ranges of insertion depth;

create a passageway tree based on the organized points;

identify at least three non-collinear landmark locations within the passageway tree;

create a seed transformation between one or more of the at least three non-collinear landmark locations and corresponding model locations in model data; and

register, using the seed transformation, the plurality of points to the model data for the one or more passageways.

2. The device of claim 1 , wherein the instrument is a flexible catheter comprising a shape sensor, wherein the location data is provided by the shape sensor.

3. The device of claim 2 , wherein the shape sensor is a fiber optic shape sensor.

4. The device of claim 1 , further comprising a tracking sensor coupled to the instrument.

5. The device of claim 1 , wherein to organize the plurality of points within the location data the one or more processors are further configured to

cluster the plurality of points within each bin based on distances between points in each of the bins.

6. The device of claim 1 , wherein to create the passageway tree the one or more processors are further configured to:

iterate through the plurality of points in descending order of insertion depth; and

create parent-child relationships between nodes of the passageway tree corresponding to the points based on distances between the points.

7. The device of claim 6 , wherein to create the passageway tree the one or more processors are further configured to link a first node corresponding to a first point as a first parent to a second node corresponding to a second point closest to the first point that also has a greater insertion depth than the first point.

8. The device of claim 6 , wherein to create the passageway tree the one or more processors are further configured to link a first node corresponding to a first point as a parent to each of a second node and a third node, the second and third node corresponding to two closest points to the first point that also have a greater insertion depth than the first point.

9. The device of claim 6 , wherein to create the passageway tree the one or more processors are further configured to create a leaf node corresponding to a first point when the first point is not within a threshold distance of any point having a greater insertion depth than the first point.

10. The device of claim 1 , wherein to identify the at least three non-collinear landmark locations within the passageway tree, the one or more processors are further configured to:

identify a main branch point in the passageway tree;

identify a first landmark location proximal to the main branch point;

identify a second landmark location distal to the main branch point in a first branch of the passageway tree distal to the main branch point; and

identify a third landmark location distal to the main branch point in a second branch of the passageway tree distal to the main branch point, the second branch being different from the first branch.

11. The device of claim 10 , wherein the one or more processors are further configured to determine a location of the main branch point based on an aggregation of the location data corresponding to each of the points within a threshold distance of the main branch point.

12. The device of claim 10 , wherein the one or more processors are further configured to determine a location of the first landmark location based on the location data corresponding to a point located at a first insertion depth proximal to the main branch point, the first insertion depth being a desired distance proximal from a second insertion depth of the main branch point.

13. The device of claim 10 , wherein the one or more processors are further configured to determine a location of the first landmark location based on an aggregation of the location data corresponding to each of the points having a first insertion depth within a range of desired distances proximal to a second insertion depth of the main branch point.

14. The device of claim 10 , wherein the one or more processors are further configured to determine a location of the second landmark location based on the location data corresponding to a point in the first branch located at a first insertion depth distal to the main branch point, the first insertion depth being a desired distance distal from a second insertion depth of the main branch point.

15. The device of claim 10 , wherein the one or more processors are further configured to determine whether the first branch is a left branch or a right branch in the passageway tree based on an order in which the first branch is traversed, steering commands of the instrument recorded when the location data is collected, one or more of an orientation angle and a length of the first branch, or a known left-right orientation of a sensor system used by the instrument to collect the location data.

16. The device of claim 10 , wherein the main branch point is a most proximal node of the passageway tree having two children.

17. The device of claim 1 , wherein the passageways correspond to airways of lungs.

18. A method of registration using one or more processors, the method comprising:

collecting a set of sensor data during insertion of a flexible elongate device within a plurality of passageways, wherein the sensor data comprises a plurality of points representing a plurality of locations of the flexible elongate device within the plurality of passageways;

organizing the plurality of points based on a corresponding insertion depth of the flexible elongate device when each of the plurality of points is collected by placing the plurality of points into bins based on ranges of insertion depth;

creating a passageway tree based on the organized points;

identifying at least three non-collinear landmark locations within the passageway tree;

creating a seed transformation between one or more of the at least three non-collinear landmark locations and corresponding model locations in model data; and

registering, using the seed transformation, the plurality of points to the model data for the plurality of passageways.

19. The method of claim 18 , wherein identifying the at least three non-collinear landmark locations comprises:

identifying a main branch point in the passageway tree;

identifying a first landmark location proximal to the main branch point;

identifying a second landmark location distal to the main branch point in a first branch of the passageway tree, wherein the first branch is distal to the main branch point; and

identifying a third landmark location distal to the main branch point in a second branch of the passageway tree, wherein the second branch is distal to the main branch point, the second branch being different from the first branch.

20. A non-transitory machine-readable medium comprising a plurality of machine-readable instructions which when executed by one or more processors associated with a device are adapted to cause the one or more processors to perform operations including:

collecting a set of sensor data during insertion of a flexible elongate device within a plurality of passageways, wherein the sensor data comprises a plurality of points representing a plurality of locations of the flexible elongate device within the plurality of passageways;

organizing the plurality of points based on a corresponding insertion depth of the flexible elongate device when each of the plurality of points is collected by placing the plurality of points into bins based on ranges of insertion depth;

creating a passageway tree based on the organized points;

identifying at least three non-collinear landmark locations within the passageway tree;

creating a seed transformation between one or more of the at least three non-collinear landmark locations and corresponding model locations in model data; and

registering, using the seed transformation, the plurality of points to the model data for the plurality of passageways.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2019
From: ZHAO, TAO
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 049903/0618 →
Continuity (2)
Provisional Application 62453401 · Feb 1, 2017
Related Publication 20200000526A1 · Jan 2, 2020
Cited By (1)
US 12,611,264