IP Library Granted Patent US 8,548,213
Granted Patent B2
US 8,548,213 · App. 13/048,930 · Granted Oct 1, 2013

Method and system for guiding catheter detection in fluoroscopic images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,548,213
App. No.
13/048,930
Granted
Oct 1, 2013
Kind
B2
Abstract

A method and system for detecting a guiding catheter in a 2D fluoroscopic image is disclosed. A plurality of guiding catheter centerline segment candidates are detected in the fluoroscopic image. A guiding catheter centerline connecting an input guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image is detected based on the plurality of guiding catheter centerline segment candidates.

Claims (75)

1. A method for detecting a guiding catheter in a fluoroscopic image, comprising:

detecting a plurality of guiding catheter centerline segment candidates in the fluoroscopic image;

clustering the plurality of guiding catheter centerline segment candidates into a number of guiding catheter centerline segment clusters; and

detecting a guiding catheter centerline connecting a guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image by connecting a plurality of the guiding catheter centerline segment clusters.

2. The method of claim 1 , further comprising:

automatically detecting the image margin of the fluoroscopic image; and

generating a ridge map of the fluoroscopic image by ridge filtering the fluoroscopic image, where the step of detecting a plurality of guiding catheter centerline segments is constrained based on the detected image margin and the ridge map.

3. The method of claim 2 , wherein the step of automatically detecting the image margin of the fluoroscopic image comprises:

detecting the image margin of the fluoroscopic image using mean thresholding.

4. The method of claim 2 , wherein the step of generating a ridge map of the fluoroscopic image by ridge filtering the fluoroscopic image comprises:

down-sampling the fluoroscopic image; and

filtering the down-sampled fluoroscopic image using ridge filtering.

5. The method of claim 1 , wherein the step of detecting a plurality of guiding catheter centerline segment candidates in the fluoroscopic image comprises:

detecting the plurality of guiding catheter centerline segment candidates in the fluoroscopic image using a guiding catheter centerline segment detector trained based on annotated training data.

6. The method of claim 5 , wherein the guiding catheter centerline segment detector is a probabilistic boosting tree (PBT) trained using 2D Haar-like features.

7. The method of claim 1 , wherein the step of detecting a guiding catheter centerline connecting a guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image based on the plurality of guiding catheter centerline segment candidates comprises:

detecting the guiding catheter centerline connecting the guiding catheter centerline ending point with the image margin in a guiding catheter centerline ending direction.

8. The method of claim 1 , wherein the step of detecting a guiding catheter centerline connecting a guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image based on the plurality of guiding catheter centerline segment candidates comprises:

generating a graph of the guiding catheter centerline segment candidates;

generating a tree of shortest path candidates based on the graph; and

selecting one of the shortest path candidates as the guiding catheter centerline.

9. The method of claim 8 , wherein the step of generating a graph of the guiding catheter centerline segment candidates comprises:

representing each of the plurality of guiding catheter centerline segment candidates as a node in the graph;

generating edges connecting the node representing each guiding catheter centerline segment candidate with one or more nodes representing at most a predetermined number of spatially closest guiding catheter centerline segment candidates; and

calculating a pair-wise connectivity score for each edge as a sum of absolute pixel intensity differences in the fluoroscopic image along a spline arc connecting the guiding catheter centerline segment candidates represented by the nodes connected by the edge.

10. The method of claim 8 , wherein the step of generating a tree of shortest path candidates based on the graph comprises:

generating a shortest path from a node in the graph representing the guiding catheter centerline ending point through each of a plurality of nodes in the graph representing guiding catheter centerline segment candidates spatially closest to the guiding catheter centerline ending point.

11. The method of claim 8 , wherein the step of selecting one of the shortest path candidates as the guiding catheter centerline comprises:

selecting a shortest one of the shortest path candidates that connects the guiding catheter centerline ending point with the image margin and that has an orientation corresponding to a guiding catheter ending direction.

12. An apparatus for detecting a guiding catheter in a fluoroscopic image, comprising:

means for detecting a plurality of guiding catheter centerline segment candidates in the fluoroscopic image;

means for clustering the plurality of guiding catheter centerline segment candidates into a number of guiding catheter centerline segment clusters; and

means for detecting a guiding catheter centerline connecting a guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image by connecting a plurality of the guiding catheter centerline segment clusters.

13. The apparatus of claim 12 , further comprising:

means for automatically detecting the image margin of the fluoroscopic image; and

means for generating a ridge map of the fluoroscopic image by ridge filtering the fluoroscopic image, where the detecting a plurality of guiding catheter centerline segments is constrained based on the detected image margin and the ridge map.

14. The apparatus of claim 12 , wherein the means for detecting a plurality of guiding catheter centerline segment candidates in the fluoroscopic image comprises:

means for detecting the plurality of guiding catheter centerline segment candidates in the fluoroscopic image using a guiding catheter centerline segment detector trained based on annotated training data.

15. The apparatus of claim 12 , wherein the means for detecting a guiding catheter centerline connecting a guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image based on the plurality of guiding catheter centerline segment candidates comprises:

means for detecting the guiding catheter centerline connecting the guiding catheter centerline ending point with the image margin in a guiding catheter centerline ending direction.

16. The apparatus of claim 15 , wherein the means for detecting a guiding catheter centerline connecting a guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image based on the plurality of guiding catheter centerline segment candidates comprises:

means for generating a graph of the guiding catheter centerline segment candidates;

means for generating a tree of shortest path candidates based on the graph; and

means for selecting one of the shortest path candidates as the guiding catheter centerline.

17. The apparatus of claim 16 , wherein the means for generating a graph of the guiding catheter centerline segment candidates comprises:

means for representing each of the plurality of guiding catheter centerline segment candidates as a node in the graph;

means for generating edges connecting the node representing each guiding catheter centerline segment candidate with one or more nodes representing at most a predetermined number of spatially closest guiding catheter centerline segment candidates; and

means for calculating a pair-wise connectivity score for each edge as a sum of absolute pixel intensity differences in the fluoroscopic image along a spline arc connecting the guiding catheter centerline segment candidates represented by the nodes connected by the edge.

18. The apparatus of claim 16 , wherein the means for generating a tree of shortest path candidates based on the graph comprises:

means for generating a shortest path from a node in the graph representing the guiding catheter centerline ending point through each of a plurality of nodes in the graph representing guiding catheter centerline segment candidates spatially closest to the guiding catheter centerline ending point.

19. The apparatus of claim 16 , wherein the means for selecting one of the shortest path candidates as the guiding catheter centerline comprises:

means for selecting a shortest one of the shortest path candidates that connects the guiding catheter centerline ending point with the image margin and that has an orientation corresponding to a guiding catheter ending direction.

20. A non-transitory computer readable medium encoded with computer executable instructions for detecting a guiding catheter in a fluoroscopic image, the computer executable instructions defining steps comprising:

detecting a plurality of guiding catheter centerline segment candidates in the fluoroscopic image;

clustering the plurality of guiding catheter centerline segment candidates into a number of guiding catheter centerline segment clusters; and

detecting a guiding catheter centerline connecting a guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image by connecting a plurality of the guiding catheter centerline segment clusters.

21. The computer readable medium of claim 20 , further comprising computer executable instructions defining the steps of:

automatically detecting the image margin of the fluoroscopic image; and

generating a ridge map of the fluoroscopic image by ridge filtering the fluoroscopic image, where the step of detecting a plurality of guiding catheter centerline segments is constrained based on the detected image margin and the ridge map.

22. The computer readable medium of claim 20 , wherein the computer executable instructions defining the step of detecting a plurality of guiding catheter centerline segment candidates in the fluoroscopic image comprise computer executable instructions defining the step of:

detecting the plurality of guiding catheter centerline segment candidates in the fluoroscopic image using a guiding catheter centerline segment detector trained based on annotated training data.

23. The computer readable medium of claim 20 , wherein the computer executable instructions defining the step of detecting a guiding catheter centerline connecting a guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image based on the plurality of guiding catheter centerline segment candidates comprise computer executable instructions defining the step of:

detecting the guiding catheter centerline connecting the guiding catheter centerline ending point with the image margin in a guiding catheter centerline ending direction.

24. The computer readable medium of claim 20 , wherein the computer executable instructions defining the step of detecting a guiding catheter centerline connecting a guiding catheter centerline ending point in the fluoroscopic image with an image margin of the fluoroscopic image based on the plurality of guiding catheter centerline segment candidates comprise computer executable instructions defining the steps of:

generating a graph of the guiding catheter centerline segment candidates;

generating a tree of shortest path candidates based on the graph; and

selecting one of the shortest path candidates as the guiding catheter centerline.

25. The computer readable medium of claim 24 , wherein the computer executable instructions defining the step of generating a graph of the guiding catheter centerline segment candidates comprise computer executable instructions defining the steps of:

representing each of the plurality of guiding catheter centerline segment candidates as a node in the graph;

generating edges connecting the node representing each guiding catheter centerline segment candidate with one or more nodes representing at most a predetermined number of spatially closest guiding catheter centerline segment candidates; and

calculating a pair-wise connectivity score for each edge as a sum of absolute pixel intensity differences in the fluoroscopic image along a spline arc connecting the guiding catheter centerline segment candidates represented by the nodes connected by the edge.

26. The computer readable medium of claim 24 , wherein the computer executable instructions defining the step of generating a tree of shortest path candidates based on the graph comprise computer executable instructions defining the step of:

generating a shortest path from a node in the graph representing the guiding catheter centerline ending point through each of a plurality of nodes in the graph representing guiding catheter centerline segment candidates spatially closest to the guiding catheter centerline ending point.

27. The computer readable medium of claim 24 , wherein the computer executable instructions defining the step of selecting one of the shortest path candidates as the guiding catheter centerline comprise computer executable instructions defining the step of:

selecting a shortest one of the shortest path candidates that connects the guiding catheter centerline ending point with the image margin and that has an orientation corresponding to a guiding catheter ending direction.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 066088 FRAME: 0256. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2024
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 071178/0246 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066088/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2016
From: SIEMENS AKTIENGESELLSCHAFT
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 039271/0561 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2014
From: SIEMENS CORPORATION
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 032151/0103 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2011
From: WANG, PENG; CHEN, TERRENCE; COMANICIU, DORIN
To: SIEMENS CORPORATION
Reel/Frame 026208/0153 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2011
From: WELS, MICHAEL; PRUMMER, SIMONE
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 026208/0178 →