IP Library Granted Patent US 8,428,316
Granted Patent B2
US 8,428,316 · App. 12/275,714 · Granted Apr 23, 2013

Coronary reconstruction from rotational X-ray projection sequence

Inventors: Yiyong Sun (Lawrenceville, NJ); Rui Liao (Plainsboro, NJ); Luc Duong (Montreal, CA); Frank Sauer (Princeton, NJ); Chenyang Xu (Allentown, NJ)
Assignee: Siemens Aktiengesellschaft
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,428,316
App. No.
12/275,714
Granted
Apr 23, 2013
Kind
B2
Abstract

A method for three-dimensional reconstruction of a branched object from a rotational sequence of images of the branched object includes segmenting the branched object from each image of the sequence, extracting centerlines of the branched object, performing symbolic reconstruction via a stereo correspondence matching between the centerlines from different views of the sequence of images using a graph cut-based optimization, and creating a three-dimensional tomographic reconstruction of the branched object compensated for motion of the branched object between the images of the sequence.

Claims (50)

1. A computer readable medium embodying instructions executable by a processor to perform a method for three-dimensional reconstruction of a branched object from a rotational sequence of images of the branched object, the method steps comprising:

generating a vesselness feature image for each image of the sequence by filtering each image of the sequence using a filter that identifies tubular structure;

segmenting the branched object from each vesselness feature image using a thresholding process;

extracting centerlines of the branched object;

performing symbolic reconstruction via a stereo correspondence matching between the centerlines from different views of the sequence of images using a graph cut-based optimization; and

creating a three-dimensional tomographic reconstruction of the branched object compensated for motion of the branched object between the images of the sequence.

2. The computer readable medium of claim 1 , wherein the graph cut-based optimization comprises:

constructing a connectivity graph for the centerlines extracted from a reference image selected from among the sequence of images;

locating an optical center in the reference image;

projecting a three-dimensional ray from optical center to the extracted centerlines in the reference image;

tracking the three-dimensional ray in a volume constructed from the sequence of images and labeling points on the ray at different depths according to a depth in the volume;

projecting the points onto another image according to a respective projection matrices; and

minimizing a mean of errors between the projected points and corresponding points on the centerlines extracted from other images.

3. The computer readable medium of claim 2 , wherein the graph cut-based optimization further comprises a smoothness penalty for neighboring connected pixels based on a difference in depth.

4. The computer readable medium of claim 2 , wherein the graph cut-based optimization further comprises a cost penalty increasing with length of a corresponding centerline.

5. The computer readable medium of claim 2 , wherein the graph cut-based optimization further comprises a cost penalty decreasing with a vesselness of a corresponding centerline.

6. The computer readable medium of claim 1 , wherein creating the three-dimensional tomographic reconstruction further comprises estimating an affine transformation for each image of the sequence to compensate for the motion in a two-dimensional imaging plane.

7. The computer readable medium of claim 1 , wherein a Multiscale Hessian-based filter is used in the filtering of each image of the sequence.

8. The computer readable medium of claim 1 , wherein the thresholding process is a hysteresis thresholding process that retains connected components for points that have a vesselness above a low threshold and with at least one pixel with a vesselness above a high threshold.

9. The computer readable medium of claim 8 , wherein the low and high thresholds are calculated as fixed quantities of accumulated histograms of the vesselness feature images.

10. A computer-implemented method for three-dimensional reconstruction of a branched object from a rotational sequence of images of the branched object comprising:

generating a vesselness feature image for each image of the sequence by filtering each image of the sequence using a filter that identifies tubular structure;

segmenting the branched object from each vesselness feature image of the sequence using a thresholding process;

extracting centerlines of the branched object;

performing symbolic reconstruction via a stereo correspondence matching between the centerlines from different views of the sequence of images using a graph cut-based optimization; and

creating a three-dimensional tomographic reconstruction of the branched object compensated for motion of the branched object between the images of the sequence.

11. The method of claim 10 , wherein the graph cut-based optimization comprises:

constructing a connectivity graph for the centerlines extracted from a reference image selected from among the sequence of images;

locating an optical center in the reference image;

projecting a three-dimensional ray from optical center to the extracted centerlines in the reference image;

tracking the three-dimensional ray in a volume constructed from the sequence of images and labeling points on the ray at different depths according to a depth in the volume;

projecting the points onto another image according to a respective projection matrices; and minimizing a mean of errors between the projected points and corresponding points on the centerlines extracted from other images.

12. The method of claim 11 , wherein the graph cut-based optimization further comprises a smoothness penalty for neighboring connected pixels based on a difference in depth.

13. The method of claim 11 , wherein the graph cut-based optimization further comprises a cost penalty increasing with length of a corresponding centerline.

14. The method of claim 11 , wherein the graph cut-based optimization further comprises a cost penalty decreasing with a vesselness of a corresponding centerline.

15. The method of claim 10 , wherein creating the three-dimensional tomographic reconstruction further comprises estimating an affine transformation for each image of the sequence to compensate for the motion in a two-dimensional imaging plane.

16. The computer-implemented method of claim 10 , wherein a Multiscale Hessian-based filter is used in the filtering of each image of the sequence.

17. The computer-implemented method of claim 10 , wherein the thresholding process is a hysteresis thresholding process that retains connected components for points that have a vesselness above a low threshold and with at least one pixel with a vesselness above a high threshold.

18. A system for three-dimensional reconstruction of a branched object from a rotational sequence of images of the branched object comprising:

a source of the rotational sequence of images comprising views of the branched object to be reconstructed;

a processor executing instructions embodied in a computer readable medium for three-dimensional reconstruction of the branched object from a symbolic reconstruction of the branched object in the rotational sequence of images; and

an output device for display of the reconstructed branched object determined by the processor,

wherein the instructions cause the processor to perform method steps comprising:

generating a vesselness feature image for each image of the sequence by filtering each image of the sequence using a filter that identifies tubular structure;

segmenting the branched object from each vesselness feature image using a thresholding process;

extracting centerlines of the branched object;

creating the symbolic reconstruction of the branched object via a stereo correspondence matching between the centerlines from different views of the sequence of images; and

creating a three-dimensional tomographic reconstruction of the branched object compensated for motion of the branched object between the images of the sequence in the symbolic reconstruction.

19. The system of claim 18 , wherein a Multiscale Hessian-based filter is used in the filtering of each image of the sequence.

20. The system of claim 18 , wherein the thresholding process is a hysteresis thresholding process that retains connected components for points that have a vesselness above a low threshold and with at least one pixel with a vesselness above a high threshold.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2009
From: SIEMENS CORPORATE RESEARCH, INC.
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 023289/0172 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2009
From: DUONG, LUC; LIAO, RUI; SAUER, FRANK; SUN, YIYONG; XU, CHENYANG
To: SIEMENS CORPORATE RESEARCH, INC.
Reel/Frame 022167/0629 →
Continuity (2)
Provisional Application 60991909 · Dec 3, 2007
Related Publication 20090141968A1 · Jun 4, 2009