Method and system for evaluating image segmentation based on visibility
View Patent ↗A method and system for evaluating image segmentation is disclosed. In order to quantitatively evaluate an image segmentation technique, synthetic image data is generated and the synthetic image data is segmented to extract an object using the segmentation technique. This segmentation results in a foreground containing the extracted object and a background. The visibility of the extracted object is quantitatively measured based on the intensity distributions of the segmented foreground and background. The visibility is quantitatively measured by calculating the Jeffries-Matusita distance between the foreground and background intensity distributions. This method can be used to evaluate segmentation of vessels in fluoroscopic image sequences by coronary digital subtraction angiography (DSA).
1. A method for evaluating an image segmentation technique, comprising:
generating synthetic image data by
generating a ground truth image of an object to be segmented, and
combining the ground truth image with a background image resulting in a synthetic image;
segmenting the synthetic image data to extract the object using the segmentation technique, resulting in a foreground containing the extracted object and a background; and
quantitatively measuring a visibility of the extracted object based on intensity distributions of the segmented foreground and background.
2. The method of claim 1 , wherein said step of generating a ground truth image comprises:
generating a ground truth image based on human annotations.
3. The method of claim 1 , wherein said step of generating synthetic image data further comprises:
adding noise to the synthetic image to simulate a certain noise levels.
4. The method of claim 3 , wherein said step of adding noise to the synthetic image comprises:
generating a uniformly distributed white noise image;
blurring the noise image with a Gaussian filter; and
multiplying the noise image by a noise scale to obtain the certain noise level; and
adding the noise image to the synthetic image.
5. The method of claim 1 , wherein the synthetic image data is synthetic fluoroscopic image sequence, and said step of segmenting the synthetic image data to extract an object using the segmentation technique comprises:
segmenting the synthetic fluoroscopic image sequence to extract vessels using coronary digital subtraction angiography (DSA).
6. The method of claim 1 , wherein said step of generating synthetic image data comprises:
generating a sequence of ground truth images of vessels from a fluoroscopic image sequence; and
summing the sequence of ground truth images with a sequence of background x-ray images in logarithm space to simulate the composition of x-ray images, resulting in a synthetic fluoroscopic image sequence.
7. The method of claim 6 , wherein said step of segmenting the synthetic image data to extract an object using the segmentation technique comprises:
estimating motion fields of vessel branches between frames of the synthetic fluoroscopic image sequence;
segmenting a vessel layer and a background layer based on the estimated motion fields; and
normalizing the extracted vessel layers.
8. The method of claim 7 , wherein said step of estimating motion fields of vessel branches between frames of the synthetic fluoroscopic image sequence comprises:
separating the vessel branches into a plurality of sets;
tracking the vessel braches in each set to estimated the motion fields.
9. The method of claim 8 , wherein said step of segmenting a vessel layer and a background layer based on the estimated motion fields comprises:
segmenting a plurality of vessel layers corresponding to the plurality of sets of vessel branches; and
combining the plurality of vessel layers to generate a single foreground layer.
10. The method of claim 1 , wherein said step of quantitatively measuring a visibility of the extracted object based on intensity distributions of the segmented foreground and background comprises:
calculating a Jeffries-Matusita (JM) distance between the intensity distributions of the segmented foreground and background.
11. The method of claim 1 , further comprising:
comparing the quantitatively measured visibility of the extracted object with a qualitatively measured visibility of the object in the synthetic image data.
12. An apparatus for evaluating an image segmentation technique, comprising:
means for generating synthetic image data comprising:
means for generating a ground truth image of an object to be segmented, and
means for combining the ground truth image with a background image resulting in a synthetic image;
means for segmenting the synthetic image data to extract an object using the segmentation technique, resulting in a foreground containing the extracted object and a background; and
means for quantitatively measuring a visibility of the extracted object based on intensity distributions of the segmented foreground and background.
13. The apparatus of claim 12 , wherein said means for generating synthetic image data further comprises:
means for adding noise to the synthetic image to simulate a certain noise levels.
14. The apparatus of claim 12 , wherein said means for generating synthetic image data comprises:
means for generating a sequence of ground truth images of vessels from a fluoroscopic image sequence; and
means for summing the sequence of ground truth images with a sequence of background x-ray images in logarithm space to simulate the composition of x-ray images, resulting in a synthetic fluoroscopic image sequence.
15. The apparatus of claim 14 , wherein said means for segmenting the synthetic image data to extract an object using the segmentation technique comprises:
means for estimating motion fields of vessel branches between frames of the synthetic fluoroscopic image sequence;
means for segmenting a vessel layer and a background layer based on the estimated motion fields; and
means for normalizing the extracted vessel layers.
16. The apparatus of claim 12 , wherein said means for quantitatively measuring a visibility of the extracted object based on intensity distributions of the segmented foreground and background comprises:
means for calculating a Jeffries-Matusita (JM) distance between the intensity distributions of the segmented foreground and background.
17. The apparatus of claim 12 , further comprising:
means for comparing the quantitatively measured visibility of the extracted object with a qualitatively measured visibility of the object in the synthetic image data.
18. A non-transitory computer readable medium encoded with computer executable instructions for evaluating an image segmentation technique, the computer executable instructions defining steps comprising:
generating synthetic image data by:
generating a ground truth image of an object to be segmented, and
combining the ground truth image with a background image resulting in a synthetic image;
segmenting the synthetic image data to extract an object using the segmentation technique, resulting in a foreground containing the extracted object and a background; and
quantitatively measuring a visibility of the extracted object based on intensity distributions of the segmented foreground and background.
19. The non-transitory computer readable medium of claim 18 , wherein the computer executable instructions defining the step of generating synthetic image data further comprise computer executable instructions defining the step of:
adding noise to the synthetic image to simulate a certain noise levels.
20. The non-transitory computer readable medium of claim 18 , wherein said the computer executable instructions defining the step of generating synthetic image data comprise computer executable instructions defining the steps of:
generating a sequence of ground truth images of vessels from a fluoroscopic image sequence; and
summing the sequence of ground truth images with a sequence of background x-ray images in logarithm space to simulate the composition of x-ray images, resulting in a synthetic fluoroscopic image sequence.
21. The non-transitory computer readable medium of claim 20 , wherein the computer executable instructions defining the step of segmenting the synthetic image data to extract an object using the segmentation technique comprise computer executable instructions defining the steps of:
estimating motion fields of vessel branches between frames of the synthetic fluoroscopic image sequence;
segmenting a vessel layer and a background layer based on the estimated motion fields; and
normalizing the extracted vessel layers.
22. The non-transitory computer readable medium of claim 18 , wherein the computer executable instructions defining the step of quantitatively measuring a visibility of the extracted object based on intensity distributions of the segmented foreground and background comprise computer executable instructions defining the step of:
calculating a Jeffries-Matusita (JM) distance between the intensity distributions of the segmented foreground and background.
23. The non-transitory computer readable medium of claim 18 , further comprising computer executable instructions defining the step of:
comparing the quantitatively measured visibility of the extracted object with a qualitatively measured visibility of the object in the synthetic image data.