Displaying computer-aided detection information with associated breast tomosynthesis image information
View Patent ↗Methods, systems, and related computer program products for processing and displaying computer-aided detection (CAD) information associated with medical breast x-ray images, such as breast x-ray tomosynthesis volumes, are described. An interactive graphical user interface for displaying a tomosynthesis data volume is described that includes a display of a two-dimensional composited image having slabbed sub-images spatially localized to marked CAD findings. Also described is a graphical navigation tool for optimized CAD-assisted viewing of the data volume, comprising a plurality of CAD indicator icons running near and along a slice ruler, each CAD indicator icon spanning a contiguous segment of the slice ruler and corresponding in depthwise position and extent to a subset of image slices spanned by the associated CAD finding, each CAD indicator icon including at least one single-slice highlighting mark indicating a respective image slice containing viewable image information corresponding to the associated CAD finding.
1. A computer-implemented method for processing and displaying breast x-ray tomosynthesis information, comprising:
receiving a plurality of two-dimensional breast x-ray tomosynthesis reconstructed image slices corresponding to a respective plurality of slice depths in a breast volume;
receiving a plurality of computer-aided detection (CAD) findings associated with the breast volume, each CAD finding identifying a subset of the image slices spanned by a suspected anatomical abnormality and locations therein of the suspected anatomical abnormality;
displaying on a user display a two dimensional diagnostic image comprising either (i) a single one of said received image slices, or (ii) a plurality of depthwise adjacent ones of said received image slices slabbed together, the diagnostic image thereby being characterized by an image depth and an image thickness;
displaying on the user display in visual proximity to the two dimensional diagnostic image a graphical depth navigation tool configured to graphically communicate to a user said image depth and said image thickness and to allow user control thereof, the graphical depth navigation tool comprising:
(a) a slice ruler spatially extending in a first direction representative of said image depth, said slice ruler comprising individual markers representing an image slice contained in the breast volume, and
(b) an extent indication region identifying a location and extent of each marked CAD finding of the breast volume, the extent indication region comprising:
a plurality of CAD indicator icons corresponding to respective CAD findings and running near and along said slice ruler, each CAD indicator icon spanning a contiguous segment that corresponds in depthwise position and extent to the subset of image slices spanned by the associated CAD finding, and
at least one single-slice highlighting mark positioned on an associated CAD indicator icon at a location indicative of the slice depth of a respective one of the subset of image slices spanned by the associated CAD finding that contains viewable image information corresponding to that associated CAD finding, and
(c) a slice slider icon disposed along said slice ruler at a user-controllable position corresponding to said image depth, said slice slider icon comprising a thickness indicator extending along a distance of the slice ruler corresponding to a thickness of the suspected anatomical abnormality identified by a CAD finding, wherein a current location of said slice slider icon and a size of said thickness indicator are automatically adjusted to correspond to a currently selected CAD finding.
2. The method of claim 1 , wherein the anatomical abnormality identified by a first of said CAD findings is a microcalcification cluster, and wherein the at least one single-slice highlighting mark on the associated CAD indicator icon identifies particular ones of the subset of image slices spanned by that microcalcification cluster that contain one or more viewable individual microcalcifications in that microcalcification cluster.
3. The method of claim 1 , wherein each said single-slice highlighting mark is a hash mark extending in a direction normal to said first direction and superimposed upon its associated CAD indicator icon.
4. The method of claim 1 , further comprising: providing on the user display a graphical region of interest (ROI) selector tool positioned in visual proximity to said two dimensional diagnostic image and said graphical depth navigation tool, said ROI selector tool allowing the user to select said CAD findings one at a time; and responsive to a user selection at said ROI selector tool establishing a currently selected CAD finding, modifying said displayed two dimensional diagnostic image to correspond to at least one image slice in the subset of image slices spanned by the currently selected CAD finding.
5. The method of claim 4 , wherein said slice slider icon and said thickness indicator are automatically adjusted to correspond to the image depth and image thickness of the modified two dimensional diagnostic image responsive to said user selection at said ROI selector tool.
6. The method of claim 4 , further comprising visually highlighting the CAD indicator icon for the currently selected CAD finding to make that CAD indicator icon more noticeable relative to the other CAD indicator icons on the user display.
7. The method of claim 4 , further comprising displaying CAD annotation markings on said two dimensional diagnostic image identifying the location of the selected CAD finding thereon.
8. The method of claim 4 , wherein said modified two dimensional diagnostic image is a slabbed image formed by slabbing the subset of image slices spanned by the currently selected CAD finding, the slabbed image not including contributions from image slices not spanned by the currently selected CAD finding.
9. The method of claim 4 , wherein said modified two dimensional diagnostic image comprises:
(a) a slabbed sub-image of a localized neighborhood that laterally encompasses the currently selected CAD finding, said slabbed sub-image being formed by slabbing the subset of image slices spanned by said currently selected CAD finding, said slabbed sub-image not including contributions from image slices not spanned by said currently selected CAD finding; and
(b) a non-CAD-specific sub-image encompassing substantially all areas in the modified two dimensional diagnostic image outlying said localized neighborhood of the currently selected CAD finding, wherein said non-CAD-specific sub-image consists of information taken from a synthetic two-dimensional mammographic image of the breast derived from said received image slices.
10. The method of claim 9 , wherein said non-CAD-specific sub-image consists of information taken from one of
(a) a single one of said subset of image slices spanned by the currently selected CAD finding, and
(b) a slabbed image formed by slabbing two or more of said subset of image slices spanned by the currently selected CAD finding.
11. The method of claim 4 , wherein said modified two dimensional diagnostic image is a cine-loop sequence consisting of the subset of image slices spanned by the currently selected CAD finding.
12. The method of claim 11 , wherein said cine-loop sequence includes at least one slab image formed by slabbing at least two adjacent ones of said subset of image slices.
13. The method of claim 4 , wherein said modified two dimensional diagnostic image comprises:
(a) a cine-loop sequence consisting of the subset of image slices spanned by the currently selected CAD finding, the cine-loop sequence being laterally windowed according to a localized neighborhood that laterally encompasses the currently selected CAD finding; and
(b) a non-CAD-specific sub-image encompassing substantially all areas in the modified two dimensional diagnostic image outlying said localized neighborhood of the currently selected CAD findings, wherein said non-CAD-specific sub-image consists of information taken from a synthetic two-dimensional mammographic image of the breast derived from said received image slices.
14. The method of claim 13 , wherein said non-CAD-specific sub-image consists of information taken from one of
(a) a single one of said subset of image slices spanned by the currently selected CAD finding, and
(b) a slabbed image formed by slabbing two or more of said subset of image slices spanned by the currently selected CAD finding.
15. The method of claim 13 , wherein said cine-loop sequence includes at least one slab image formed by slabbing at least two adjacent ones of said subset of image slices spanned by the currently selected CAD finding.
16. The method of claim 4 , wherein said modified two dimensional diagnostic image comprises:
(a) a slabbed sub-image of a localized neighborhood that laterally encompasses the currently selected CAD finding, said slabbed sub-image being formed by slabbing the subset of image slices spanned by said currently selected CAD finding, said slabbed sub-image not including contributions from image slices not spanned by said currently selected CAD finding; and
(b) a non-CAD-specific sub-image encompassing substantially all areas in the modified two dimensional diagnostic image outlying said localized neighborhood of the currently selected CAD finding, wherein said non-CAD-specific sub-image consists of information taken from one of
(a) an actual two-dimensional mammographic image of the breast,
(b) a single one of said received image slices, and
(c) a slabbed image formed by slabbing two or more of said received image slices.
17. A system including at least one processing unit configured to process and display breast x-ray tomosynthesis information according to the method of claim 1 .
18. A non-transitory computer readable medium tangibly embodying one or more sequences of instructions wherein execution of the one or more sequences of instructions by one or more processors contained in one or more computing systems causes the one or more computing systems to process and display breast x-ray tomosynthesis information according to the method of claim 1 .