System and method for segmenting a region in a medical image
View Patent ↗A method and computer program are provided for segmenting a prostate from a medical image such as an ultrasound image. Each slice in a study is analysed and uses a manual initialization to obtain an initial contour, in which a user selects initial points that are automatically rendered on the image. An automatic refinement stage then snaps the contour to the prostate boundary in the image based on a pre-stored anatomical atlas and edge information obtained from the image. A manual adjustment stage may then be performed and if selected, the contour is automatically propagated to the next image slice to avoid the manual initialization. An auxiliary image slice may be referred to, which indicates how the prostate shape changes from slice to slice, e.g. by providing a perpendicular profile.
1. A computer-implemented method for segmenting a region in an image comprising:
defining a plurality of initial points on the image;
defining, with a processor, one or more control points placed relative to each pair of neighbouring ones of said plurality of initial points;
generating, with the processor, an initial contour from the plurality of initial points by interpolating a Bezier curve between each pair of neighbouring ones of said plurality of initial points using the one or more control points placed relative to said each pair, wherein said interpolating comprises using a spline-based interpolation between said each pair wherein said control points are located outside of said initial contour; and
adjusting, with the processor, the positions of said control points to modify each said Bezier curve to refine said initial contour according to information regarding an expected shape for said region.
2. The method according to claim 1 wherein defining a plurality of initial points includes
enabling the selection of a first point at a first extent of said region;
enabling the selection of a second point at a second extent of said region being opposite said first point to define a line of symmetry;
enabling the selection of a third point at a third extent of said region on one side of said line of symmetry; and
providing a fourth point at a fourth extent of said region across said line of symmetry from said third point.
3. The method according to claim 2 comprising
examining boundary information in said image to generate a score,
refining said initial contour a plurality of times to produce a plurality of scores and generating a refined contour according to the highest of said scores.
4. The method according to claim 3 wherein said examining boundary information comprises
comparing said initial contour to boundary information in said image to generate a first score;
comparing said initial contour to said information to generate a second score, said information being indicative of an expected shape for said region;
combining said first and second scores to obtain a combined score;
reshaping said initial contour a plurality of times to obtain a plurality of adjusted contours;
generating said combined score for each said plurality of adjusted contours; and
generating said refined contour according to the highest of said combined scores.
5. The method according to claim 4 wherein said first score is calculated by incrementing by the value of each pixel in a gradient-magnitude image such that said first score is high when said contour is close to edges in said image.
6. The method according to claim 4 wherein said second score is calculated according to how close said contour is from an average shape, said average shape being determined from a plurality of shapes in an empirically derived atlas of expected shapes.
7. The method according to claim 4 wherein said combined score is computed as a weighted combination of said first and second scores.
8. The method according to claim 2 wherein said information is provided by one or more of the following: functional knowledge derived from medical images, geometry of said region, symmetry of said region, real-time information acquired during imaging, an empirically derived atlas of expected shapes, and localization information.
9. The method according to claim 2 wherein said control points are modified a plurality of times and at each modification, a plausibility of the shape of said region is determined from an atlas of empirically derived expected shapes for said region, said plausibility being used to choose a refined contour.
10. The method according to claim 2 wherein providing said fourth point comprises enabling selection of said fourth point at said fourth extent of said region across said line of symmetry from said third point.
11. The method according to claim 2 wherein enabling the selection of said third point and providing said fourth point comprise
generating a provisional contour passing through said first and second points;
providing said third point on said provisional contour on said one side of said line of symmetry;
enabling movement of said third point towards said third extent of said region; and
during movement of said third point, automatically moving said fourth point on said provisional contour on an other side of said line of symmetry in a direction opposite that of said third point towards said fourth extent of said region.
12. The method according to claim 1 comprising
obtaining at least one auxiliary image slice of said region at a different angle than a stack of image slices containing said region to provide a profile of said region in another dimension;
repeating said method for each said image slices and referencing said profile to approximate a next segmentation contour for a next one of said image slices while propagating through said stack of image slices.
13. A non-transitory computer readable medium comprising computer executable instructions for causing an image processing device to segment a region in an image by
defining a plurality of initial points on the image;
defining one or more control points placed relative to each pair of neighboring ones of said plurality of initial points;
generating an initial contour from the plurality of initial points by interpolating a Bezier curve between each pair of neighbouring ones of said plurality of initial points using the one or more control points placed relative to said each pair, wherein said interpolating comprises using a spline-based interpolation between said each pair wherein said control points are located outside of said initial contour; and
adjusting the positions of said control points to modify each said Bezier curve to refine said initial contour according to known information regarding an expected shape for said region.
14. The computer readable medium according to claim 13 wherein the instructions for defining a plurality of initial points on the image include instructions for
enabling the selection of a first point at a first extent of said region; enabling the selection of a second point at a second extent of said region being opposite said first point to define a line of symmetry;
enabling the selection of a third point at a third extent of said region on one side of said line of symmetry; and
providing a fourth point at a fourth extent of said region across said line of symmetry from said third point.
15. The computer readable medium according to claim 14 comprising instructions for
examining boundary information in said image to generate a score,
refining said initial contour a plurality of times to produce a plurality of scores and generating a refined contour according to the highest of said scores.
16. The computer readable medium according to claim 15 wherein said examining boundary information comprises
comparing said initial contour to boundary information in said image to generate a first score;
comparing said initial contour to said information to generate a second score, said information being indicative of an expected shape for said region;
combining said first and second scores to obtain a combined score;
reshaping said initial contour a plurality of times to obtain a plurality of adjusted contours;
generating said combined score for each said plurality of adjusted contours; and
generating said refined contour according to the highest of said combined scores.
17. The computer readable medium according to claim 16 wherein said first score is calculated by incrementing by the value of each pixel in a gradient-magnitude image such that said first score is high when said contour is close to edges in said image.
18. The computer readable medium according to claim 16 wherein said second score is calculated according to how close said contour is from an average shape, said average shape being determined from a plurality of shapes in an empirically derived atlas of expected shapes.
19. The computer readable medium according to claim 16 wherein said combined score is computed as a weighted combination of said first and second scores.
20. The computer readable medium according to claim 14 wherein said information is provided one or more of the following: functional knowledge derived from medical images, geometry of said region, symmetry of said region, real-time information acquired during imaging, an empirically derived atlas of expected shapes, and localization information.
21. The computer readable medium according to claim 14 wherein said control points are modified a plurality of times and at each modification, a plausibility of the shape of said region is determined from an atlas of empirically derived expected shapes for said region, said plausibility being used to choose a refined contour.
22. The computer readable medium according to claim 14 wherein providing said fourth point comprises enabling selection of said fourth point at said fourth extent of said region across said line of symmetry from said third point.
23. The computer readable medium according to claim 14 wherein the instructions enabling selection of said third point and providing said fourth point comprise
generating a provisional contour passing through said first and second points;
providing said third point on said provisional contour on said one side of said line of symmetry;
enabling movement of said third point towards said third extent of said region; and
during movement of said third point, automatically moving said fourth point on said provisional contour on an other side of said line of symmetry in a direction opposite that of said third point towards said fourth extent of said region.
24. The computer readable medium according to claim 13 comprising instructions for
obtaining at least one auxiliary image slice of said region at a different angle than a stack of image slices containing said region to provide a profile of said region in another dimension;
repeating said method for each said image slices and referencing said profile to approximate a next segmentation contour for a next one of said image slices while propagating through said stack of image slices.
25. A computer-implemented method for generating a initial contour for segmenting a region in an image comprising:
enabling, with a processor, the selection of a first point at a first extent of said region;
enabling, with the processor, the selection of a second point at a second extent of said region being opposite said first point to define a line of symmetry;
generating, with the processor, a provisional contour passing through said first and second points;
providing, with the processor, a third point on said provisional contour on one side of said line of symmetry;
enabling, with the processor, movement of said third point towards a third extent of said region;
during movement of said third point, automatically moving, with the processor, a fourth point on said provisional contour on the other side of said line of symmetry in a direction opposite that of said third point towards a fourth extent of said region; and
interpolating, with the processor, between said points according to information indicative of an expected shape for said region to generate said initial contour, wherein the processor generates said initial contour by interpolating a Bezier curve between pairs of said points.