IP Library Granted Patent US 7,680,312
Granted Patent B2
US 7,680,312 · App. 11/429,685 · Granted Mar 16, 2010

Method for knowledge based image segmentation using shape models

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,680,312
App. No.
11/429,685
Granted
Mar 16, 2010
Kind
B2
Abstract

A method for segmenting an object of interest from an image of a patient having such object. Each one of a plurality of training shapes is distorted to overlay a reference shape with a parameter Θ i being a measure of the amount of distortion required to effect the overlay. A vector of the parameters Θ i is obtained for every one of the training shapes through the minimization of a cost function along with an estimate of uncertainty for every one of the obtained vectors of parameters Θ i , such uncertainty being quantified as a covariance matrix Σ i . A statistical model represented as {circumflex over (f)} H (Θ,Σ) is generated with the sum of kernels having a mean Θ i and covariance Σ i . The desired object of interest in the image of the patient is identified by positioning of the reference shape on the image and distorting the reference shape to overlay the obtained image with a parameter Θ being a measure of the amount of distortion required to effect the overlay. An uncertainty is quantified as a covariance matrix Σ and an energy function E=E shape +E image is computed to obtain the probability of the current shape in the statistical shape model E shape (Θ,Σ)=−log({circumflex over (f)} H ) and the fit in the image E image .

Claims (42)

1. A method for use in segmenting an object of interest from an image of a patient having such object, comprising:

using medical imaging apparatus to perform the steps of:

transforming a generated reference shape of the object to match every one of a plurality of training shapes according to an energy function comprising distorting each one of the training shapes to overlay the reference shape with a parameter Θ i , being a measure of the amount of distortion required at each grid point to effect the overlay for the i th one of the N training shapes;

obtaining a vector of the parameters Θ i , for every one of the training shapes through the minimization of a cost function;

estimating an uncertainty for every one of the obtained vectors of parameters Θ i , such uncertainty being quantified as a covariance matrix Σ i ;

providing for the plurality of training shapes a statistical model represented as {circumflex over (f)} H (Θ,Σ) which is the sum of the K Gaussian kernels having a mean Θ i and covariance Σ i .

2. The method recited in claim 1 wherein the cost function is the sum squared difference between a distance map generated for one of the training shapes and the transformed reference model.

3. The method recited in claim 1 including additionally:

obtaining the image of the desired object from the patient;

identifying the desired object of interest in the image of the patient by positioning of the reference shape on the image comprising:

transforming the generated reference shape to match the obtained image according to the energy function comprising distorting the reference shape to overlay the obtained image with a parameter Θ being a measure of the amount of distortion required to effect the overlay;

estimating an uncertainty, such uncertainty being quantified as a covariance matrix Σ;

computing a shape term of an energy function E shape (Θ,Σ)=−log({circumflex over (f)} H ) to obtain the probability of the current shape in the statistical shape model; and

computing an image term of an energy function E image to evaluate the fit of the shape in the image

minimizing the energy function E shape +E image .

4. The method recited in claim 3 wherein the minimizing E shape (Θ,Σ)=−log({circumflex over (f)} H ) comprises:

computing E shape (Θ,Σ Θ )=−log({circumflex over (f)} H ) and E image ;

changing Θ according to the derivative of E shape +E image ;

generating a new covariance matrix as Σ Θ , to thereby compute a new E shape(Θ,Σ Θ )=−log({circumflex over (f)} H ) and E image until E shape (Θ,Σ)+E image is minimized.

5. The method recited in claim 1 wherein the cost function is the distance between such one of the training shapes and the transformed reference model.

6. A method for learning deformations of an object of interest obtained from an image bank of a patient having such object, comprising:

using medical imaging apparatus to perform the steps of:

generating an initial reference shape of the object of interest to be segmented;

obtaining a predetermined number of, N, images of the desired object from over a general population of such objects, where N is greater than 1;

transforming the generated reference shape to match every one of N training shapes according to an energy function comprising distorting each one of the N training shapes to overlay the reference shape with a parameter Θ i being a measure of the amount of distortion required at each grid point to effect the overlay for the i th one of the N training shapes;

obtaining a vector of the parameters Θ i , for every one of the N training shapes through the minimization of a cost function;

estimating an uncertainty for every one of the obtained N vectors of parameters Θ i , such uncertainty being quantified as a covariance matrix Σ i ;

providing a statistical model represented as {circumflex over (f)} H (Θ,Σ) cumulating information of the N training shapes modeled with kernels having a mean Θ i , and covariance Σ i .

7. The method recited in claim 6 wherein the uncertainty is computed by assuming that the energy function can be approximated at its minimum by a paraboloid, the width of the paraboloid being representative of the degree of uncertainty.

8. The method recited in claim 7 wherein the reference shape is on a reference coordinate system having an overlaid free form deformation grid. Such free form deformation grid having a plurality of grid points with positions represented in the vector Θ, with a the projection of the covariance matrix onto a grid point being represented as an ellipse elongated in the direction of greater uncertainty, and wherein, in the case of smooth linear contours, a component is tangent to the reference shape and another component is normal to the reference shape.

9. The method recited in claim 6 including additionally:

obtaining the image of the desired object from the patient;

identifying the desired object of interest in the image of the patient by positioning of the reference shape on the image comprising:

transforming the generated reference shape to match the obtained image according to the energy function comprising distorting the reference shape to overlay the obtained image with a parameter Θ being a measure of the amount of distortion required to effect the overlay;

estimating an uncertainty, such uncertainty being quantified as a covariance matrix Σ;

computing an energy function E shape to obtain the probability of the current shape in the statistical shape model; and

minimizing E=E shape +E image comprising:

computing E shape (Θ,Σ)=−log({circumflex over (f)} H );

computing E image ;

changing Θ;

generating an updated covariant matrix with the changed Θ;

recomputing the energy function E=E shape +E image .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2007
From: SIEMENS CORPORATE RESEARCH, INC.
To: SIEMENS MEDICAL SOLUTIONS USA, INC.
Reel/Frame 019309/0669 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2006
From: JOLLY, MARIE-PIERRE; PARAGIOS, NIKOLAOS; TARON, MAXIME G.
To: SIEMENS CORPORATE RESEARCH, INC.
Reel/Frame 017885/0191 →