IP Library Granted Patent US 7,761,240
Granted Patent B2
US 7,761,240 · App. 11/200,758 · Granted Jul 20, 2010

Systems and methods for automated diagnosis and grading of tissue images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,761,240
App. No.
11/200,758
Granted
Jul 20, 2010
Kind
B2
Abstract

Systems and methods are provided for automated diagnosis and grading of tissue images based on morphometric data extracted from the images by a computer. The morphometric data may include image-level morphometric data such as fractal dimension data, fractal code data, wavelet data, and/or color channel histogram data. The morphometric data may also include object-level morphometric data such as color, structural, and/or textural properties of segmented image objects (e.g., stroma, nuclei, red blood cells, etc.).

Claims (55)

1. An apparatus for evaluating a tissue image for a medical condition, the apparatus comprising:

a model predictive of the medical condition, wherein the model is based on one or more fractal dimension features from one or more binary images, each binary image corresponding to a particular color channel of the tissue image, said model defining a relationship between the expression of said one or more fractal dimension features and the medical condition, wherein the model is configured to:

receive data identifying an expression of said one or more fractal dimension features within the tissue image; and

evaluate said data according to the relationship defined by the model to produce a value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

2. The apparatus of claim 1 , further comprising an image processing tool configured to extract the one or more fractal dimension features from the tissue image, wherein said image processing tool is configured to:

threshold the tissue image at one or more fixed, equally-spaced thresholds in one or more of its red, green, and blue (RGB) color channels to obtain one or more binary images; and

compute a fractal dimension value γ k i for each of the one or more binary images.

3. The apparatus of claim 1 , wherein the model predicts whether the tissue in the tissue image is cancerous or non-cancerous.

4. The apparatus of claim 1 , wherein the model predicts a cancer grade for the tissue in the tissue image.

5. The apparatus of claim 4 , wherein the cancer grade comprises a Gleason grade.

6. The apparatus of claim 1 , wherein the model is further based on one or more additional features, said model further defining a relationship between the expression of said one or more additional features and the medical condition, wherein said model is further configured to receive additional data identifying an expression of said one or more additional features and to evaluate said additional data according to the relationships defined by the model to produce said value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

7. An apparatus for evaluating a tissue image for a medical condition, the apparatus comprising:

a model predictive of the medical condition, wherein the model is based on one or more fractal code features from the group of fractal code features consisting of a mean square error (MSE) between a domain block and a range block, a shift parameter of an affine transform, a scaling parameter of an affine transform, a shuffling transform, and a Euclidean distance between a domain block and a range block in an image plane, said model defining a relationship between the expression of said one or more fractal code features and the medical condition, wherein the model is configured to:

receive data identifying an expression of said one or more fractal code features within the tissue image; and

evaluate said data according to the relationship defined by the model to produce a value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

8. The apparatus of claim 7 , further comprising an image processing tool configured to extract the one or more fractal code features from the tissue image, wherein the image processing tool is configured to:

partition the tissue image into non-overlapping blocks of two different sizes: range blocks B j and domain blocks Ā i ; and

search for a domain block Ā i and a transformation T i such that the transformed domain block T i Ā i is an approximation of B j ,

wherein one or more characteristics of the transformation comprise the one or more fractal code features.

9. The apparatus of claim 8 , wherein said image processing tool is configured to search for a domain block Ā i and a transformation T i such that a mean square error (MSE) between the domain block and range block is minimized.

10. The apparatus of claim 7 , wherein the model is further based on one or more additional features, said model further defining a relationship between the expression of said one or more additional features and the medical condition, wherein said model is further configured to receive additional data identifying an expression of said one or more additional features and to evaluate said additional data according to the relationships defined by the model to produce said value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

11. An apparatus for evaluating a tissue image for a medical condition, the apparatus comprising:

a model predictive of the medical condition, wherein the model is based on one or more wavelet features comprising one or more measurements of variance of wavelet coefficients for one or more wavelet representation subbands, said model defining a relationship between the expression of said one or more measurements of variance of wavelet coefficients and the medical condition, wherein the model is configured to:

receive data identifying an expression of said one or more measurements of variance of wavelet coefficients within the tissue image; and

evaluate said data according to the relationship defined by the model to produce a value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

12. The apparatus of claim 11 , further comprising an image processing tool configured to extract the one or more wavelet features from the tissue image, wherein the image processing tool is configured to:

generate a wavelet representation of the tissue image; and

compute the variance of the wavelet subband coefficients for at least one of the wavelet representation subbands.

13. The apparatus of claim 11 , wherein the one or more wavelet features comprises one or more scalar wavelet transform features.

14. The apparatus of claim 11 , wherein the model is further based on one or more additional features, said model further defining a relationship between the expression of said one or more additional features and the medical condition, wherein said model is further configured to receive additional data identifying an expression of said one or more additional features and to evaluate said additional data according to the relationships defined by the model to produce said value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

15. An apparatus for evaluating a tissue image for a medical condition, the apparatus comprising:

a model predictive of the medical condition, wherein the model is based on one or more color channel histogram features comprising one or more pixel counts, each pixel count corresponding to an intensity of a particular color channel of the tissue image, said model defining a relationship between the expression of said one or more color histogram features and the medical condition, wherein the model is configured to:

receive data identifying an expression of said one or more color histogram features within the tissue image; and

evaluate said data according to the relationship defined by the model to produce a value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

16. The apparatus of claim 15 , further comprising an image processing tool configured to extract the one or more channel histogram features from the tissue image, wherein said image processing tool is configured to:

separate the tissue image into one or more of its red, green, and blue (RGB) color channels to produce one or more color channel images;

separate one or more of the color channel images into bins representing levels of color intensity; and

compute a pixel count for one or more of the bins.

17. The apparatus of claim 15 , wherein the model is further based on one or more additional features, said model further defining a relationship between the expression of said one or more additional features and the medical condition, wherein said model is further configured to receive additional data identifying an expression of said one or more additional features and to evaluate said additional data according to the relationships defined by the model to produce said value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

18. A computer readable storage medium comprising computer executable instructions recorded thereon for performing the method comprising:

receiving data identifying an expression of one or more fractal dimension features from one or more binary images of a tissue image, each binary image corresponding to a particular color channel of the tissue image; and

evaluating said data with a model predictive of a medical condition to produce a value indicative of at least one of the presence, absence, or aggressiveness of the medical condition, wherein the model is based on said one or more fractal dimension features, said model defining a relationship between the expression of said one or more fractal dimension features and the medical condition wherein said evaluating said data comprises evaluating said data according to the relationship defined by the model.

19. The computer readable storage medium of claim 18 , wherein the model is further based on one or more additional features, said model further defining a relationship between the expression of said one or more additional features and the medical condition, wherein said computer executable instructions further comprise computer executable instructions for receiving additional data identifying an expression of said one or more additional features and evaluating said additional data according to the relationships defined by the model to produce said value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

20. A computer readable storage medium comprising computer executable instructions recorded thereon for performing the method comprising:

receiving data identifying for a tissue image an expression of one or more fractal code features from the group of fractal code features consisting of a mean square error (MSE) between a domain block and a range block, a shift parameter of an affine transform, a scaling parameter of an affine transform, a shuffling transform, and a Euclidean distance between a domain block and a range block in an image plane; and

evaluating said data with a model predictive of a medical condition to produce a value indicative of at least one of the presence, absence, or aggressiveness of the medical condition, wherein the model is based on said one or more fractal code features, said model defining a relationship between the expression of said one or more fractal code features and the medical condition wherein said evaluating said data comprises evaluating said data according to the relationship defined by the model.

21. The computer readable storage medium of claim 20 , wherein the model is further based on one or more additional features, said model further defining a relationship between the expression of said one or more additional features and the medical condition, wherein said computer executable instructions further comprise computer executable instructions for receiving additional data identifying an expression of said one or more additional features and evaluating said additional data according to the relationships defined by the model to produce said value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

22. A computer readable storage medium comprising computer executable instructions recorded thereon for performing the method comprising:

receiving data identifying for a tissue image an expression of one or more wavelet features comprising one or more measurements of variance of wavelet coefficients for one or more wavelet representation subbands; and

evaluating said data with a model predictive of a medical condition to produce a value indicative of at least one of the presence, absence, or aggressiveness of the medical condition, wherein the model is based on said one or more wavelet features, said model defining a relationship between the expression of said one or more wavelet features and the medical condition wherein said evaluating said data comprises evaluating said data according to the relationship defined by the model.

23. The computer readable storage medium of claim 22 , wherein the model is further based on one or more additional features, said model further defining a relationship between the expression of said one or more additional features and the medical condition, wherein said computer executable instructions further comprise computer executable instructions for receiving additional data identifying an expression of said one or more additional features and evaluating said additional data according to the relationships defined by the model to produce said value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

24. A computer readable storage medium comprising computer executable instructions recorded thereon for performing the method comprising:

receiving data identifying for a tissue image an expression of one or more color channel histogram features comprising one or more pixel counts, each pixel count corresponding to an intensity of a particular color channel of the tissue image; and

evaluating said data with a model predictive of a medical condition to produce a value indicative of at least one of the presence, absence, or aggressiveness of the medical condition, wherein the model is based on said one or more color channel histogram features, said model defining a relationship between the expression of said one or more color channel histogram features and the medical condition wherein said evaluating said data comprises evaluating said data according to the relationship defined by the model.

25. The computer readable storage medium of claim 24 , wherein the model is further based on one or more additional features, said model further defining a relationship between the expression of said one or more additional features and the medical condition, wherein said computer executable instructions further comprise computer executable instructions for receiving additional data identifying an expression of said one or more additional features and evaluating said additional data according to the relationships defined by the model to produce said value indicative of at least one of the presence, absence, or aggressiveness of the medical condition.

Assignments (3)
THIS IS TO CORRECT ERRORS IN A COVER SHEET PREVIOUSLY RECORDED (REEL/FRAME 027502/0828): CORRECTION OF THE ASSIGNOR'S NAME TO AUREON (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC.; CORRECTION OF THE ASSIGNEE'S NAME TO AUREON, INC. Recorded May 22, 2012
From: AUREON (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
To: AUREON, INC.
Reel/Frame 028252/0442 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2012
From: AUREON, INC.
To: CHAMPALIMAUD FOUNDATION
Reel/Frame 028244/0077 →
SECURITY AGREEMENT Recorded Jan 12, 2010
From: AUREON LABORATORIES, INC.
To: ATLAS VENTURE ENTREPRENEURS' FUND VI, L.P.; ATLAS VENTURE FUND VI GMBH & CO. KG; ATLAS VENTURE FUND VI, L.P.; SPROUT CAPITAL IX, L.P.; DLJ CAPITAL CORP.; SPROUT IX PLAN INVESTORS, L.P.; SPROUT ENTREPRENEURS' FUND, L.P.; PFIZER INC.; CANTABRIA DE ACTIVOS, S.L.; CORPORACION MASAVEU, S.A.; LEALTAD DESARROLLO, S.C.R., S.A.; INICIATIVAS DIGITALES; INVERSIONES VECU 2006, S.L.; MARCO BASSETTI; ESTRELA - SGPS, S.A.; MINTZ LEVIN INVESTMENTS LLC
Reel/Frame 023768/0486 →