IP Library Granted Patent US 7,668,358
Granted Patent B2
US 7,668,358 · App. 10/623,191 · Granted Feb 23, 2010

Model-based grayscale registration of medical images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,668,358
App. No.
10/623,191
Granted
Feb 23, 2010
Kind
B2
Abstract

Numerical image processing based on a model of medical image acquisition of two or more medical images to provide grayscale registration is described. The grayscale registered temporal images may then be displayed for visual comparison and/or further processed by a computer-aided diagnosis system for detection of medical abnormalities therein. A parametric method includes spatially registering two images and performing gray scale registration of the images. A parametric transform model, e.g., analog to analog, digital to digital, analog to digital, or digital to analog model, is selected based on the image acquisition method(s) of the images, i.e., digital or analog/film. Gray scale registration involves generating a joint pixel value histogram from the two images, statistically fitting parameters of the transform model to the joint histogram, generating a lookup table, and using the lookup table to transform and register pixel values of one image to the pixel values of the other image.

Claims (68)

1. A method implemented by a computing device comprising at least one processor and memory for grayscale registration of a first medical image and a second medical image, the method comprising:

spatially registering, by the computing device, the first medical image and the second medical image relative to each other;

generating, by the computing device, at least one joint pixel value histogram based on pixel values of the first and second medical images;

generating, by the computing device, a lookup table based at least in part on the at least one joint pixel value histogram, a first image acquisition method for the first medical image and a second image acquisition method for the second medical image; and

applying, by the computing device, the lookup table to the pixel values of the first medical image to generate a third medical image, the third medical image being transformed from the first medical image and registered to the second medical image;

wherein the step of generating the lookup table includes:

selecting a parametric transform function from a plurality of predetermined, parametric transform functions based on the first and second medical image acquisition methods for the first and second medical images, respectively; and

statistically fitting parameters of the selected parametric transform function to the at least one pixel value histogram, the statistically fitting determines values of the parameters, wherein the lookup table is generated using the selected parametric transform function and the values of the fitted parameters;

and wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image and wherein the plurality of predetermined parametric transform functions includes: (1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.

2. The method of claim 1 , wherein the plurality of predetermined parametric transform functions are one-dimensional monotonic functions.

3. The method of claim 1 , wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

4. The method of claim 1 , wherein each of the first and second medical images is a mammogram, and wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of breast thickness, incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

5. The method of claim 1 , further comprising the steps of:

performing computer aided detection process for comparing the second and third medical images; and

displaying the second and third medical images with results of said computer aided detection process.

6. The method of claim 1 , wherein spatially registering the first and second medical images includes at least one of translating, rotating, shearing and scaling at least one of the first and second medical images.

7. The method of claim 1 , wherein each of the first and second medical images includes a target portion and a remainder portion and wherein spatially registering the first and second medical images includes segmenting the target portion and the remainder portion of each of the first and second medical images.

8. The method of claim 1 , wherein each of the first and second medical images includes a target portion and a remainder portion and wherein spatially registering the first and second medical images includes cropping each of the first and second medical images to contain only the target portion that is in both the first and second medical images.

9. The method of claim 8 , wherein the at least one pixel value histogram is generated based on pixel values of only the cropped first and second medical images.

10. The method of claim 1 , wherein spatially registering the first and second medical images includes optimization of an entropy correlation coefficient of the first and second medical images.

11. A method implemented by a computing device comprising at least one processor and memory for registering a first medical image to a second medical image, the method comprising:

generating, by the computing device, a joint pixel value histogram using pixel values of the first and second medical images;

selecting, by the computing device, a parametric transform function from a plurality of predetermined parametric transform functions, the selecting being based on a first medical image acquisition method for the first medical image and a second medical image acquisition method for the second medical image; and

statistically fitting, by the computing device, parameters of the selected parametric transform function to the joint pixel value histogram, the statistically fitting determining values of the parameters;

wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image and wherein the plurality of predetermined parametric transform functions includes: (1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.

12. The method of claim 11 , further comprising:

generating a lookup table using the selected parametric transform function and the values of the fitted parameters; and

applying the lookup table to the pixel values of the first medical image to generate a third medical image, the third medical image being transformed from the first medical image and registered to the second medical image.

13. The method of claim 11 , further comprising the steps of:

performing computer aided detection process for comparing the second and third medical images; and

displaying the second and third medical images with results of said computer aided detection process.

14. The method of claim 11 , wherein the plurality of predetermined parametric transform functions are one-dimensional monotonic functions.

15. The method of claim 11 , wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

16. The method of claim 11 , wherein each of the first and second medical images is a mammogram, and wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of breast thickness, incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

17. The method of claim 11 , further comprising spatially registering the first medical image and the second medical image relative to each other.

18. The method of claim 17 , wherein spatially registering the first and second medical images includes at least one of translating, rotating, shearing and scaling at least one of the first and second medical images.

19. The method of claim 17 , wherein each of the first and second medical images includes a target portion and a remainder portion and wherein spatially registering the first and second medical images includes segmenting the target portion and the remainder portion of each of the first and second medical images.

20. The method of claim 17 , wherein each of the first and second medical images includes a target portion and a remainder portion and wherein spatially registering the first and second medical images includes cropping each of the first and second medical images to contain only the target portion that is in both the first and second medical images.

21. The method of claim 20 , wherein the joint pixel value histogram is genera ted based on pixel values of only the cropped first and second medical images.

22. The method of claim 17 , wherein spatially registering the first and second medical images includes optimization of an entropy correlation coefficient of the medical images.

23. A system for registering a first medical image to a second medical image, comprising:

an input for receiving data for the first and second medical images; and

a processor generating a joint pixel value histogram using pixel values of the first and second medical images, selecting a parametric transform function from a plurality of predetermined parametric transform functions based on a first image acquisition method for the first medical image and a second image acquisition method for the second medical image, and statistically fitting parameters of the selected parametric transform function to the joint histogram to determine the values of the parameters;

wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image, and wherein the plurality of predetermined parametric transform functions includes: (1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.

24. The system of claim 23 , the processor further generating a lookup table using the selected parametric transform function and the values of the fitted parameters and applying the lookup table to the pixel values of the first medical image to generate a third medical image, the third medical image being transformed from the first medical image and registered to the second medical image.

25. The system of claim 23 , the processor further performing a computer aided detection process for comparing the second and third medical images, the system further comprising:

a display for displaying the second and third medical images with results of the computer aided detection process.

26. The system of claim 23 , wherein the plurality of predetermined parametric transform functions are one-dimensional monotonic functions.

27. The system of claim 23 , wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

28. The system of claim 23 , the processor further spatially registering the first medical image and the second medical image relative to each other.

29. The system of claim 28 , the processor further spatially registering the first and second medical images by at least one of translating, rotating, shearing and scaling at least one of the first and second medical images.

30. The system of claim 28 , wherein each of the first and second medical image includes a target portion and a remainder portion and wherein the processor spatially registers the first and second medical images by segmenting the target portion and the remainder portion of each of the first and second medical images.

31. The system of claim 28 , wherein each of the first and second medical images includes a target portion and a remainder portion and wherein the processor further crops each of the first and second medical images to contain only the target portion that is in both the first and second medical images.

32. The system of claim 31 , the processor further generating the joint pixel value histogram based on pixel values of only the cropped first and second medical images.

33. The system of claim 28 , the processor further spatially registering the first and second medical images by optimizing an entropy correlation coefficient of the first and second medical images.

34. A tangible computer readable storage medium embodied with a computer program product such that when executed directs a computing apparatus to automatically register a first medical image and a second medical image, comprising:

computer code for generating a joint pixel value histogram using pixel values of the first and second medical images;

computer code for selecting a parametric transform function from a plurality of predetermined parametric transform functions, the selecting being based on a first image acquisition method for the first medical image and a second image acquisition method for the second medical image; and

computer code for statistically fitting parameters of the selected parametric transform function to the joint pixel value histogram, the statistically fitting determines values of the parameters, wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image and wherein the plurality of predetermined parametric transform functions includes: (1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.

35. A tangible computer readable storage medium embodied with a computer program product such that when executed directs a computing apparatus to automatically register a first medical image and a second medical image, comprising:

computer code for spatially registering the first medical image and the second medical image relative to each other;

computer code for generating at least one joint pixel value histogram based on pixel values of the first and second medical images;

computer code for generating a lookup table based on the at least one joint pixel value histogram, a first image acquisition method for the first medical image and a second image acquisition method for the second medical image; and

computer code for applying the lookup table to the pixel values of the first medical image to generate a third medical image, the third medical image being transformed from the first medical image and registered to the second medical image;

wherein the computer code for generating the lookup table includes:

computer code for selecting a parametric transform function from a plurality of predetermined, parametric transform functions based on the first and second medical image acquisition methods for the first and second medical images, respectively; and

computer code for statistically fitting parameters of the selected parametric transform function to the at least one pixel value histogram, the statistically fitting determines values of the parameters, wherein the lookup table is generated using the selected parametric transform function and the values of the fitted parameters;

wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image, and wherein the plurality of predetermined parametric transform functions includes: (1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.

Assignments (13)
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2026
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: HOLOGIC, INC., ON ITS OWN BEHALF AND AS SUCCESSOR-BY-MERGER TO DIRECT RADIOGRAPHY CORP.; CYTYC CORPORATION, ON ITS OWN BEHALF AND AS SUCCESSOR-BY-MERGER TO BIOLUCENT, LLC; CYTYC SURGICAL PRODUCTS, LLC, AS SUCCESSOR-BY-CONVERSION TO CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; GEN-PROBE INCORPORATED, ON ITS OWN BEHALF AND AS SUCCESSOR-BY-MERGER TO THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE PRODESSE, INC.; SUROS SURGICAL SYSTEMS, INC.
Reel/Frame 075566/0039 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NO. 8081301 PREVIOUSLY RECORDED AT REEL: 028810 FRAME: 0745. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT. Recorded Nov 9, 2017
From: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE INCORPORATED
To: GOLDMAN SACHS BANK USA
Reel/Frame 044432/0565 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NO. 8081301 PREVIOUSLY RECORDED AT REEL: 035820 FRAME: 0239. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST RELEASE. Recorded Nov 9, 2017
From: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
To: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE INCORPORATED
Reel/Frame 044727/0529 →
SECURITY AGREEMENT Recorded Aug 7, 2015
From: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; DIRECT RADIOGRAPHY CORP.; GEN-PROBE INCORPORATED; GEN-PROBE PRODESSE, INC.; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 036307/0199 →
SECURITY INTEREST RELEASE REEL/FRAME 028810/0745 Recorded Jun 4, 2015
From: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
To: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE INCORPORATED
Reel/Frame 035820/0239 →
SECURITY AGREEMENT Recorded Aug 1, 2012
From: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE INCORPORATED
To: GOLDMAN SACHS BANK USA
Reel/Frame 028810/0745 →
TERMINATION OF PATENT SECURITY AGREEMENTS AND RELEASE OF SECURITY INTERESTS Recorded Aug 25, 2010
From: GOLDMAN SACHS CREDIT PARTNERS, L.P., AS COLLATERAL AGENT
To: HOLOGIC, INC.; R2 TECHNOLOGY, INC.; SUROS SURGICAL SYSTEMS, INC.; BIOLUCENT, LLC; DIRECT RADIOGRAPHY CORP.; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS LIMITED PARTNERSHIP; CYTYC SURGICAL PRODUCTS II LIMITED PARTNERSHIP; CYTYC SURGICAL PRODUCTS III, INC.; CYTYC PRENATAL PRODUCTS CORP.; THIRD WAVE TECHNOLOGIES, INC.
Reel/Frame 024944/0315 →
21ST SUPPLEMENT TO PATENT SECURITY AGREEMENT Recorded Mar 29, 2010
From: HOLOGIC, INC.
To: GOLDMAN SACHS CREDIT PARTNERS L.P., AS COLLATERAL AGENT
Reel/Frame 024151/0435 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2009
From: R2 TECHNOLOGY, INC.
To: HOLOGIC, INC.
Reel/Frame 023620/0362 →
PATENT SECURITY AGREEMENT Recorded Jul 29, 2008
From: R2 TECHNOLOGY, INC.
To: GOLDMAN SACHS CREDIT PARTNERS L.P., AS COLLATERAL AGENT
Reel/Frame 021301/0838 →
PATENT SECURITY AGREEMENT Recorded Oct 26, 2007
From: R2 TECHNOLOGY, INC.
To: GOLDMAN SACHS CREDIT PARTNERS L.P.
Reel/Frame 020024/0231 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2004
From: SNOEREN, PETER R.; KARSSEMEIJER, NICO
To: R2 TECHNOLOGY, INC.
Reel/Frame 015100/0143 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2004
From: SNOEREN, PETER R.
To: R2 TECHNOLOGY, INC.
Reel/Frame 014902/0323 →