IP Library Granted Patent US 7,689,038
Granted Patent B2
US 7,689,038 · App. 11/328,354 · Granted Mar 30, 2010

Method for improved image segmentation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,689,038
App. No.
11/328,354
Granted
Mar 30, 2010
Kind
B2
Abstract

An improved image segmentation algorithm is provided that identifies each object in an image. Pixels of the image are sorted based on a range of attribute values of the image. These pixels are then added to a labeling image one by one starting with an extreme point in the range of attribute values. Features are calculated for each object located and these features are matched with pre-defined acceptance criteria. If there is a match, the object is output to an output image. The steps of adding pixels to the image, evaluating the features of the resulting objects and outputting the objects are repeated until a stopping point is reached.

Claims (48)

1. A method to identify each object in an image, said method comprising steps of:

a. sorting pixels based on a range of attribute values of said image;

b. adding one of said sorted pixels to a labeling image to locate an object in said labeling image;

c. outputting said object onto an output image if features of said object match a pre-defined acceptance criteria; and

d. starting with one extreme point in said range of attribute values, performing steps b and c repeatedly utilizing a computer until another extreme point in said range of attribute values is reached.

2. The method to identify each object in the image, as per claim 1 , wherein said pixels are sorted based on any of the following attribute values: brightness, hue, or gradient.

3. The method to identify each object in the image, as per claim 1 , wherein said object is located by adding said one of said sorted pixels to the labeling image to create a new object or an updated old object.

4. The method to identify each object in the image, as per claim 3 , wherein said new object is created if said added pixel is not adjacent to another pixel or object already placed on said labeling image.

5. The method to identify each object in the image, as per claim 3 , wherein said updated old object is created if said added pixel is adjacent to already existing said old object or if said added pixel joins two old objects already existing on said labeling image.

6. The method to identify each object in the image, as per claim 1 , wherein said object is assigned a label, wherein labels are updated for each added pixel.

7. The method to identify each object in the image, as per claim 6 , wherein said label of said object builds on labels from a previously added pixel.

8. The method to identify each object in the image, as per claim 1 , wherein said features of said object are calculated from features of an object located when a pixel was previously added.

9. The method to identify each object in the image, as per claim 1 , wherein said object is output to said output image only if said object's features calculated when said sorted pixel is added are a better match to said acceptance criteria than said object's features calculated for all previously added pixels.

10. The method to identify each object in the image, as per claim 1 , wherein said method is performed on two-dimensional or three-dimensional images from biological or non-biological applications.

11. The method to identify each object in the image, as per claim 10 , wherein said object in said biological applications is any of the following: a cell, a nucleus, cytoplasm, a nuclear or cytoplasmic inclusion, clustered cells, or an object within images produced by imaging devices.

12. The method to identify each object in the image, as per claim 10 , wherein said object in said non-biological applications is any of the following: a component on a circuit board, or a man-made or natural object in a satellite image.

13. The method to identify each object in the image, as per claim 1 , wherein said features are any of the following: perimeter, area, object moment of inertia, eccentricity, elliptical axes, best fit to an ellipse, contrast, grey value, optical density mean, standard deviation, or texture.

14. The method to identify each object in the image, as per claim 1 , wherein said acceptance criteria are any of the following: size, shape, texture, color, or density.

15. The method to identify each object in the image, as per claim 1 , wherein said method uses multiple acceptance criteria to identify different kinds of objects in said labeling image simultaneously.

16. The method to identify each object in the image, as per claim 1 , wherein steps b and c are performed repeatedly until a point representing background pixels values in said range of attribute values, or a point in said range of attribute values representing pixel values not related to said objects being located, is reached.

17. A computer readable medium having computer readable program code embodied therein for execution by a processor to perform a method comprising:

a. sorting pixels based on a range of attribute values of said image;

b. adding one of said sorted pixels to a labeling image to locate an object in said labeling image;

c. outputting said object onto an output image if features of said object match a pre-defined acceptance criteria; and

d. starting with one extreme point in said range of attribute values, performing steps b and c repeatedly until another extreme point in said range of attribute values is reached.

18. The computer readable medium having computer readable program code embodied therein for execution by the processor to perform the method, as per claim 17 , wherein steps b and c are performed repeatedly until a point representing background pixels values in said range of attribute values, or a point in said range of attribute values representing pixel values not related to said objects being located, is reached.

19. A method to identify each object in an image under a plurality of threshold values, said method comprising steps of:

a. sorting pixels in said image based on a range of attribute values of said pixels, wherein said range of attribute values correspond to said plurality of threshold values;

b. adding one of said pixels to a labeling image to create a new object or update an old object;

c. calculating features of said created new object or said updated old object;

d. matching said calculated features of said created new object or said updated old object with a pre-defined criteria;

e. outputting said created new object or said updated old object on an output image if an acceptance criteria is satisfied for said features; and

f. staffing with one extreme point in said range of attribute values, performing steps b through e repeatedly utilizing a computer until a stopping point is reached, said stopping point being selected from the group consisting of: another extreme point in said range of values, a point representing background pixels values in said range of attribute values, and a point in said range of attribute values representing pixel values not related to said new object or said updated old object.

20. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said pixels are sorted based on any of the following attribute values: brightness, hue, or gradient.

21. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said plurality of threshold values is brightness, hue, or gradient.

22. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said new object is created if said added pixel is not adjacent to another pixel or object already placed on said labeling image.

23. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said updated old object is created if said added pixel is adjacent to already existing said old object or if said added pixel joins two old objects already existing on said labeling image.

24. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said method is performed on two-dimensional or three-dimensional images from biological or non-biological applications.

25. The method to identify each object in the image under the plurality of threshold values, as per claim 24 , wherein said object in said biological applications is any of the following: a cell, a nucleus, cytoplasm, a nuclear or cytoplasmic inclusion, clustered cells or an object within images produced by imaging devices.

26. The method to identify each object in the image under the plurality of threshold values, as per claim 24 , wherein said object in said non-biological applications is any of the following: a component on a circuit board, or a man-made or natural object in a satellite image.

27. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said features are any of the following:

perimeter, area, object moment of inertia, eccentricity, elliptical axes, best fit to an ellipse, contrast, grey value, optical density mean, standard deviation, or texture.

28. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said acceptance criteria are any of the following: size, shape, texture, color, or density.

29. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said method uses multiple acceptance criteria to identify different kinds of objects in said labeling image simultaneously.

30. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said created new object or said updated old object is assigned a label, wherein labels are updated for each added pixel.

31. The method to identify each object in the image under the plurality of threshold values, as per claim 30 , wherein said labels build on labels from a previously added pixel.

32. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said features of said created new object or said updated old object are calculated from features of an object located when a pixel was previously added.

33. The method to identify each object in the image under the plurality of threshold values, as per claim 19 , wherein said updated old object is output to said output image only if features of said updated old object calculated when said sorted pixel is added are a better match to said acceptance criteria than features of said updated old object calculated for all previously added pixels.

Assignments (11)
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2026
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: HOLOGIC, INC., ON ITS OWN BEHALF AND AS SUCCESSOR-BY-MERGER TO DIRECT RADIOGRAPHY CORP.; CYTYC CORPORATION, ON ITS OWN BEHALF AND AS SUCCESSOR-BY-MERGER TO BIOLUCENT, LLC; CYTYC SURGICAL PRODUCTS, LLC, AS SUCCESSOR-BY-CONVERSION TO CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; GEN-PROBE INCORPORATED, ON ITS OWN BEHALF AND AS SUCCESSOR-BY-MERGER TO THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE PRODESSE, INC.; SUROS SURGICAL SYSTEMS, INC.
Reel/Frame 075566/0039 →
SECURITY INTEREST Recorded Apr 8, 2026
From: BIOTHERANOSTICS, INC.; GEN-PROBE INCORPORATED; GEN-PROBE PRODESSE, INC.; CYTYC CORPORATION; SUROS SURGICAL SYSTEMS, INC.; GYNESONICS, INC.; BOLDER SURGICAL, LLC; FAXITRON BIOPTICS, LLC; HEALTH BEACONS, INC.; HOLOGIC, INC.
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 075462/0440 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NO. 8081301 PREVIOUSLY RECORDED AT REEL: 035820 FRAME: 0239. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST RELEASE. Recorded Nov 9, 2017
From: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
To: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE INCORPORATED
Reel/Frame 044727/0529 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NO. 8081301 PREVIOUSLY RECORDED AT REEL: 028810 FRAME: 0745. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT. Recorded Nov 9, 2017
From: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE INCORPORATED
To: GOLDMAN SACHS BANK USA
Reel/Frame 044432/0565 →
SECURITY AGREEMENT Recorded Aug 7, 2015
From: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; DIRECT RADIOGRAPHY CORP.; GEN-PROBE INCORPORATED; GEN-PROBE PRODESSE, INC.; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 036307/0199 →
SECURITY INTEREST RELEASE REEL/FRAME 028810/0745 Recorded Jun 4, 2015
From: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
To: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE INCORPORATED
Reel/Frame 035820/0239 →
SECURITY AGREEMENT Recorded Aug 1, 2012
From: HOLOGIC, INC.; BIOLUCENT, LLC; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS, LIMITED PARTNERSHIP; SUROS SURGICAL SYSTEMS, INC.; THIRD WAVE TECHNOLOGIES, INC.; GEN-PROBE INCORPORATED
To: GOLDMAN SACHS BANK USA
Reel/Frame 028810/0745 →
TERMINATION OF PATENT SECURITY AGREEMENTS AND RELEASE OF SECURITY INTERESTS Recorded Aug 26, 2010
From: GOLDMAN SACHS CREDIT PARTNERS, L.P., AS COLLATERAL AGENT
To: HOLOGIC, INC.; R2 TECHNOLOGY, INC.; SUROS SURGICAL SYSTEMS, INC.; BIOLUCENT, LLC; DIRECT RADIOGRAPHY CORP.; CYTYC SURGICAL PRODUCTS II LIMITED PARTNERSHIP; CYTYC SURGICAL PRODUCTS LIMITED PARTNERSHIP; CYTYC CORPORATION; CYTYC SURGICAL PRODUCTS III, INC.; CYTYC PRENATAL PRODUCTS CORP.; THIRD WAVE TECHNOLOGIES, INC.
Reel/Frame 024892/0001 →
PATENT SECURITY AGREEMENT Recorded Jul 29, 2008
From: CYTYC CORPORATION
To: GOLDMAN SACHS CREDIT PARTNERS L.P., AS COLLATERAL AGENT
Reel/Frame 021301/0879 →
PATENT SECURITY AGREEMENT Recorded Oct 26, 2007
From: CYTYC CORPORATION
To: GOLDMAN SACHS CREDIT PARTNERS L.P.
Reel/Frame 020018/0529 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2006
From: ZAHNISER, MICHAEL; DIAGNOSTIC VISION CORPORATION
To: CYTYC CORPORATION
Reel/Frame 017438/0804 →