Granted Patent B2

US 6,973,213 · App. 09/977,186 · Granted Dec 6, 2005

Abstract

Claims (54)

1. An image segmentation process comprising the following steps:

a) segmenting an image into a main background, a first local background, and a first object, wherein the first object is on either the main background or the first local background;

b) classifying the first object into one class of a group of classes consisting of a text object, a picture object, and a composite object;

c) if the first object is classified as a composite object, identifying a second local background for the first object; and

d) segmenting a next object on the second local background.

2. The process set forth in claim 1 , further comprising the following steps:

e) classifying the next object into one class of a group of classes consisting of a text object, a picture object, and a composite object; and

f) if the next object is classified as a composite object, performing steps c) through e) for the next object.

3. The process set forth in claim 1 , step a)further comprising the following steps:

e) identifying one or more block of pixels in the image, wherein the dynamic ranges of each of the three color channels are less than a predetermined threshold for the block;

f) applying a region growing algorithm to each uniform block, wherein adjacent pixels with a color difference from the uniform block less than a predetermined threshold are marked as belonging to the region;

g) calculating a mean color for each grown region;

h) combining regions of similar mean color; and

i) identifying the region with the largest bounding area as the main background for the image.

4. The process set forth in claim 1 , step a) further comprising the following steps:

e) detecting edges in the main background in both vertical and horizontal directions;

f) removing the edge pixels from the main background;

g) identifying a non-text object on the main background using a connect component analysis; and

h) segmenting the non-text object on the main background.

5. The process set forth in claim 1 , wherein the first object is classified as a composite object, step c) further comprising the following steps:

e) detecting edges in the first object;

f) removing the edge pixels from the first object;

g) applying a region growing algorithm to each pixel on the outer boundary of the removed edge pixels, wherein adjacent pixels with a color difference from the region less than a predetermined threshold are marked as belonging to the region; and

h) identifying the region with the largest bounding area;

i) comparing the dimensions of the largest region to a predetermined threshold; and

j) if the dimensions of the largest region are greater than the predetermined threshold, identifying the region as the second local background for the first object, otherwise, reclassifying the first object as a picture object.

6. The process set forth in claim 2 , steps d) and e) further comprising the following steps:

g) applying a one-dimensional morphological algorithm to the second local background in the horizontal direction to segment the next object and classifying the next object as a text object if the width of the elements detected by the algorithm is less than a maximal width; and

h) applying a one-dimensional morphological algorithm to the second local background in the vertical direction to segment the next object and classifying the next object as a text object if the width of the elements detected by the algorithm is less than a maximal width.

7. The process set forth in claim 1 , step d) further comprising the following steps:

e) detecting edges in the second local background in both vertical and horizontal directions;

f) removing the edge pixels from the second local background; and

g) segmenting the next object on the second local background using a connect component analysis.

8. A method for segmenting an image, comprising the following steps:

a) identifying a main background for the image;

b) identifying a first object on the main background;

c) classifying the first object into one class of a group of classes consisting of a text object, a picture object, and a composite object;

d) if the first object is classified as a composite object, identifying a local background for the first object;

e) if the first object is classified as a composite object, identifying a second object on the local background; classifying the second object into one class of a group of classes consisting of a text object, a picture object, and a composite object; and if the second object is classified as a composite object; identifying a local background for the second object.

9. The method set forth in claim 8 , further comprising the following steps:

h) if the second object is classified as a composite object, identifying a third object on the local background of the second object;

i) classifying the third object into one class of a group of classes consisting of a text object, a picture object, and a composite object; and

j) if the third object is classified as a composite object, identifying a local background for the third object.

10. The method set forth in claim 8 , further comprising the following steps:

i) if the second object is classified as a composite object, identifying a third object on the local background of the second object;

j) classifying the third object into one class of a group of classes consisting of a text object, a picture object, and a composite object; and

k) if the third object is classified as a composite object, identifying a local background for the third object.

11. A method for segmenting an image, comprising the following steps:

a) identifying a main background for the image;

b) identifying a first object on the main background;

c) classifying the first object into one class of a group of classes consisting of a text object, a picture object, and a composite object; and

d) if the first object is classified as a composite object, identifying a local background for the first object;

e) if the first object is classified as a composite object, determining if the dimensions of the local background of the first object are greater than a predetermined threshold; and

f) if the dimensions are not greater than the predetermined threshold, reclassifying the first object as a picture object.

Assignments (8)