AUTOMATIC STATE ASSIGNMENT TO DOCUMENTS BASED ON PHRASE OCCURRENCE IN TEXT
Fuzzy document state assignment includes loading into memory a raster image of a document and performing OCR upon a page of a document in order to produce parseable text. The parseable text is then segmented and normalized and an index is generated from the segmented and normalized text. Thereafter, a probability of a particular classification is computed based upon the detection in the index of a combination of words associated with a corresponding classification. Finally, the document is annotated with the particular classification.
1 . A method for fuzzy document state assignment comprising:
loading into memory a raster image of a document;
performing optical character recognition (OCR) upon a page of a document in order to produce parseable text;
text segmenting and normalizing the parseable text;
generating an index of the text segmented and normalized parseable text;
computing a probability of a particular classification based upon detecting in the index a combination of words associated with a corresponding classification; and,
annotating the document with the particular classification.
2 . The method of claim 1 , wherein the document comprises multiple pages and the process of performing the OCR, generating the index, computing the probability and annotating the document repeats for each of the multiple pages.
3 . The method of claim 2 , wherein the annotation of the document based upon performing the process for a first one of the pages is displayed in a display screen of a computer before completing a performance of the process for a second one of the pages.
4 . The method of claim 1 , further comprising annotating the document with the computed probability as a confidence of the particular classification.
5 . The method of claim 1 , further comprising transmitting the parseable text and the raster image with an electronic message to an inbox for second level review of the particular classification.
6 . The method of claim 1 , wherein the computation of the probability is based upon a threshold number of words in the index present in a classification table association the words with the corresponding classification.
7 . A data processing system adapted for fuzzy document state assignment, the system comprising:
a host computing platform comprising one or more computers, each with memory and one or processing units including one or more processing cores; and,
a fuzzy document state assignment module comprising computer program instructions enabled while executing in the memory of at least one of the processing units of the host computing platform to perform:
loading into the memory a raster image of a document;
performing optical character recognition (OCR) upon a page of a document in order to produce parseable text;
text segmenting and normalizing the parseable text;
generating an index of the text segmented and normalized parseable text;
computing a probability of a particular classification based upon detecting in the index a combination of words associated with a corresponding classification; and,
annotating the document with the particular classification.
8 . The system of claim 7 , wherein the document comprises multiple pages and the process of performing the OCR, generating the index, computing the probability and annotating the document repeats for each of the multiple pages.
9 . The system of claim 7 , wherein the annotation of the document based upon performing the process for a first one of the pages is displayed in a display screen of a computer before completing a performance of the process for a second one of the pages.
10 . The system of claim 7 , wherein the program instructions further perform annotating the document with the computed probability as a confidence of the particular classification.
11 . The system of claim 7 , wherein the program instructions further perform transmitting the parseable text and the raster image with an electronic message to an inbox for second level review of the particular classification.
12 . The system of claim 7 , wherein the computation of the probability is based upon a threshold number of words in the index present in a classification table association the words with the corresponding classification.
13 . A computing device comprising a non-transitory computer readable storage medium having program instructions stored therein, the instructions being executable by at least one processing core of a processing unit to cause the processing unit to perform a method for fuzzy document state assignment, the method including:
loading into memory a raster image of a document;
performing optical character recognition (OCR) upon a page of a document in order to produce parseable text;
text segmenting and normalizing the parseable text;
generating an index of the text segmented and normalized parseable text;
computing a probability of a particular classification based upon detecting in the index a combination of words associated with a corresponding classification; and,
annotating the document with the particular classification.
14 . The device of claim 13 , wherein the document comprises multiple pages and the process of performing the OCR, generating the index, computing the probability and annotating the document repeats for each of the multiple pages.
15 . The device of claim 14 , wherein the annotation of the document based upon performing the process for a first one of the pages is displayed in a display screen of a computer before completing a performance of the process for a second one of the pages.
16 . The device of claim 13 , wherein the method further includes annotating the document with the computed probability as a confidence of the particular classification.
17 . The device of claim 13 , wherein the method further includes transmitting the parseable text and the raster image with an electronic message to an inbox for second level review of the particular classification.
18 . The device of claim 13 , wherein the computation of the probability is based upon a threshold number of words in the index present in a classification table association the words with the corresponding classification.