Method for automatically indexing documents
View Patent ↗Methods and Systems for automatically indexing a set of base documents. Data defining all elements respectively contained within the base documents is indexed. The elements comprise an element to be checked and surrounding elements that surround the element to be checked. The received data is evaluated as to whether the element to be checked has the corresponding meaning, wherein training has been performed based on a training sample generated for base documents in which the element to be checked is surrounded by the surrounding elements and has the corresponding meaning. For those base documents where elements have been found to have the corresponding meaning, building an index indexing the base documents, the index comprising the elements having the corresponding meaning with a corresponding reference to the document in which each element is contained.
1. A method for automatically indexing a set of base documents, said method comprising:
inputting, with a computer device, data defining all elements respectively contained within the base documents which meet predefined criteria and defining a corresponding meaning, the elements comprising an element to be checked and surrounding elements that surround the element to be checked;
evaluating, with a trainable classifying apparatus in communication with the computer device which has been trained to recognize whether inputted data belongs to a corresponding classification category or not, the received data as to whether the element to be checked has the corresponding meaning, wherein the training has been performed based on a training sample generated for base documents in which the element to be checked is surrounded by the surrounding elements and has the corresponding meaning, the received data comprising data coding absolute or relative positions of the surrounding elements by corresponding text strings; and
for those base documents where elements have been found to have the corresponding meaning, building, with the computer device, an index indexing the base documents, the index comprising the elements having the corresponding meaning with a corresponding reference to the document in which each element is contained.
2. The method of claim 1 , further comprising training said classifying apparatus.
3. The method of claim 2 , wherein the training comprises using a set of documents for which the elements having the meaning of interest are already known to automatically generate text documents as training samples to train said classifying apparatus.
4. The method of claim 1 , wherein the inputting comprises:
evaluating, with the computer device, the base documents by checking for the elements respectively contained within the base documents which meet the predefined criteria and whether the elements have the corresponding meaning; and
generating, with the computer device, the data based on the evaluating.
5. The method of claim 1 , wherein:
the inputting comprises generating, with the computer device, the data; and
the data comprises a text document for the element to be checked, the text document being based on the element to be checked and its surrounding elements and including coding for the element's X-Y position and the X-Y positions of the surrounding elements.
6. A system for automatically indexing a set of base documents, said system comprising:
a trainable classifying apparatus configured for:
inputting, with a computer device, data defining all elements respectively contained within the base documents which meet predefined criteria and defining a corresponding meaning, the elements comprising an element to be checked and surrounding elements that surround the element to be checked;
evaluating, with the trainable classifying apparatus, which has been trained to recognize whether inputted data belongs to a corresponding classification category or not, the received data as to whether the element to be checked has the corresponding meaning, wherein the training has been performed based on a training sample generated for base documents in which the element to be checked is surrounded by the surrounding elements and has the corresponding meaning, the received data comprising data coding absolute or relative positions of the surrounding elements by corresponding text strings; and
for those base documents where elements have been found to have the corresponding meaning, building, with the computer device, an index indexing the base documents, the index comprising the elements having the corresponding meaning with a corresponding reference to the document in which each element is contained.
7. The system of claim 6 , wherein the classifying apparatus is configured to be trained by using a set of documents for which the elements having the meaning of interest are already known to automatically generate text documents as training samples to train said classifying apparatus.
8. The system of claim 6 , wherein the inputting comprises:
evaluating, with the computer device, the base documents by checking for the elements respectively contained within the base documents which meet the predefined criteria and whether the elements have the corresponding meaning; and
generating, with the computer device, the data based on the evaluating.
9. The system of claim 6 , wherein:
the inputting comprises generating, with the computer device, the data; and
the data comprises a text document for the element to be checked, the text document being based on the element to be checked and its surrounding elements and including coding for the element's X-Y position and the X-Y positions of the surrounding elements.