Using an ID domain to improve searching
Methods which use an ID domain to improve searching are described. An embodiment describes an index phase in which an image of a document is converted into the ID domain. This is achieved by dividing the text in the image into elements and mapping each element to an identifier. Similar elements are mapped to the same identifier. Each element in the text is then replaced by the appropriate identifier to create a version of the document in the ID domain. This version may be indexed and searched. Another embodiment describes a query phase in which a query is converted into the ID domain and then used to search an index of identifiers which has been created from collections of documents which have been converted into the ID domain. The conversion of the query may use mappings which were created during the index phase or alternatively may use pre-existing mappings.
1. A system comprising:
a processor;
an input for receiving a query; and
a memory arranged to store executable instructions arranged to cause the processor to:
convert the query into an image;
perform a comparison between elements in the image to a cluster table associated with a font, the cluster table defining mappings between image elements and identifiers associated with the image elements;
create a query defined in terms of identifiers based on the comparison between elements of the image and the cluster table associated with the font; and
search an index of identifiers created from at least one document image using the query defined in terms of identifiers based on the comparison between elements of the image and the cluster table associated with the font;
divide text in an image of a document into a plurality of elements;
arrange the plurality of elements into clusters of similar elements;
allocate a unique one of the identifiers to each cluster;
order the identifiers according to an order of a language of each page of the text;
replace each element in the image of the document with one or more identifiers, one of the one or more identifiers comprising the identifier corresponding to the unique identifier of the cluster comprising the element; and
create an index of identifiers in the image of the document.
2. The system according to claim 1 , wherein the query is created by replacing each element in the image with at least one identifier based on the comparison.
3. The system according to claim 2 , wherein the query is created by replacing each element in the image with N identifiers corresponding to the N most similar image elements in the cluster table.
4. The system according to claim 3 , wherein each of said N identifiers has an associated weight and wherein the search of an index of identifiers uses the query defined in terms of identifiers and the weight associated with each of the identifiers.
5. The system according to claim 1 , wherein the memory is further arranged to store executable instructions arranged to cause the processor to:
convert the query into another image using another font different from the font;
create another query defined in terms of identifiers based on a comparison between elements of the other image and a cluster table associated with the other font different from the font; and
search another index of identifiers created from at least one document image using the other query defined in terms of identifiers based on the comparison between elements of the other image and the cluster table associated with the other font different from the font.
6. The system according to claim 1 , wherein the query defined in terms of identifiers is created by:
replacing each element in the image with at least one identifier based on the comparison; and
creating a query comprising a restricted sequence of identifiers.