Indexing and search query processing
A method for processing a search query according to one embodiment includes receiving a search query containing terms; combining at least some consecutive terms in the search query to create biwords; looking up at least some of the terms and biwords in a search index for identifying sections of documents containing the at least some of the terms and/or biwords; generating a content score for each of the identified sections based at least in part on a number of the terms and biwords found in the sections of each document, wherein the biwords are given a higher priority than matched terms, wherein the priority affects the content score; and selecting and outputting an indicator of at least one of the sections, or portion thereof, based at least in part on the content score.
1. A method for analyzing and indexing a document, comprising:
receiving a document;
converting the document to one or more text streams;
analyzing, using a processor, the one or more text streams for identifying textual contents of the document, wherein the textual content contains words and bi-words;
analyzing the one or more text streams for identifying sections of the document;
indexing the identified word or bi-word in association with the sections in which word or bi-word is located, wherein the indexing further comprises assigning a predefined priority value to each word or bi-word within each section; and
saving a result of the indexing in a data storage device.
2. The method as recited in claim 1 , wherein the document is unstructured or semistructured, the unstructured or semistructured document being in a printer format.
3. The method as recited in claim 2 , wherein the document is unstructured or semistructured, the unstructured or semistructured document being a binary representation of dark and light areas of a scanned document.
4. The method as recited in claim 3 , wherein the document as received does not contain format markers.
5. The method as recited in claim 4 , further comprising identifying a context of the document and generating meta data representing a context of at least some of the sections.
6. The method as recited in claim 1 , further comprising indexing the meta data.
7. The method as recited in claim 1 , wherein at least one of the context of the document and the context of at least some of the sections is based on a word extracted from the document and matched to a term in a context-related dictionary.
8. The method as recited in claim 1 , wherein the sections include groups of paragraphs of the document, each paragraph being individually detected by analyzing the one or more text streams.