Indexing and search query processing
A method for processing a search query according to one embodiment includes receiving a search query containing terms; combining at least some consecutive terms in the search query to create biwords; looking up at least some of the terms and biwords in a search index for identifying sections of documents containing the at least some of the terms and/or biwords; generating a content score for each of the identified sections based at least in part on a number of the terms and biwords found in the sections of each document, wherein the biwords are given a higher priority than matched terms, wherein the priority affects the content score; and selecting and outputting an indicator of at least one of the sections, or portion thereof, based at least in part on the content score.
1. A non-transitory computer readable storage medium having an inverted index structure stored thereon for access by a program configured to execute keyword searches, the inverted index structure comprising:
a plurality of content words and bi words extracted from an unstructured text document, the biwords comprising consecutive single word terms;
for each of the content words and bi words, at least one document identifier containing information about an association between the respective content word and a logical section within the unstructured text document containing the content word or bi word;
for each of the document identifiers, at least one position identifier containing first information about the logical section in the unstructured text document containing the content word or bi word and second information about a paragraph in the logical section in the unstructured text document containing the content word or biword, the first information being distinct from the second information; and
for each of the position identifiers, at least one priority bit containing a priority of the content word or biword associated with the position identifier, wherein a higher weight is assigned to word or biword matching at the position identifier with the priority bits set than at another position identifier without the priority bits set.
2. The inverted index structure as recited in claim 1 , wherein at least some of the position identifiers further contain information about a page in the unstructured text document containing the content word or biword.
3. The inverted index structure as recited in claim 1 , wherein at least some of the position identifiers include a weighting value of the content word or biword.
4. The inverted index structure as recited in claim 3 , wherein the weighting value is based at least in part on a position of the content word or biword in the unstructured text document.
5. The inverted index structure as recited in claim 1 , further comprising context meta data associated with the unstructured text document, the context meta data indicating a context of the unstructured text document associated therewith.
6. The inverted index structure as recited in claim 5 , wherein at least some of the context meta data is weighted.
7. The inverted index structure as recited in claim 1 , wherein for at least one of the position identifiers, the first information is stored within a multi-bit integer of which a first plurality of bits store a logical section identifier associated with the respective logical section and a second plurality of bits store the at least one priority bit.