System and method of quality assessment of a search index
View Patent ↗Systems, methods, and computer program products for enabling assessment of the quality of a search index. In one embodiment, objects are processed to produce corresponding text that is stored and indexed. The objects are also processed to identify and store corresponding metadata values for indexing. Error conditions that are detected during the processing of objects to generate corresponding text are tracked and compared to determine the most severe of the error conditions. An indication of the most severe error condition is stored in a first consolidated error field. Errors that are encountered in the identification and storage of metadata values are counted and this count is stored in a second consolidated error field. Both of the consolidated error fields are indexed in the same manner as the text and metadata for the objects, so that the stored error information can be used in queries of the search index.
1. A method for quality assessment of a search index, the method comprising:
providing a plurality of storage locations in a storage unit including a non-transitory storage media; and
for each of a plurality of objects:
storing information in one or more of the storage locations, wherein each of the storage locations is associated with one of a plurality of fields and one of the plurality of objects;
storing a first indication of one or more error conditions in one of the storage locations for the object which is associated with a first consolidated error field;
storing a second indication of one or more error conditions in one of the storage locations for the object which is associated with a second consolidated error field, wherein the second indication of one or more error conditions comprises a count of error conditions associated with storing metadata for the object;
providing a search index, wherein the search index includes a dictionary of terms that are contained in the information stored in the one or more of the storage locations, including ones of the storage locations associated with the first consolidated error field;
enabling a search of the search index for terms associated with the first consolidated error field using a search interface presented on a computer system; and
enabling retrieval of information from one or more of the storage locations in response to the search of the search index.
2. The method of claim 1 , further comprising, for each of the plurality of objects:
examining the object and processing the object to produce text associated with the object, wherein the information stored in the storage locations includes the text associated with the object, wherein the one or more error conditions occur during the processing of the object to produce the text associated with the object.
3. The method of claim 1 , further comprising, for each of the plurality of objects:
examining the object and identifying metadata associated with the object, wherein the information stored in the storage locations includes the metadata associated with the object, wherein the one or more error conditions occur during the identification or storage of the metadata associated with the object.
4. The method of claim 1 , further comprising consolidating information for a plurality of different error conditions and thereby producing the first indication of the one or more error conditions.
5. The method of claim 4 , wherein consolidating information for a plurality of error conditions comprises, for each of the plurality of objects:
comparing multiple error conditions associated with text conversion of the object and producing an indication of a severity of the multiple error conditions.
6. The method of claim 4 , wherein consolidating information for a plurality of error conditions comprises, for each of the plurality of objects:
maintaining a count of a plurality of error conditions associated with storing metadata for the object.
7. A computer program product comprising a non-transitory computer readable medium having a set of instructions stored thereon, the instructions executable by a processor to:
for each of a plurality of objects:
store information in one or more of the storage locations, wherein each of the storage locations is associated with one of a plurality of fields and one of the plurality of objects;
store a first indication of one or more error conditions in one of the storage locations for the object which is associated with a first consolidated error field;
store a second indication of one or more error conditions in one of the storage locations for the object which is associated with a second consolidated error field, wherein the second indication of one or more error conditions comprises a count of error conditions associated with storing metadata for the object;
provide a search index, wherein the search index includes a dictionary of terms that are contained in the information stored in the one or more of the storage locations, including ones of the storage locations associated with the first consolidated error field;
enable a search of the search index for terms associated with the first consolidated error field; and
enable retrieval of information from one or more of the storage locations in response to the search of the search index.
8. The computer program product of claim 7 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and process the object to produce text associated with the object, wherein the information stored in the storage locations includes the text associated with the object, wherein the one or more error conditions occur during the processing of the object to produce the text associated with the object.
9. The computer program product of claim 7 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and identify metadata associated with the object, wherein the information stored in the storage locations includes the metadata associated with the object, wherein the one or more error conditions occur during the identification or storage of the metadata associated with the object.
10. The computer program product of claim 7 , wherein the instructions are further executable by the processor to consolidate information for a plurality of different error conditions and thereby produce the first indication of the one or more error conditions.
11. The computer program product of claim 10 , wherein the instructions are executable by the processor to consolidate information for the plurality of error conditions by, for each of the plurality of objects, comparing multiple error conditions associated with text conversion of the object and producing an indication of a severity of the multiple error conditions.
12. The computer program product of claim 10 , wherein the instructions are further executable by the processor to consolidate information for the plurality of error conditions by, for each of the plurality of objects, maintaining a count of a plurality of error conditions associated with storing metadata for the object.
13. A computerized search system for quality assessment of a search index, the system comprising;
a processor; and
a storage unit coupled to the processor;
wherein the processor is configured to, for each of a plurality of objects:
store information in one or more of the storage locations, wherein each of the storage locations is associated with one of a plurality of fields and one of the plurality of objects;
store a first indication of one or more error conditions in one of the storage locations for the object which is associated with a first consolidated error field;
store a second indication of one or more error conditions in one of the storage locations for the object which is associated with a second consolidated error field, wherein the second indication of one or more error conditions comprises a count of error conditions associated with storing metadata for the object;
provide a search index, wherein the search index includes a dictionary of terms that are contained in the information stored in the one or more of the storage locations, including ones of the storage locations associated with the first consolidated error field;
enable a search of the search index for terms associated with the first consolidated error field; and
enable retrieval of information from one or more of the storage locations in response to the search of the search index.
14. The search system of claim 13 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and process the object to produce text associated with the object, wherein the information stored in the storage locations includes the text associated with the object, wherein the one or more error conditions occur during the processing of the object to produce the text associated with the object.
15. The search system of claim 13 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and identify metadata associated with the object, wherein the information stored in the storage locations includes the metadata associated with the object, wherein the one or more error conditions occur during the identification or storage of the metadata associated with the object.
16. The search system of claim 13 , wherein the instructions are further executable by the processor to consolidate information for a plurality of different error conditions and thereby produce the first indication of the one or more error conditions.
17. The search system of claim 16 , wherein the instructions are executable by the processor to consolidate information for the plurality of error conditions by, for each of the plurality of objects, comparing multiple error conditions associated with text conversion of the object and producing an indication of a severity of the multiple error conditions.
18. The search system of claim 16 , wherein the instructions are further executable by the processor to consolidate information for the plurality of error conditions by, for each of the plurality of objects, maintaining a count of a plurality of error conditions associated with storing metadata for the object.