System and method of quality assessment of a search index
View Patent ↗Systems, methods, and computer program products for enabling assessment of the quality of a search index. In one embodiment, objects are processed to produce corresponding text that is stored and indexed. The objects are also processed to identify and store corresponding metadata values for indexing. Error conditions that are detected during the processing of objects to generate corresponding text are tracked and compared to determine the most severe of the error conditions. An indication of the most severe error condition is stored in a first consolidated error field. Errors that are encountered in the identification and storage of metadata values are counted and this count is stored in a second consolidated error field. Both of the consolidated error fields are indexed in the same manner as the text and metadata for the objects, so that the stored error information can be used in queries of the search index.
1. A method for quality assessment of a search index, the method comprising:
providing a plurality of storage locations in a storage unit; and
for each of a plurality of objects:
storing information in one or more of the storage locations, wherein each of the storage locations is associated with one of a plurality of fields and one of the plurality of objects;
storing a first indication of one or more error conditions in one of the storage locations for the object which is associated with a first consolidated error field;
providing a search index, wherein the search index includes a dictionary of terms that are contained in the information stored in the one or more of the storage locations, including ones of the storage locations associated with the first consolidated error field;
enabling a search of the search index for terms associated with the first consolidated error field;
enabling retrieval of information from one or more of the storage locations in response to the search of the search index; and
consolidating information for a plurality of different error conditions and thereby producing the first indication of the one or more error conditions by, for each of the plurality of objects, maintaining a count of a plurality of error conditions associated with storing metadata for the object.
2. The method of claim 1 , further comprising, for each of the plurality of objects:
examining the object and processing the object to produce text associated with the object, wherein the information stored in the storage locations includes the text associated with the object, wherein the one or more error conditions occur during the processing of the object to produce the text associated with the object.
3. The method of claim 1 , further comprising, for each of the plurality of objects:
examining the object and identifying metadata associated with the object, wherein the information stored in the storage locations includes the metadata associated with the object, wherein the one or more error conditions occur during the identification or storage of the metadata associated with the object.
4. The method of claim 1 , wherein consolidating information for a plurality of error conditions comprises, for each of the plurality of objects:
comparing multiple error conditions associated with text conversion of the object and producing an indication of a highest error condition of the multiple error conditions.
5. The method of claim 4 , wherein the method further comprises storing a second indication of one or more error conditions in one of the storage locations for the object which is associated with a second consolidated error field, wherein the second indication of one or more error conditions comprises the count of the plurality of error conditions associated with storing metadata for the object.
6. A computer program product comprising a non-transitory computer readable medium having a set of instructions stored thereon, the instructions executable by a processor to:
for each of a plurality of objects:
store information in one or more of the storage locations, wherein each of the storage locations is associated with one of a plurality of fields and one of the plurality of objects;
store a first indication of one or more error conditions in one of the storage locations for the object which is associated with a first consolidated error field;
provide a search index, wherein the search index includes a dictionary of terms that are contained in the information stored in the one or more of the storage locations, including ones of the storage locations associated with the first consolidated error field;
enable a search of the search index for terms associated with the first consolidated error field;
enable retrieval of information from one or more of the storage locations in response to the search of the search index; and
consolidate information for a plurality of different error conditions and thereby produce the first indication of the one or more error conditions by, for each of the plurality of objects, maintaining a count of a plurality of error conditions associated with storing metadata for the object.
7. The computer program product of claim 6 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and process the object to produce text associated with the object, wherein the information stored in the storage locations includes the text associated with the object, wherein the one or more error conditions occur during the processing of the object to produce the text associated with the object.
8. The computer program product of claim 6 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and identify metadata associated with the object, wherein the information stored in the storage locations includes the metadata associated with the object, wherein the one or more error conditions occur during the identification or storage of the metadata associated with the object.
9. The computer program product of claim 6 , wherein the instructions are executable by the processor to consolidate information for the plurality of error conditions by, for each of the plurality of objects, comparing multiple error conditions associated with text conversion of the object and producing an indication of a highest error condition of the multiple error conditions.
10. The computer program product of claim 9 , wherein the instructions are further executable by the processor to store a second indication of one or more error conditions in one of the storage locations for the object which is associated with a second consolidated error field, wherein the second indication of one or more error conditions comprises a count of a plurality of error conditions associated with storing metadata for the object.
11. The computer program product of claim 6 , wherein the instructions are further executable by the processor to consolidate information for the plurality of error conditions by, for each of the plurality of objects, maintaining a count of a plurality of error conditions associated with storing metadata for the object.
12. A computerized search system for quality assessment of a search index, the system comprising;
a processor; and
a storage unit coupled to the processor and storing instructions that are executable by the processor;
wherein the processor is configured to execute the instructions to, for each of a plurality of objects:
store information in one or more of the storage locations, wherein each of the storage locations is associated with one of a plurality of fields and one of the plurality of objects;
store a first indication of one or more error conditions in one of the storage locations for the object which is associated with a first consolidated error field;
provide a search index, wherein the search index includes a dictionary of terms that are contained in the information stored in the one or more of the storage locations, including ones of the storage locations associated with the first consolidated error field;
enable a search of the search index for terms associated with the first consolidated error field; and
enable retrieval of information from one or more of the storage locations in response to the search of the search index,
wherein the instructions are further executable by the processor to consolidate information for a plurality of different error conditions and thereby produce the first indication of the one or more error conditions by, for each of the plurality of objects, maintaining a count of a plurality of error conditions associated with storing metadata for the object.
13. The search system of claim 12 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and process the object to produce text associated with the object, wherein the information stored in the storage locations includes the text associated with the object, wherein the one or more error conditions occur during the processing of the object to produce the text associated with the object.
14. The search system of claim 12 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and identify metadata associated with the object, wherein the information stored in the storage locations includes the metadata associated with the object, wherein the one or more error conditions occur during the identification or storage of the metadata associated with the object.
15. The search system of claim 12 , wherein the instructions are executable by the processor to consolidate information for the plurality of error conditions by, for each of the plurality of objects, comparing multiple error conditions associated with text conversion of the object and producing an indication of a highest error condition of the multiple error conditions.
16. A computerized search system for quality assessment of a search index, the system comprising;
a processor; and
a storage unit coupled to the processor and storing instructions that are executable by the processor;
wherein the processor is configured to execute the instructions to, for each of a plurality of objects:
store information in one or more of the storage locations, wherein each of the storage locations is associated with one of a plurality of fields and one of the plurality of objects;
store a first indication of one or more error conditions in one of the storage locations for the object which is associated with a first consolidated error field;
provide a search index, wherein the search index includes a dictionary of terms that are contained in the information stored in the one or more of the storage locations, including ones of the storage locations associated with the first consolidated error field;
enable a search of the search index for terms associated with the first consolidated error field; and
enable retrieval of information from one or more of the storage locations in response to the search of the search index,
wherein the instructions are further executable by the processor to consolidate information for a plurality of different error conditions and thereby produce the first indication of the one or more error conditions, wherein consolidating information for a plurality of error conditions comprises, for each of the plurality of objects:
comparing multiple error conditions associated with text conversion of the object and producing an indication of the most severe one of the multiple error conditions, and
wherein the instructions are further executable by the processor to store a second indication of one or more error conditions in one of the storage locations for the object which is associated with a second consolidated error field, wherein the second indication of one or more error conditions comprises a count of a plurality of error conditions associated with storing metadata for the object.
17. The search system of claim 16 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and process the object to produce text associated with the object, wherein the information stored in the storage locations includes the text associated with the object, wherein the one or more error conditions occur during the processing of the object to produce the text associated with the object.
18. The search system of claim 16 , wherein the instructions are further executable by the processor to, for each of the plurality of objects, examine the object and identify metadata associated with the object, wherein the information stored in the storage locations includes the metadata associated with the object, wherein the one or more error conditions occur during the identification or storage of the metadata associated with the object.