Normalized search
Systems and methods of searching by a processor are described herein. In accordance with one aspect of the present disclosure, a master index having a plurality of index documents corresponding to artifacts stored in a repository is generated. An index document maps contents from a source artifact to index categories having different default boost values indicating relative importance of the index categories. A search query is fired by a user to search the master index. A result list of artifacts having contents matching (hit) the search query is generated. Artifacts are ranked in the list based on hit scores according to number of hits, which categories the hits occurred and the default boost values of the index categories.
1. A method of searching by a processor comprising:
generating a master index having a plurality of index documents corresponding to artifacts stored in a repository,
wherein an index document is associated with a source artifact, the index document indexes the associated source artifact according to a list of index keys,
wherein index keys are separated into index categories corresponding to logical levels of source artifacts, the logical levels include metadata and content levels,
wherein index categories are assigned respective boost values to indicate relative importance of the index categories,
index keys are assigned boost values of their associated index categories:
firing a search query by a user to search the master index;
generating a result list of artifacts matching (hit) the search query; and
ranking artifacts in the list based on hit scores of the artifacts (artifact hit scores), wherein
an artifact hit score is based on a total score of individual hits (individual hit scores) of the artifact,
an individual hit score of an artifact is equal to the boost value of the assigned boost value of the index key associated with the hit.
2. The method of claim 1 wherein the artifacts comprise business intelligence artifacts.
3. The method of claim 1 wherein the hit scores are calculated based on a sum of all index category scores, wherein each index category score is equal to the number of hits in that category multiplied by the boost value.
4. The method of claim 1 wherein the index categories are based on structures of the artifacts in the repository.
5. The method of claim 2 wherein the index categories corresponding to logical levels of source artifacts comprise:
enterprise metadata, wherein enterprise metadata relates to content which identifies different artifacts in the repository;
document metadata, wherein document metadata relates to general meta properties of an artifact in the repository;
content metadata, wherein content metadata relates to different fields in an artifact; and
content, wherein content relates to content in an artifact.
6. The method of claim 1 wherein the boost values for the different index categories are configurable depending on the relative importance of the index categories.
7. The method of claim 6 wherein the index categories and boost values comprise:
enterprise metadata configured with the highest boost value;
document metadata configured with the second highest boost value;
content metadata configured with the third highest boost value; and
content configured with the lowest boost value.
8. The method of claim 1 wherein the artifacts stored in the repository includes artifacts having different types of structures.
9. The method of claim 1 comprises processing the search query to form an internal search query which is used to search the index documents in the master index.
10. The method of claim 9 wherein processing the search query comprises:
forming sub-classes associating a term of the search query with each of the index categories; and
ORing the sub-classes to form the internal search query.
11. The method of claim 10 wherein forming sub-classes are performed for all terms of the search query and ORing the sub-classes of all terms to form the internal search query.
12. The method of claim 1 comprises generating usage history documents, wherein a user history document includes user ID, artifact ID, search term, and history hit counts in the different index categories with respect to the user ID, artifact ID and search term.
13. The method of claim 12 comprises storing usage history document in the master index.
14. The method of claim 12 wherein the boost values are default boost values which are changed to dynamic boost values based on the usage history documents with respect to the search term, user ID, artifact ID and hit counts in the different index categories in the usage history documents.
15. The method of claim 14 wherein the dynamic boost values are applied to derive the hit score of the artifact corresponding to a document ID for those index categories having hit counts exceeding a minimum threshold value.
16. The method of claim 1 comprises generating device type documents, wherein a device type document includes an artifact ID and device types which have accessed artifact corresponding to the artifact ID.
17. The method claim 16 wherein rankings of the artifacts are modified based on device type which the user is using.
18. A non-transitory computer-readable medium having stored thereon program code, the program code is executable by a computer to:
generate a master index having a plurality of index documents corresponding to artifacts stored in a repository,
wherein an index document is associated with a source artifact, the index document indexes the associated source artifact according to a list of index keys,
wherein index keys are separated into index categories corresponding to logical levels of source artifacts, the index categories comprises
enterprise metadata, wherein enterprise metadata relates to content which identifies different artifacts in the repository,
document metadata, wherein document metadata relates to general meta properties of an artifact in the repository,
content metadata, wherein content metadata relates to different fields in an artifact, and
content, wherein content relates to content in an artifact,
wherein index categories are assigned respective boost values to indicate relative importance of the index categories,
index keys are assigned boost values of their associated index categories;
fire a search query by a user to search the master index;
generate a result list of artifacts matching (hit) the search query; and
rank artifacts in the list based on hit scores of the artifacts (artifact hit scores), wherein
an artifact hit score is based on a total score of individual hits (individual hit scores) of the artifact,
an individual hit score of an artifact is equal to the boost value of the assigned boost value of the index key associated with the hit.
19. The non-transitory computer-readable medium of claim 18 wherein the boost values are default boost values and the program code is further executable by the computer to change the default boost values to dynamic boost values based on user usage history documents with respect to a search term, user ID, artifact ID and hit counts in the different index categories in the usage history documents.
20. A system comprising:
a memory for storing non-transitory computer-readable program code; and
a processor in communication with the memory, the processor being operative with the computer-readable program code to
generate a master index having a plurality of index documents corresponding to artifacts stored in a repository,
wherein an index document is associated with a source artifact, the index document indexes the associated source artifact according to a list of index keys, wherein index keys are separated into index categories corresponding to logical levels of source artifacts, wherein the index categories comprise
enterprise metadata, wherein enterprise metadata relates to content which identifies different artifacts in the repository,
document metadata, wherein document metadata relates to general meta properties of an artifact in the repository,
content metadata, wherein content metadata relates to different fields in an artifact, and
content, wherein content relates to content in an artifact, and
wherein index categories are assigned respective boost values to indicate relative importance of the index categories,
index keys are assigned boost values of their associated index categories;
fire a search query by a user to search the master index;
generate a result list of artifacts matching (hit) the search query; and
rank artifacts in the list based on hit scores of the artifacts (artifact hit scores), wherein
an artifact hit score is based on score of individual hits (individual hit scores) of the artifact,
an individual hit score of an artifact is equal to the boost value of the assigned boost value of the index key associated with the hit.