Entity based query filtering
In an example embodiment, one or more query terms are obtained. For each of the one or more query terms, a standardized entity taxonomy is searched to locate a standardized entity that most closely matches the query term. A confidence score is calculated for the query term-standardized entity pair for the standardized entity that most closely matches the query term. In response to a determination that the confidence score transgresses a threshold, the query term is associated with an entity identification corresponding to the standardized entity that most closely matches the query term. One or more query rewriting rules corresponding to an entity type of the standardized entity having the entity identification are obtained. The one or more query rewriting rules are executed to rewrite the first query such that the rewritten query, when performed on a data source, returns fewer search results than the first query would have.
1. A computer-implemented method, comprising:
obtaining one or more query terms in a first query; and
for each of the one or more query terms:
searching a standardized entity taxonomy to locate a standardized entity that most closely matches the query term, the standardized entity taxonomy comprising an entity identification for each of a plurality of different standardized entities;
calculating a confidence score for a query term-standardized entity pair for the standardized entity that most closely matches the query term;
in response to a determination that the confidence score transgresses a threshold, associating the query term with the entity identification corresponding to the standardized entity that most closely matches the query term;
retrieving one or more query rewriting rules corresponding to an entity type of the standardized entity having the entity identification; and
executing the one or more query rewriting rules to rewrite the first query such that the rewritten query is more restrictive than the first query.
2. The method of claim 1 , wherein the one or more query rewriting rules include adding the standardized entity having the entity identification to the first query with an AND connector.
3. The method of claim 1 , wherein the one or more query rewriting rules include determining if the query term comprises two or more words and, in response to a determination that the query term comprises two or more words, adding the two or more words as a phrase to the first query with an AND connector.
4. The method of claim 1 , wherein the entity type is a skill and the one or more query rewriting rules include determining if there are any standardized titles having an affinity score with the standardized entity that most closely matches the query term higher than a preset threshold, and adding any such standardized titles to the first query with an AND connector.
5. The method of claim 2 , wherein the entity type is a skill and the one or more query rewriting rules include determining if there are any skills similar to the standardized entity having the entity identification, and adding any such similar skills to the standardized entity having the entity identification to the first query with an OR connector.
6. The method of claim 1 , wherein the entity type is a skill and the one or more query rewriting rules include identifying a standardized function corresponding to the standardized entity having the entity identification in the standardized entity taxonomy and adding the standardized function to the first query with an AND connector.
7. The method of claim 1 , wherein the confidence score indicates a statistical likelihood that a user specifying the query term in a search query would have, under ideal circumstances, also entered the corresponding standardized entity in the search query, based on a confidence score model trained via a machine learning algorithm based on member profiles and member activities in a social networking service.
8. A system comprising:
a computer-readable medium having instructions stored thereon, which, when executed by a processor, cause the system to:
obtain one or more query terms in a first query; and
for each of the one or more query terms:
search a standardized entity taxonomy to locate a standardized entity that most closely matches the query term, the standardized entity taxonomy comprising an entity identification for each of a plurality of different standardized entities;
calculate a confidence score for a query term-standardized entity pair for the standardized entity that most closely matches the query term;
in response to a determination that the confidence score transgresses a threshold, associate the query term with the entity identification corresponding to the standardized entity that most closely matches the query term;
retrieve one or more query rewriting rules corresponding to an entity type of the standardized entity having the entity identification; and
execute the one or more query rewriting rules to rewrite the first query such that the rewritten query is more restrictive than the first query.
9. The system of claim 8 , wherein the one or more query rewriting rules include adding the standardized entity having the entity identification to the first query with an AND connector.
10. The system of claim 8 , wherein the one or more query rewriting rules include determining if the query term comprises two or more words and, in response to a determination that the query term comprises two or more words, adding the two or more words as a phrase to the first query with an AND connector.
11. The system of claim 8 , wherein the entity type is a skill and the one or more query rewriting rules include determining if there are any standardized titles having an affinity score with the standardized entity that most closely matches the query term higher than a preset threshold, and adding any such standardized titles to the first query with an AND connector.
12. The system of claim 9 , wherein the entity type is a skill and the one or more query rewriting rules include determining if there are any skills similar to the standardized entity having the entity identification, and adding any such similar skills to the standardized entity having the entity identification to the first query with an OR connector.
13. The system of claim 8 , wherein the entity type is a skill and the one or more query rewriting rules include identifying a standardized function corresponding to the standardized entity having the entity identification in the standardized entity taxonomy and adding the standardized function to the first query with an AND connector.
14. The system of claim 8 , wherein the confidence score indicates a statistical likelihood that a user specifying the query term in a search query would have, under ideal circumstances, also entered the corresponding standardized entity in the search query, based on a confidence score model trained via a machine learning algorithm based on member profiles and member activities in a social networking service.
15. A non-transitory machine-readable storage medium comprising instructions, which when implemented by one or more machines, cause the one or more machines to perform operations comprising:
obtaining one or more query terms in a first query; and
for each of the one or more query terms:
searching a standardized entity taxonomy to locate a standardized entity that most closely matches the query term, the standardized entity taxonomy comprising an entity identification for each of a plurality of different standardized entities;
calculating a confidence score for a query term-standardized entity pair for the standardized entity that most closely matches the query term;
in response to a determination that the confidence score transgresses a threshold, associating the query term with the entity identification corresponding to the standardized entity that most closely matches the query term;
retrieving one or more query rewriting rules corresponding to an entity type of the standardized entity having the entity identification; and
executing the one or more query rewriting rules to rewrite the first query such that the rewritten query is more restrictive than the first query.
16. The non-transitory machine-readable storage medium of claim 15 , wherein the one or more query rewriting rules include adding the standardized entity having the entity identification to the first query with an AND connector.
17. The non-transitory machine-readable storage medium of claim 15 , wherein the one or more query rewriting rules include determining if the query term comprises two or more words and, in response to a determination that the query term comprises two or more words, adding the two or more words as a phrase to the first query with an AND connector.
18. The non-transitory machine-readable storage medium of claim 15 , wherein the entity type is a skill and the one or more query rewriting rules include determining if there are any standardized titles having an affinity score with the standardized entity that most closely matches the query term higher than a preset threshold, and adding any such standardized titles to the first query with an AND connector.
19. The non-transitory machine-readable storage medium of claim 16 , wherein the entity type is a skill and the one or more query rewriting rules include determining if there are any skills similar to the standardized entity having the entity identification, and adding any such similar skills to the standardized entity having the entity identification to the first query with an OR connector.
20. The non-transitory machine-readable storage medium of claim 15 , wherein the entity type is a skill and the one or more query rewriting rules include identifying a standardized function corresponding to the standardized entity having the entity identification in the standardized entity taxonomy and adding the standardized function to the first query with an AND connector.