Techniques for navigational query identification
To accurately classify a query as navigational, thousands of available features are explored, extracted from major commercial search engine results, user Web search click data, query log, and the whole Web's relational content. To obtain the most useful features for navigational query identification, a three level system is used which integrates feature generation, feature integration, and feature selection in a pipeline. Because feature selection plays a key role in classification methodologies, the best feature selection method is coupled with the best classification approach to achieve the best performance for identifying navigational queries. According to one embodiment, linear Support Vector Machine (SVM) is used to rank features and the top ranked features are fed into a Stochastic Gradient Boosting Tree (SGBT) classification method for identifying whether or not a particular query is a navigational query.
1. A method comprising performing a machine-executed operation involving instructions for identifying a navigational query, wherein the machine-executed operation is at least one of:
A) storing said instructions onto a volatile or non-volatile storage medium; and
B)executing the instructions;
wherein said instructions are instructions which, when executed by one or more processors, cause performance of:
determining whether a query is a navigational query by
receiving a set of query-URL pair-wise features based at least in part on said query in conjunction with an associated query result set;
integrating subsets of said set of query-URL pair-wise features to generate a set of query-based features that are independent of any particular URL;
automatically selecting, from said set of query-based features, a subset of most effective features for identifying navigational queries, wherein said selecting is based on a machine learning feature selection method;
based on said subset of most effective features, using a machine learning classification method to determine whether said query is a navigational query.
2. The method of claim 1 , wherein said machine learning feature selection method is a linear support vector machine method.
3. The method of claim 1 , wherein said machine learning classification method is a stochastic gradient boosting tree method.
4. The method of claim 1 , wherein said machine learning feature selection method is a linear support vector machine method and said machine learning classification method is a stochastic gradient boosting tree method.
5. The method of claim 1 , wherein said receiving comprises receiving a set of query-URL pair-wise features based on information from a click engine, a Web-map, and a query log.
6. The method of claim 1 , wherein said receiving comprises receiving a set of query-URL pair-wise features comprising click features, URL features, and anchor text features.
7. The method of claim 1 , wherein said integrating comprises generating said set of query-based features based on statistics associated with said subsets of said set of query-URL pair-wise features.
8. The method of claim 1 , wherein said integrating comprises generating said set of query-based features based in part on statistics associated with a click-based subset of said set of query-URL pair-wise features.
9. The method of claim 1 , wherein said integrating comprises generating said set of query-based features based in part on statistics associated with a URL-based subset of said set of query-URL pair-wise features.
10. The method of claim 1 , wherein said integrating comprises generating said set of query-based features based in part on statistics associated with an anchor text-based subset of said set of query-URL pair-wise features.
11. The method of claim 1 , wherein said integrating comprises generating said set of query-based features based in part on a normalized ratio operator defined as r k (f i )=[max(f j )−f jk ]/[max(f j )−min(f j )] where k=2, 5, 10, 20.
12. The method of claim 1 , wherein said selecting comprises selecting, from said set of query-based features, a subset of approximately fifty most effective features for identifying navigational queries.
13. The method of claim 1 , wherein said instructions are instructions which, when executed by one or more processors, cause performance of:
in response to determining that said query is a navigational query, returning only a subset of said query result set.
14. The method of claim 1 , wherein said machine learning feature selection method is an information gain method.
15. The method of claim 1 , wherein said machine learning feature selection method is a gradient boosting tree method.
16. The method of claim 1 , wherein said machine learning classification method is a naive Bayes method.
17. The method of claim 1 , wherein said machine learning classification method is a maximum entropy method.
18. The method of claim 1 , wherein said machine learning classification method is a support vector machine method.