Automatic generation of taxonomies for categorizing queries and search query processing using taxonomies
Systems and methods for processing search requests are provided, including automatic generation of taxonomies and query processing using those taxonomies.
1. A computer-implemented method for generating at least one taxonomy automatically from data about queries in a querying system, the method comprising:
generating, from query logs representing previous queries, a concept network identifying unit concepts represented in the queries, wherein the concept network reflects tangentially related topics determined by considering frequency of appearance of terms in the query logs and frequency of appearance of terms together in queries;
generating a particular taxonomy by organizing the concept network hierarchically with a parent node and two or more immediate child nodes of the parent node;
wherein generating the particular taxonomy comprises: (a) attempting to categorize a particular previous query in a first taxonomy, (b) determining that the particular previous query cannot be categorized in the first taxonomy, (c) categorizing the particular previous query in a first category of a second taxonomy that differs from the first taxonomy, (d) determining that a mapping from the first category in the second taxonomy to a second category in the first taxonomy exists, and (e) in response to determining that the mapping exists, categorizing the particular previous query in the second category of the first taxonomy; and
providing data that is derived based on the particular taxonomy.
2. The method of claim 1 , further comprising providing media content to the client.
3. The method of claim 1 , wherein a client-side application executes instructions, communicating with server systems to process and display the data.
4. The method of claim 1 , further comprising populating one or more indexes with web site and query data from other indexes and data collection technologies.
5. The method of claim 1 , further comprising automatically processing and ranking web content tangentially related to a search query.
6. The method of claim 1 , wherein a given unit is assigned to a child node with branches higher up in the particular taxonomy representing broader categories and branches lower in the particular taxonomy representing more specific categories.
7. The method of claim 1 , further comprising recording user query activity in the form of the query logs.
8. The method of claim 1 , further comprising:
performing a search of a corpus using a current query; and
modifying search results according to a mapping of the current query onto the particular taxonomy.
9. The method of claim 1 , wherein one of the first taxonomy and the second taxonomy is a geographically organized taxonomy, and wherein the other one of the first taxonomy and the second taxonomy is not a geographically organized taxonomy.
10. A system executing an application that performs operations comprising:
generating in computer memory, from query logs representing previous queries, a concept network identifying unit concepts represented in the queries, wherein the concept network reflects tangentially related topics determined by considering frequency of appearance of terms in the query logs and frequency of appearance of terms together in queries;
generating in the computer memory a particular taxonomy by organizing the concept network hierarchically with a parent node and two or more immediate child nodes of the parent node;
wherein generating the particular taxonomy comprises: (a) attempting to categorize a particular previous query in a first taxonomy, (b) determining that the particular previous query cannot be categorized in the first taxonomy, (c) categorizing the particular previous query in a first category of a second taxonomy that differs from the first taxonomy, (d) determining that a mapping from the first category in the second taxonomy to a second category in the first taxonomy exists, and (e) in response to determining that the mapping exists, categorizing the particular previous query in the second category of the first taxonomy; and
providing data that is derived based on the particular taxonomy.
11. The system of claim 10 , wherein the operations further comprise:
performing a search of a corpus using a current query; and
modifying search results according to a mapping of the current query onto the particular taxonomy.
12. The system of claim 10 , wherein one of the first taxonomy and the second taxonomy is a geographically organized taxonomy, and wherein the other one of the first taxonomy and the second taxonomy is not a geographically organized taxonomy.