Time-box constrained searching in a distributed search system
A method includes receiving a search query containing one or more query terms from a remote device, determining one or more entity types implicated by the search query based on the one or more query terms, and determining an entity score indicating a likelihood that the search query implicates the entity type. The method also includes identifying one or more index clusters from index clusters to search based on the one or more entity types implicated by the search query, generating a query execution plan based on the entity scores, and performing a consumer driven search on the identified index clusters based on a set of query terms corresponding to the one or more query terms and in accordance with the query execution plan to identify a delivery consideration set of records. The method also includes generating delivery search results based on the delivery consideration set of records.
1. A method comprising:
receiving, at a processing system, a search query containing one or more query terms from a remote device;
determining, by the processing system, one or more entity types implicated by the search query based on the one or more query terms, and for each entity type, determining an entity score indicating a likelihood that the search query implicates the entity type;
identifying, by the processing system, one or more index clusters from a plurality of index clusters to search based on the one or more entity types implicated by the search query, each index cluster having a plurality of tiers, and each tier including one or more search indexes;
generating, by the processing system, a query execution plan based on the entity scores of the one or more entity types, the query execution plan indicating, for each identified index cluster, i) a priority assigned to a search of the index cluster and ii) a time constraint assigned to the indicating cluster indicating a maximum amount of time allotted to search the index cluster;
performing, by the processing system, a consumer driven search on the identified index clusters based on a set of query terms corresponding to the one or more query terms and in accordance with the query execution plan to identify a delivery consideration set of records;
generating, by the processing system, delivery search results based on the delivery consideration set of records; and
transmitting the delivery search results from the processing system to the remote device;
performing, by the processing system, a continuation search, wherein performing the continuation search comprises, for each index cluster indicated in the query execution plan:
assigning a lowest priority and an unlimited time constraint to the set of query terms with respect to the index cluster;
inserting the set of query terms in a queue corresponding to the index cluster with other intent queries, each other intent query having a respective priority assigned thereto;
searching all tiers of the index cluster using the set of query terms; and
updating a continuation consideration set of records based on the searching, wherein the continuation consideration set of records indicates records identified across all of the index clusters indicated in the query execution plan.