Systems and methods for query term analytics
A query term analytics system receives a search query from a user device. The system has an engine enhanced with the ability to track query terms using in-memory counters and leveraging an inverted index of content stored in a content repository. The search query is run on the content and, contemporaneously the engine performs a query term analysis on the query terms to produce query term analytics. The query term analysis includes an impact analysis that determines an impact of removing a keyword or keyword criteria from the search query. A compressed bitset can be used to indicate whether a keyword is in the content. The engine can accumulate statistics using the in-memory counters while the search query is being processed. Using the statistics thus accumulated, a query term analytics report is generated and provided to the user device for presentation on the user device.
1. A method, comprising:
receiving, by a query term analytics system from a user device, a search query containing query terms and keyword criteria, wherein the keyword criteria specify a location within content to be searched, the query term analytics system having a processor, a query processing engine executing on the processor, a computer memory communicatively connected to the query processing engine, counters in the computer memory, and a query term analytics report generator;
processing, by the query processing engine, the search query against content stored in a content repository;
contemporaneously with the processing and as the search query is being run against the content stored in the content repository, performing, by the query processing engine, a query term analysis by performing an impact analysis on the search query, wherein performing the impact analysis comprises:
modifying the search query by removing and adding at least one of a respective query term and keyword criteria of the search query, thereby generating one or more modified search queries, comprising keywords corresponding to the respective query terms in the modified search queries;
determining, during the execution of the search query, a number of hits in the inverted index for the keywords of each modified search query based on the keyword criteria of the corresponding modified search query, the query term analysis producing query term analytics including the number of hits on the keywords during execution of the search query;
providing, by the query processing engine to the query term analytics report generator, the query term analytics on the keywords and keyword criteria in the modified search queries, wherein the query term analytics are provided without further selection from the user device;
generating, by the query term analytics report generator based on the query term analytics, a query term analytics report describing the query term analytics for the modified search queries; and
returning the search query results of the search query against the content stored in the content repository.
2. The method according to claim 1 , wherein impact analysis includes determining a number of hits responsive to the query term, the keyword, or the keyword criteria being excluded from or included in the search query.
3. The method according to claim 1 , wherein performing the query term analysis includes keeping track of the query terms in the search query using the counters in the memory and leveraging the inverted index of the content stored in the content repository.
4. The method according to claim 3 , wherein keeping track of the query terms in the search query includes updating a compressed bitset to indicate whether the content has a particular query term, a particular keyword, or particular keyword criteria.
5. The method according to claim 1 , wherein performing the query term analysis includes accumulating statistics using the counters in the computer memory as a query term in the search query is being processed and wherein the query term analytics report is generated using the statistics thus accumulated.
6. The method according to claim 1 , further comprising:
providing the query term analytics report to the user device for presentation on the user device.
7. The method according to claim 1 , wherein the content comprises a document or an electronic message.
8. A query term analytics system, comprising:
a processor;
a computer memory; and
stored instructions translatable by the processor for:
receiving, from a user device, a search query containing query terms and keyword criteria, wherein the keyword criteria specify a location within content to be searched;
processing the search query against content stored in a content repository;
contemporaneously with the processing and as the search query is being run against the content stored in the content repository, performing a query term analysis by performing an impact analysis on the search query, wherein performing the impact analysis comprises:
modifying the search query by removing and adding at least one of a respective query term and keyword criteria of the search query, thereby generating one or more modified search queries, comprising keywords corresponding to the respective query terms in the modified search queries;
determining, during the execution of the search query, a number of hits in the inverted index for the keywords of each modified search query based on the keyword criteria of the corresponding modified search query, the query term analysis producing query term analytics including the number of hits on the keywords during execution of the search query;
generating, based on the query term analytics, a query term analytics report describing the query term analytics for the modified search queries; and
returning the search query results of the search query against the content stored in the content repository.
9. The query term analytics system of claim 8 , wherein the impact analysis includes determining a number of hits responsive to the query term, the keyword, or the keyword criteria being excluded from or included in the search query.
10. The query term analytics system of claim 8 , wherein performing the query term analysis includes keeping track of the query terms in the search query using the counters in the memory and leveraging the inverted index of the content stored in the content repository.
11. The query term analytics system of claim 10 , wherein keeping track of the query terms in the search query includes updating a compressed bitset to indicate whether the content has a particular query term, a particular keyword, or particular keyword criteria.
12. The query term analytics system of claim 8 , wherein performing the query term analysis includes accumulating statistics using the counters in the computer memory as a query term in the search query is being processed and wherein the query term analytics report is generated using the statistics thus accumulated.
13. The query term analytics system of claim 8 , wherein the stored instructions are further translatable by the processor for:
providing the query term analytics report to the user device for presentation on the user device.
14. The query term analytics system of claim 8 , wherein the content comprises a document or an electronic message.
15. A computer program product comprising a non-transitory computer-readable medium storing instructions translatable by a processor of a query term analytics system for:
receiving, from a from a user device, a search query containing query terms and keyword criteria, wherein the keyword criteria specify a location within content to be searched, the query term analytics system having a processor, a query processing engine executing on the processor, a computer memory communicatively connected to the query processing engine, counters in the computer memory, and a query term analytics report generator;
processing, by the query processing engine, the search query against content stored in a content repository;
contemporaneously with the processing and as the search query is being run against the content stored in the content repository, performing, by the query processing engine, a query term analysis by performing an impact analysis on the search query, wherein performing the impact analysis comprises:
modifying the search query by removing and adding at least one of a respective query term and keyword criteria of the search query, thereby generating one or more modified search queries, comprising keywords corresponding to the respective query terms in the modified search queries;
determining, during the execution of the search query, a number of hits in the inverted index for the keywords of each modified search query based on the keyword criteria of the corresponding modified search query, the query term analysis producing query term analytics including the number of hits on the keywords during execution of the search query;
providing the query term analytics on the keywords and keyword criteria in the modified search queries, wherein the query term analytics are provided without further selection from the user device;
generating, by the query term analytics report generator based on the query term analytics, a query term analytics report describing the query term analytics for the modified search queries; and
returning the search query results of the search query against the content stored in the content repository.
16. The computer program product of claim 15 , wherein the impact analysis includes determining a number of hits responsive to the query term, the keyword, or the keyword criteria being excluded from or included in the search query.
17. The computer program product of claim 15 , wherein performing the query term analysis includes keeping track of the query terms in the search query using the counters in the memory and leveraging the inverted index of the content stored in the content repository.
18. The computer program product of claim 17 , wherein keeping track of the query terms in the search query includes updating a compressed bitset to indicate whether the content has a particular query term, a particular keyword, or particular keyword criteria.
19. The computer program product of claim 15 , wherein performing the query term analysis includes accumulating statistics using the counters in the computer memory as a query term in the search query is being processed and wherein the query term analytics report is generated using the statistics thus accumulated.
20. The computer program product of claim 15 , wherein the stored instructions are further translatable by the processor for:
providing the query term analytics report to the user device for presentation on the user device.